-- Logs begin at Tue 2021-11-23 18:43:26 UTC, end at Tue 2021-11-23 19:50:26 UTC. -- Nov 23 19:14:50.098552 dv-cinder-819011-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Nov 23 19:14:50.109444 dv-cinder-819011-1-iscsi devstack@keystone.service[79219]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Nov 23 19:14:50.109956 dv-cinder-819011-1-iscsi devstack@keystone.service[79219]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 23 19:14:50 2021] *** Nov 23 19:14:50.109956 dv-cinder-819011-1-iscsi devstack@keystone.service[79219]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 23 19:14:50.109956 dv-cinder-819011-1-iscsi devstack@keystone.service[79219]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 23 19:14:50.109956 dv-cinder-819011-1-iscsi devstack@keystone.service[79219]: nodename: dv-cinder-819011-1-iscsi Nov 23 19:14:50.109956 dv-cinder-819011-1-iscsi devstack@keystone.service[79219]: machine: x86_64 Nov 23 19:14:50.109956 dv-cinder-819011-1-iscsi devstack@keystone.service[79219]: clock source: unix Nov 23 19:14:50.109956 dv-cinder-819011-1-iscsi devstack@keystone.service[79219]: pcre jit disabled Nov 23 19:14:50.109956 dv-cinder-819011-1-iscsi devstack@keystone.service[79219]: detected number of CPU cores: 4 Nov 23 19:14:50.109956 dv-cinder-819011-1-iscsi devstack@keystone.service[79219]: current working directory: / Nov 23 19:14:50.109956 dv-cinder-819011-1-iscsi devstack@keystone.service[79219]: detected binary path: /usr/bin/uwsgi-core Nov 23 19:14:50.109956 dv-cinder-819011-1-iscsi devstack@keystone.service[79219]: your processes number limit is 47680 Nov 23 19:14:50.109956 dv-cinder-819011-1-iscsi devstack@keystone.service[79219]: your memory page size is 4096 bytes Nov 23 19:14:50.109956 dv-cinder-819011-1-iscsi devstack@keystone.service[79219]: detected max file descriptor number: 2048 Nov 23 19:14:50.109956 dv-cinder-819011-1-iscsi devstack@keystone.service[79219]: lock engine: pthread robust mutexes Nov 23 19:14:50.109956 dv-cinder-819011-1-iscsi devstack@keystone.service[79219]: thunder lock: enabled Nov 23 19:14:50.110713 dv-cinder-819011-1-iscsi devstack@keystone.service[79219]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Nov 23 19:14:50.110713 dv-cinder-819011-1-iscsi devstack@keystone.service[79219]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 23 19:14:50.154626 dv-cinder-819011-1-iscsi devstack@keystone.service[79219]: Python main interpreter initialized at 0x557e6059e9c0 Nov 23 19:14:50.154626 dv-cinder-819011-1-iscsi devstack@keystone.service[79219]: python threads support enabled Nov 23 19:14:50.154626 dv-cinder-819011-1-iscsi devstack@keystone.service[79219]: your server socket listen backlog is limited to 100 connections Nov 23 19:14:50.154626 dv-cinder-819011-1-iscsi devstack@keystone.service[79219]: your mercy for graceful operations on workers is 90 seconds Nov 23 19:14:50.155000 dv-cinder-819011-1-iscsi devstack@keystone.service[79219]: mapped 403077 bytes (393 KB) for 2 cores Nov 23 19:14:50.155070 dv-cinder-819011-1-iscsi devstack@keystone.service[79219]: *** Operational MODE: preforking *** Nov 23 19:14:50.155331 dv-cinder-819011-1-iscsi devstack@keystone.service[79219]: *** uWSGI is running in multiple interpreter mode *** Nov 23 19:14:50.155331 dv-cinder-819011-1-iscsi devstack@keystone.service[79219]: spawned uWSGI master process (pid: 79219) Nov 23 19:14:50.155536 dv-cinder-819011-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Nov 23 19:14:50.157608 dv-cinder-819011-1-iscsi devstack@keystone.service[79219]: spawned uWSGI worker 1 (pid: 79232, cores: 1) Nov 23 19:14:50.157608 dv-cinder-819011-1-iscsi devstack@keystone.service[79219]: spawned uWSGI worker 2 (pid: 79233, cores: 1) Nov 23 19:14:50.157608 dv-cinder-819011-1-iscsi devstack@keystone.service[79219]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 23 19:14:55.262186 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 19:14:55.262186 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: from cryptography.utils import int_from_bytes Nov 23 19:14:55.262977 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 19:14:55.262977 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: from cryptography.utils import int_from_bytes Nov 23 19:14:55.264697 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 19:14:55.264697 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: from cryptography.utils import int_from_bytes Nov 23 19:14:55.265171 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 23 19:14:55.265171 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: from cryptography.utils import int_from_bytes Nov 23 19:14:55.311317 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 23 19:14:55.311497 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 23 19:14:55.311687 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] command line args: [] {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 23 19:14:55.311844 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 23 19:14:55.311937 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 23 19:14:55.312049 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 23 19:14:55.312135 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ================================================================================ {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 23 19:14:55.312240 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] command line args: [] {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 23 19:14:55.312351 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] admin_token = **** {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.312510 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 23 19:14:55.312594 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] config_dir = [] {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.312687 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ================================================================================ {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 23 19:14:55.312764 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.312927 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] config_source = [] {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.313001 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] admin_token = **** {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.313155 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] debug = True {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.313235 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] config_dir = [] {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.313311 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.313548 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.313548 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] config_source = [] {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.313677 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.313743 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] debug = True {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.313806 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.313953 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.314077 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.314187 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.314289 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.314385 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.314492 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] list_limit = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.314608 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.314711 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] log_config_append = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.314820 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.314923 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.315025 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] log_dir = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.315125 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] list_limit = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.315225 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] log_file = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.315325 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] log_config_append = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.315325 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.315533 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.315628 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] log_dir = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.315727 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.315822 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] log_file = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.315911 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.315989 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.316110 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.316193 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.316264 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.316334 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.316460 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.316582 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.316664 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.316741 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.316857 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.316939 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.317011 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.317130 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.317238 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.317353 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.317475 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.317629 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.317749 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.317823 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.317937 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.318056 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.318164 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.318291 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.318435 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.318812 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.319028 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.319173 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.62/identity {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.319309 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.319392 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] publish_errors = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.319572 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.319798 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.62/identity {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.319927 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.320008 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.320078 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] publish_errors = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.320200 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.320274 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.320428 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.320503 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.320590 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.320666 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] standard_threads = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.320834 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.320918 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.321070 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.321152 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.321254 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.321335 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] standard_threads = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.321437 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] use_journal = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.321548 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.321625 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] use_json = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.321768 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] use_stderr = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.321843 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.321941 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] use_syslog = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.322033 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.322112 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] use_journal = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.322235 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.322316 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] use_json = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.322398 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.322475 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] use_stderr = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.322599 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] use_syslog = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.322676 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.322830 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 23 19:14:55.322936 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.323082 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.323160 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.323319 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.323396 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.324112 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.324496 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.324577 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.324650 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.324729 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.324807 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.324885 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.325013 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.325096 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.325174 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.325286 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.325385 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.325534 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.325636 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.325743 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.325847 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.325944 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.326052 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.326158 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.326268 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.326354 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.326503 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.326629 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.326724 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.326801 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.326987 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.327072 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.327227 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.327308 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.327466 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.327552 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.327724 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.327809 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.327979 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.328062 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.328226 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.328461 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.328588 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.328710 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.328710 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.328953 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.329092 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.329221 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.329344 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.329473 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.329549 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.329616 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.329698 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.329771 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.329836 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.329899 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.330027 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.330159 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.330258 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.330365 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.330482 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.330616 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.330726 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.330865 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.330950 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.331098 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.331175 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.331330 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.331413 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.331579 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.331667 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.331829 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.331906 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.332053 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.332135 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.332280 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.332371 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.332505 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.332590 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.332730 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.332806 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.332960 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.333038 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.333188 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.333265 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.333436 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.333516 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.333661 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.333737 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.333883 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.333961 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.334114 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.334191 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.334345 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.334423 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.334579 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.334657 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.334803 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.334879 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.335032 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.335113 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.335261 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.335338 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.335491 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.335567 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.335740 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.335817 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.335972 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.336056 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.336210 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.336293 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.336448 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.336525 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.336687 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.336766 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.336923 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.337001 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.337153 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.337238 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.337382 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.337473 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.337654 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.337741 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.337885 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.337963 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.338119 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.338197 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.338349 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.338434 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.338609 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.338715 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.338846 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.338958 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.339165 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.340246 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.340381 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.340474 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.340557 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.340630 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.340706 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.340778 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.340849 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.340918 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.340996 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.341069 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.341138 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.341288 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.341369 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.341533 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.341625 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.341779 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.341856 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.342015 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.342098 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.342253 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.342338 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.342479 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.342562 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.342705 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.342789 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.342933 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.343019 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.343165 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.343242 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.343391 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.343468 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.343626 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.343712 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.343857 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.343934 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.344094 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.344169 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.344323 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.344408 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.344557 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.344633 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.344790 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.344874 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.345032 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.345133 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.345258 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] auth.external = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.345334 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.345514 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.345594 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.345761 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.345853 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.346020 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.346099 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.346244 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] auth.password = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.346325 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.346469 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] auth.token = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.346548 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.346705 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.346782 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] auth.external = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.346936 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.347013 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.347177 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.347262 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.347402 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.347480 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.347644 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.347721 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] auth.password = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.347869 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] auth.token = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.347943 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.348100 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.348176 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.348329 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] credential.caching = True {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.348406 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.348570 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.348648 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.348799 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.348901 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.349042 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.349126 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.349277 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.349355 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.349528 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.349609 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.349759 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.349835 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] credential.caching = True {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.350000 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.350086 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.350245 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.350329 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.350473 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.350557 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.350715 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.350791 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.350960 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.351040 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.351195 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.351273 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.351442 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.351532 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.351682 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.351760 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.351919 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.351995 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.352150 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] federation.caching = True {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.352226 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.352395 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.352481 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.352636 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.352721 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.352876 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.352954 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.353100 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.353180 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.353341 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.353448 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.353594 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.353671 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] federation.caching = True {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.353844 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.353924 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.354075 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.354153 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.354325 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.354403 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.354556 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.354636 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.354821 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.355339 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.355424 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] identity.caching = True {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.355497 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.355578 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.355652 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.355723 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.355793 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.355864 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.355941 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.356024 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.356098 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.356169 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.356314 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.356400 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.356551 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] identity.caching = True {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.356638 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.356801 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.356879 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.357050 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.357127 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.357278 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.357356 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.357529 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.357609 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.357761 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.357839 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.357996 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.358075 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.358234 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.358312 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.358477 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.358562 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.358730 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.358810 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.358962 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.359039 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.359196 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.359274 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.359428 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.359509 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.359671 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.359749 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.359900 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.359985 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.360134 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.360218 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.360359 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.360438 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.360590 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.360667 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.360827 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.360907 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.361062 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.361140 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.361305 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.361394 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.361545 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.361619 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.361788 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.361867 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.362022 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.362098 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.362253 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.362337 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.362492 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.362568 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.362730 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.362812 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.362955 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.363040 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.363189 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.363266 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.363421 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.363528 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.363685 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.363761 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.363870 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.363949 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.364104 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.364181 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.364335 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.364413 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.364564 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.364641 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.364800 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.364881 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.365032 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.365111 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.365256 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.365331 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.365507 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.365587 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.365747 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.365825 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.365986 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.366066 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.366213 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.366289 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.366444 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.366526 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.366673 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.366756 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.366898 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.user = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.366975 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.367132 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.367210 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.367379 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.367455 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.367604 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.367680 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.367846 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.367924 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.368081 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.368157 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.368317 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.368401 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.368544 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.368620 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.user = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.368769 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.368845 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.368999 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.369083 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.369232 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.369309 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.369487 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.369568 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.369717 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.369806 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.369961 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.370039 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.370203 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.370279 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.370466 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.370622 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.370711 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.370869 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.370937 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.371110 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.371203 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.371395 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.371616 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.371696 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.371845 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.371921 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.372077 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.372161 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.372309 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.372387 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.372550 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.372627 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.372795 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.372882 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.373027 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.373102 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.373261 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.373336 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.373511 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.373600 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.373752 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.373829 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.373984 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.374060 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.374217 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.374300 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.374446 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.374522 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.374687 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.374763 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.374923 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.375008 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.375151 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.375228 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.375383 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.375460 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.375619 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.375706 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] resource.caching = True {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.375864 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.375941 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.376100 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.376183 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.376330 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.376414 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.376564 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.376639 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.376809 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.376884 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.377040 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.377125 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.377271 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.377347 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.377523 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.377602 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.377759 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.377852 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] resource.caching = True {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.377989 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] role.caching = True {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.378066 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.378230 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] role.driver = sql {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.378307 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.378455 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.378540 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.378698 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.378776 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.378939 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.379022 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.379176 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.379260 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.379415 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.379491 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.379656 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.379735 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.379898 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.379983 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.380132 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] role.caching = True {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.380209 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.380373 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.380448 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] role.driver = sql {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.380599 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.380685 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.380844 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.380925 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.381085 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.381162 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.381327 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.381436 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.381590 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.381667 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.381838 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.381976 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.382086 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.382208 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.382334 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.382454 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.382584 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.382697 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.382817 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.382940 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.383065 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.383183 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.383311 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.383413 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.383559 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.383732 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.383820 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.383892 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.384129 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.384205 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.384356 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.384434 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.384582 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.384658 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.384807 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.384883 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.385052 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.385130 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.385302 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.385378 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.385568 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.385646 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.385802 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.385880 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.386547 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.386631 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.386776 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.386930 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.386995 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] token.caching = True {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.387089 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.387235 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.387345 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.387473 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.387566 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.387704 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.387784 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.387955 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.388035 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.388196 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.388284 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.388427 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.388505 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.388664 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.388742 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.388900 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.388987 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.389146 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.389224 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] token.caching = True {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.389375 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.389473 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.389632 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.389723 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.389861 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.389940 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.390101 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.390180 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.390342 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.390428 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.390566 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.390644 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.390804 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.390882 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.391058 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.391143 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.391306 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.391383 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] database.connection = **** {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.391540 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.391616 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.391779 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.391864 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.392008 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.392085 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.392244 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.392319 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.392474 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.392565 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.392705 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.392783 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.392935 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.393012 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.393165 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.393250 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.393450 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.393532 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] database.connection = **** {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.393685 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.393775 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.393923 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.394002 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.394152 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.394238 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.394395 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.394624 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.394701 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.394863 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.394941 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.395088 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.395167 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.395321 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.395400 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.395550 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.395627 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.395706 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 23 19:14:55.395822 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.396066 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.396311 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.396547 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.396797 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.397033 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.397279 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.397541 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.397786 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.398023 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 23 19:14:55.398194 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 23 19:14:55.425174 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.425399 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.425647 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.426936 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.427170 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.427396 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.434887 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.436928 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.464256 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.464484 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.466685 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.466921 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.606583 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.607213 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.655267 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.655493 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.658219 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.658457 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.722226 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.722448 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.722536 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.722669 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.722754 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.722887 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.722970 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.723101 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.723184 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.723316 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.723444 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.723561 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.746969 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.747191 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.747299 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.747412 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.747496 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.747632 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.747788 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.747942 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.748024 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.748098 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.748171 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.748243 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.748310 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.748466 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.759374 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.759860 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.772353 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.772583 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.772696 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.772807 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.772891 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.773025 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.773107 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.773239 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.773322 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.773542 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.773626 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.773758 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.773839 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.773974 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 23 19:14:55.790652 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.790856 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 23 19:14:55.791189 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.791386 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 23 19:14:55.791559 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.791641 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.791716 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 23 19:14:55.791897 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.792049 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.792155 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.792273 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 23 19:14:55.792454 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.792533 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.792952 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.793227 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.793508 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.803189 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.803459 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.803721 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.803994 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.804652 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.804931 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.805204 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.805509 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.812490 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:55.814194 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:55.815669 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:55.815942 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.816218 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.816603 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.816880 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.817138 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.817394 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:55.817559 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.817687 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.817769 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.817938 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.818021 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.818204 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.818339 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.818466 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.818877 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.819139 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.819407 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.819679 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.819949 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.820219 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.820483 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.845415 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.846988 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:55.847259 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.847342 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.848863 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:55.849141 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.852344 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:55.852616 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.852895 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.854379 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:55.854657 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.854959 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.860174 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:55.860409 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.862172 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:55.862455 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.866468 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:55.866747 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.867021 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.867297 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.867561 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.867823 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.868082 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.868341 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.868537 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:55.868822 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.869105 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.869390 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.869689 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.869963 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.870232 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.871831 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.887654 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.887921 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.890580 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.890859 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.892328 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:55.895280 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:55.895843 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.896130 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.898834 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.899127 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.900958 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:55.904335 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:55.904622 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:55.908016 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:55.908267 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.908558 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.908834 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.909117 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.909397 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.909706 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.911729 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.912024 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.912302 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.912591 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.912867 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.913143 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.928687 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:55.929058 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.929322 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.929604 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.932335 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:55.932710 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.933177 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.933467 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.937358 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.939033 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.939305 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.941161 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.942283 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:55.942564 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.942843 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.942925 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.943120 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.943280 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.943387 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.946363 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:55.946641 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.946926 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.947208 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.947499 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.957494 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:55.957766 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.958035 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.958306 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.958581 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.958866 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.959143 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.961518 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:55.961797 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.962075 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.962354 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.962639 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.962916 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.963194 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.976584 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:55.980263 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:55.981470 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:55.983592 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.984690 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:55.994269 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.994269 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:55.994269 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.994269 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.994498 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.994498 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.994498 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:55.994498 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.994498 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.994770 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.995928 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:55.999107 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.999193 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.999390 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.999667 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:55.999934 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:56.001066 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:56.004231 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:56.004576 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:56.004883 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:56.005131 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:56.008969 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:56.009249 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:56.009547 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:56.014983 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:56.015269 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:56.015547 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:56.023550 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:56.023550 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:56.023550 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:56.023550 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:56.023550 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:56.023550 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:56.023550 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:56.023982 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:56.023982 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:56.023982 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:56.023982 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:56.023982 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:56.023982 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:56.024330 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:56.024402 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 23 19:14:56.024402 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:56.024402 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:56.024402 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:56.024402 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:56.024703 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:56.024924 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:56.025197 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:56.025496 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:56.025774 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:56.026043 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:56.026304 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:56.026576 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:56.026891 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 23 19:14:56.058936 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557e6059e9c0 pid: 79233 (default app) Nov 23 19:14:56.062288 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98098d73-2ab2-423e-92fe-51942c9b5fe5 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:14:56.062588 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98098d73-2ab2-423e-92fe-51942c9b5fe5 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:14:56.062862 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98098d73-2ab2-423e-92fe-51942c9b5fe5 None None] PATH_INFO: `/v3` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:14:56.065909 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557e6059e9c0 pid: 79232 (default app) Nov 23 19:14:56.067046 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 791 bytes} [Tue Nov 23 19:14:56 2021] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:04.516286 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6935b-de49-4508-b867-f4f41c768d31 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:04.516804 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6935b-de49-4508-b867-f4f41c768d31 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:04.516912 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6935b-de49-4508-b867-f4f41c768d31 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:04.521867 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1/2] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:04 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:04.528317 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c027027-e91a-452f-a709-b8ff71e9ea05 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:04.528692 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c027027-e91a-452f-a709-b8ff71e9ea05 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:04.528930 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c027027-e91a-452f-a709-b8ff71e9ea05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:04.560159 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG oslo_db.sqlalchemy.engines [None req-9c027027-e91a-452f-a709-b8ff71e9ea05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79233) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 19:15:04.753231 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG passlib.handlers.bcrypt [None req-9c027027-e91a-452f-a709-b8ff71e9ea05 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79233) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 23 19:15:04.753671 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG passlib.handlers.bcrypt [None req-9c027027-e91a-452f-a709-b8ff71e9ea05 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79233) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 23 19:15:04.809736 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-9c027027-e91a-452f-a709-b8ff71e9ea05 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:04.811329 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-9c027027-e91a-452f-a709-b8ff71e9ea05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:04.936015 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 2/3] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:04 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 19:15:05.100509 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6935b-de49-4508-b867-f4f41c768d31 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:05.133891 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG oslo_db.sqlalchemy.engines [None req-44b6935b-de49-4508-b867-f4f41c768d31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 23 19:15:05.261117 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6935b-de49-4508-b867-f4f41c768d31 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:05.266067 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d41d4-0ee5-4886-905b-9a8a6ec7db44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:05.266716 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d41d4-0ee5-4886-905b-9a8a6ec7db44 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:05.267001 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d41d4-0ee5-4886-905b-9a8a6ec7db44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:05.267271 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d41d4-0ee5-4886-905b-9a8a6ec7db44 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:05.275238 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d41d4-0ee5-4886-905b-9a8a6ec7db44 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:05.326586 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d79d41d4-0ee5-4886-905b-9a8a6ec7db44 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 23 19:15:05.326928 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d41d4-0ee5-4886-905b-9a8a6ec7db44 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:05.335921 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 2/4] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:15:05 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 23 19:15:05.342472 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c027027-e91a-452f-a709-b8ff71e9ea05 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:05.356253 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c027027-e91a-452f-a709-b8ff71e9ea05 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:05.360512 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cef5bd-a158-4e8b-90b3-e451b3df6852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:05.361626 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cef5bd-a158-4e8b-90b3-e451b3df6852 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:05.361911 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cef5bd-a158-4e8b-90b3-e451b3df6852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:05.362189 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cef5bd-a158-4e8b-90b3-e451b3df6852 admin admin] PATH_INFO: `/v3/projects/bbbece3b7f8c49dc96e2d01b1a42f43c` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:05.363678 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cef5bd-a158-4e8b-90b3-e451b3df6852 admin admin] RBAC: Authorizing `identity:get_project(project_id=bbbece3b7f8c49dc96e2d01b1a42f43c)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:05.416163 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.common.rbac_enforcer.enforcer [None req-41cef5bd-a158-4e8b-90b3-e451b3df6852 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 23 19:15:05.416503 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cef5bd-a158-4e8b-90b3-e451b3df6852 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:05.421231 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 3/5] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:05 2021] GET /identity/v3/projects/bbbece3b7f8c49dc96e2d01b1a42f43c => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:07.640565 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3d683-d05c-4a25-b1e3-15a84f5341c4 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:07.641103 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3d683-d05c-4a25-b1e3-15a84f5341c4 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:07.641103 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3d683-d05c-4a25-b1e3-15a84f5341c4 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:07.645783 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 3/6] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:07 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:07.651780 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34740efe-2ceb-456b-8873-b0c525820887 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:07.652161 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34740efe-2ceb-456b-8873-b0c525820887 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:07.652925 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34740efe-2ceb-456b-8873-b0c525820887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:07.671948 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-34740efe-2ceb-456b-8873-b0c525820887 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:07.674392 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-34740efe-2ceb-456b-8873-b0c525820887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:07.682190 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 4/7] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:07.704781 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3d683-d05c-4a25-b1e3-15a84f5341c4 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:07.716957 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3d683-d05c-4a25-b1e3-15a84f5341c4 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:07.721055 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f46fa-0075-43b5-bcac-88c79fedcca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:07.721710 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f46fa-0075-43b5-bcac-88c79fedcca8 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:07.721990 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f46fa-0075-43b5-bcac-88c79fedcca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:07.722260 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f46fa-0075-43b5-bcac-88c79fedcca8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:07.729646 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f46fa-0075-43b5-bcac-88c79fedcca8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:07.732076 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f46fa-0075-43b5-bcac-88c79fedcca8 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:07.740473 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 4/8] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:15:07 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:15:07.746169 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34740efe-2ceb-456b-8873-b0c525820887 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:07.754841 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34740efe-2ceb-456b-8873-b0c525820887 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:07.759128 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfe02a-5c11-4d9e-b230-3d6f0917cfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:07.759976 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfe02a-5c11-4d9e-b230-3d6f0917cfca admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:07.760258 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfe02a-5c11-4d9e-b230-3d6f0917cfca admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:07.760531 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfe02a-5c11-4d9e-b230-3d6f0917cfca admin admin] PATH_INFO: `/v3/users/992e61bfb655451f80bb04b469d3594e` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:07.761952 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfe02a-5c11-4d9e-b230-3d6f0917cfca admin admin] RBAC: Authorizing `identity:get_user(user_id=992e61bfb655451f80bb04b469d3594e)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:07.763773 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfe02a-5c11-4d9e-b230-3d6f0917cfca admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:07.765312 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 5/9] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:07 2021] GET /identity/v3/users/992e61bfb655451f80bb04b469d3594e => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:10.076533 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52ecdd-cf29-4623-abc2-bb699f799c52 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:10.077044 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52ecdd-cf29-4623-abc2-bb699f799c52 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:10.077044 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52ecdd-cf29-4623-abc2-bb699f799c52 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:10.078933 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 5/10] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:10.084400 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65c7f8-420f-449d-8f65-b118db88eb6e None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:10.084779 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65c7f8-420f-449d-8f65-b118db88eb6e None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:10.084947 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65c7f8-420f-449d-8f65-b118db88eb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:10.092018 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774ae2a-09eb-4357-959f-8e8db18fc7ad None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:10.092308 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774ae2a-09eb-4357-959f-8e8db18fc7ad None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:10.092591 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774ae2a-09eb-4357-959f-8e8db18fc7ad None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:10.094337 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 6/11] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 19:15:10.099954 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ff2bb-02db-4bb8-b553-3681ae9d3c48 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:10.100243 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ff2bb-02db-4bb8-b553-3681ae9d3c48 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:10.100523 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ff2bb-02db-4bb8-b553-3681ae9d3c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:10.103017 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-9d65c7f8-420f-449d-8f65-b118db88eb6e None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:10.104186 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-9d65c7f8-420f-449d-8f65-b118db88eb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:10.112215 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 6/12] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:10.134215 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65c7f8-420f-449d-8f65-b118db88eb6e None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:10.142362 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG passlib.handlers.bcrypt [None req-ff1ff2bb-02db-4bb8-b553-3681ae9d3c48 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79232) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 23 19:15:10.142793 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG passlib.handlers.bcrypt [None req-ff1ff2bb-02db-4bb8-b553-3681ae9d3c48 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79232) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 23 19:15:10.143354 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65c7f8-420f-449d-8f65-b118db88eb6e None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:10.147665 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda96d9-a8e9-4152-accd-7a55ab9de5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:10.148289 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda96d9-a8e9-4152-accd-7a55ab9de5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:10.148569 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda96d9-a8e9-4152-accd-7a55ab9de5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:10.148840 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda96d9-a8e9-4152-accd-7a55ab9de5c0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:10.156962 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda96d9-a8e9-4152-accd-7a55ab9de5c0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:10.158733 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda96d9-a8e9-4152-accd-7a55ab9de5c0 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:10.167175 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 7/13] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:15:10 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 23 19:15:10.173005 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda96d9-a8e9-4152-accd-7a55ab9de5c0 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:10.181010 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda96d9-a8e9-4152-accd-7a55ab9de5c0 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:10.185460 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc30bc-319a-4521-a92f-8f7663755eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:10.186165 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc30bc-319a-4521-a92f-8f7663755eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:10.186444 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc30bc-319a-4521-a92f-8f7663755eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:10.186712 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc30bc-319a-4521-a92f-8f7663755eb2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:10.187847 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc30bc-319a-4521-a92f-8f7663755eb2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:10.188922 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-ff1ff2bb-02db-4bb8-b553-3681ae9d3c48 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:10.189447 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc30bc-319a-4521-a92f-8f7663755eb2 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:10.190552 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-ff1ff2bb-02db-4bb8-b553-3681ae9d3c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:10.190938 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 8/14] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:15:10 2021] GET /identity/v3/domains/default => generated 199 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:10.214316 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 7/15] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 19:15:10.239809 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc30bc-319a-4521-a92f-8f7663755eb2 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:10.250919 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc30bc-319a-4521-a92f-8f7663755eb2 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:10.255558 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a52aea-19f8-4562-be98-dbb8a7348aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:10.256379 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a52aea-19f8-4562-be98-dbb8a7348aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:10.256665 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a52aea-19f8-4562-be98-dbb8a7348aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:10.256942 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a52aea-19f8-4562-be98-dbb8a7348aa8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:10.273055 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a52aea-19f8-4562-be98-dbb8a7348aa8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:10.280984 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-a4a52aea-19f8-4562-be98-dbb8a7348aa8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 19:15:10.282288 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 9/16] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:15:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:15:10.288694 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ff2bb-02db-4bb8-b553-3681ae9d3c48 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:10.298072 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ff2bb-02db-4bb8-b553-3681ae9d3c48 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:10.302586 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5561d-b704-4776-975f-162940c8f4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:10.303620 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5561d-b704-4776-975f-162940c8f4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:10.303913 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5561d-b704-4776-975f-162940c8f4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:10.304196 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5561d-b704-4776-975f-162940c8f4c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:10.305156 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5561d-b704-4776-975f-162940c8f4c1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:10.305505 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5561d-b704-4776-975f-162940c8f4c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:10.307318 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING py.warnings [None req-dcd5561d-b704-4776-975f-162940c8f4c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:15:10.307318 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: warnings.warn(msg) Nov 23 19:15:10.307318 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: Nov 23 19:15:10.308249 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5561d-b704-4776-975f-162940c8f4c1 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:10.327005 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 8/17] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:10.333064 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a52aea-19f8-4562-be98-dbb8a7348aa8 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:10.343652 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a52aea-19f8-4562-be98-dbb8a7348aa8 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:10.348291 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbc12e-394c-4ad1-8e5a-362c2e8002d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:10.349178 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbc12e-394c-4ad1-8e5a-362c2e8002d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:10.349498 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbc12e-394c-4ad1-8e5a-362c2e8002d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:10.349778 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbc12e-394c-4ad1-8e5a-362c2e8002d1 admin admin] PATH_INFO: `/v3/users/992e61bfb655451f80bb04b469d3594e` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:10.351039 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cbc12e-394c-4ad1-8e5a-362c2e8002d1 admin admin] RBAC: Authorizing `identity:get_user(user_id=992e61bfb655451f80bb04b469d3594e)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:10.352898 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cbc12e-394c-4ad1-8e5a-362c2e8002d1 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:10.354616 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 10/18] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:10 2021] GET /identity/v3/users/992e61bfb655451f80bb04b469d3594e => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:10.361289 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5561d-b704-4776-975f-162940c8f4c1 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:10.372040 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5561d-b704-4776-975f-162940c8f4c1 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:10.376774 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5e372-252f-4450-b03c-d7f71da9f863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:10.377622 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5e372-252f-4450-b03c-d7f71da9f863 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:10.377907 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5e372-252f-4450-b03c-d7f71da9f863 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:10.378180 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5e372-252f-4450-b03c-d7f71da9f863 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:10.379626 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5e372-252f-4450-b03c-d7f71da9f863 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:10.381351 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5e372-252f-4450-b03c-d7f71da9f863 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:10.383156 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 9/19] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:15:10 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:10.389392 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbc12e-394c-4ad1-8e5a-362c2e8002d1 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:10.399135 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbc12e-394c-4ad1-8e5a-362c2e8002d1 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:10.404599 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f8c5b-8875-4d6e-88eb-6080a25dfbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:10.405248 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f8c5b-8875-4d6e-88eb-6080a25dfbe7 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:10.405564 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f8c5b-8875-4d6e-88eb-6080a25dfbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:10.405841 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f8c5b-8875-4d6e-88eb-6080a25dfbe7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:10.406699 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f8c5b-8875-4d6e-88eb-6080a25dfbe7 admin admin] RBAC: Adding query filter params (role.id=6d9a8878ffeb49fea19d854657c6b767, scope.domain.id=default, user.id=992e61bfb655451f80bb04b469d3594e) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:10.407008 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f8c5b-8875-4d6e-88eb-6080a25dfbe7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:10.408733 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING py.warnings [None req-0b9f8c5b-8875-4d6e-88eb-6080a25dfbe7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:15:10.408733 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: warnings.warn(msg) Nov 23 19:15:10.408733 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: Nov 23 19:15:10.409931 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f8c5b-8875-4d6e-88eb-6080a25dfbe7 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:10.416863 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 11/20] 10.222.0.62 () {56 vars in 1343 bytes} [Tue Nov 23 19:15:10 2021] GET /identity/v3/role_assignments?user.id=992e61bfb655451f80bb04b469d3594e&scope.domain.id=default&role.id=6d9a8878ffeb49fea19d854657c6b767 => generated 233 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:12.960118 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5762e77-5a48-40c1-b40c-61d7fd2a5bd0 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:12.961131 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5762e77-5a48-40c1-b40c-61d7fd2a5bd0 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:12.961669 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5762e77-5a48-40c1-b40c-61d7fd2a5bd0 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:12.963903 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 10/21] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:12 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:12.970887 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f5367-a6d0-43cf-bc13-abe6eb528111 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:12.971761 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f5367-a6d0-43cf-bc13-abe6eb528111 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:12.972236 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f5367-a6d0-43cf-bc13-abe6eb528111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:12.981647 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cfd48-ca6b-4b18-9383-f45feeea7e62 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:12.982224 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cfd48-ca6b-4b18-9383-f45feeea7e62 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:12.982698 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cfd48-ca6b-4b18-9383-f45feeea7e62 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:12.984928 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 11/22] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 19:15:12.998436 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-e44f5367-a6d0-43cf-bc13-abe6eb528111 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:12.999986 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-e44f5367-a6d0-43cf-bc13-abe6eb528111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:13.006696 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e58a6-047c-41e4-baa9-cc54128f6767 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:13.006989 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e58a6-047c-41e4-baa9-cc54128f6767 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:13.007268 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e58a6-047c-41e4-baa9-cc54128f6767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:13.012828 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 12/23] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 19:15:13.028590 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-f87e58a6-047c-41e4-baa9-cc54128f6767 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:13.030119 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-f87e58a6-047c-41e4-baa9-cc54128f6767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:13.043514 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f5367-a6d0-43cf-bc13-abe6eb528111 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:13.044503 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 12/24] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:13 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:13.059479 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f5367-a6d0-43cf-bc13-abe6eb528111 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:13.070907 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af20bc-09f3-4927-9a51-fcc183204f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:13.071711 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af20bc-09f3-4927-9a51-fcc183204f0e admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:13.071991 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af20bc-09f3-4927-9a51-fcc183204f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:13.072260 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af20bc-09f3-4927-9a51-fcc183204f0e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:13.086287 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af20bc-09f3-4927-9a51-fcc183204f0e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:13.088144 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af20bc-09f3-4927-9a51-fcc183204f0e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:13.109209 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-c7af20bc-09f3-4927-9a51-fcc183204f0e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:15:13.110791 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 13/25] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:15:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:15:13.113772 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e58a6-047c-41e4-baa9-cc54128f6767 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:13.126575 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e58a6-047c-41e4-baa9-cc54128f6767 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:13.128138 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af20bc-09f3-4927-9a51-fcc183204f0e admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:13.137635 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4515c-f40a-4184-9d91-c8ee958f3d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:13.138675 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4515c-f40a-4184-9d91-c8ee958f3d8f admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:13.140181 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4515c-f40a-4184-9d91-c8ee958f3d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:13.140631 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4515c-f40a-4184-9d91-c8ee958f3d8f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:13.147571 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af20bc-09f3-4927-9a51-fcc183204f0e admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:13.156146 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a94d6e-98a9-4928-b964-cbb4dc92934e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:13.158169 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a94d6e-98a9-4928-b964-cbb4dc92934e admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:13.159338 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a94d6e-98a9-4928-b964-cbb4dc92934e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:13.159781 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a94d6e-98a9-4928-b964-cbb4dc92934e admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:13.160717 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a94d6e-98a9-4928-b964-cbb4dc92934e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:13.163197 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a94d6e-98a9-4928-b964-cbb4dc92934e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:13.164386 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING py.warnings [None req-26a94d6e-98a9-4928-b964-cbb4dc92934e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:15:13.164386 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: warnings.warn(msg) Nov 23 19:15:13.164386 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: Nov 23 19:15:13.165854 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a94d6e-98a9-4928-b964-cbb4dc92934e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:13.166575 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4515c-f40a-4184-9d91-c8ee958f3d8f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:13.174382 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-32d4515c-f40a-4184-9d91-c8ee958f3d8f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 19:15:13.187534 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 13/26] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:15:13 2021] GET /identity/v3/roles/admin => generated 83 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:15:13.189108 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f881157-72d7-451d-aeaa-db4ae83fb661 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:13.189601 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f881157-72d7-451d-aeaa-db4ae83fb661 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:13.190069 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f881157-72d7-451d-aeaa-db4ae83fb661 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:13.193702 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 14/27] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:13 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:13.202294 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26daa91-75a5-44f3-aa06-cee9da0d146d None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:13.202581 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26daa91-75a5-44f3-aa06-cee9da0d146d None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:13.202864 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26daa91-75a5-44f3-aa06-cee9da0d146d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:13.208069 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 14/28] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:15:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:13.208712 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a94d6e-98a9-4928-b964-cbb4dc92934e admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:13.224897 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a94d6e-98a9-4928-b964-cbb4dc92934e admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:13.240352 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8bd93-2d2d-477c-9b6d-0cae29d8f048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:13.241034 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8bd93-2d2d-477c-9b6d-0cae29d8f048 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:13.241318 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8bd93-2d2d-477c-9b6d-0cae29d8f048 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:13.241617 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8bd93-2d2d-477c-9b6d-0cae29d8f048 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:13.242397 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e8bd93-2d2d-477c-9b6d-0cae29d8f048 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:13.242705 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e8bd93-2d2d-477c-9b6d-0cae29d8f048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:13.243716 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING py.warnings [None req-15e8bd93-2d2d-477c-9b6d-0cae29d8f048 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:15:13.243716 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: warnings.warn(msg) Nov 23 19:15:13.243716 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: Nov 23 19:15:13.244627 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e8bd93-2d2d-477c-9b6d-0cae29d8f048 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:13.247674 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-f26daa91-75a5-44f3-aa06-cee9da0d146d None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:13.249009 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-f26daa91-75a5-44f3-aa06-cee9da0d146d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:13.257815 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 15/29] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:13 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:13.259536 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26daa91-75a5-44f3-aa06-cee9da0d146d None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:13.269768 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 15/30] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:13 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:13.275830 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8bd93-2d2d-477c-9b6d-0cae29d8f048 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:13.276653 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26daa91-75a5-44f3-aa06-cee9da0d146d None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:13.290910 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8bd93-2d2d-477c-9b6d-0cae29d8f048 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:13.291809 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e656a-b165-4270-8fb9-15ebbfb9a710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:13.292706 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e656a-b165-4270-8fb9-15ebbfb9a710 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:13.293748 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e656a-b165-4270-8fb9-15ebbfb9a710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:13.294859 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e656a-b165-4270-8fb9-15ebbfb9a710 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:13.296166 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e656a-b165-4270-8fb9-15ebbfb9a710 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:13.297810 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING py.warnings [None req-3d6e656a-b165-4270-8fb9-15ebbfb9a710 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:15:13.297810 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: warnings.warn(msg) Nov 23 19:15:13.297810 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: Nov 23 19:15:13.299667 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e656a-b165-4270-8fb9-15ebbfb9a710 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:13.306666 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76386eba-65cd-4397-8707-f0cf7d7edf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:13.307775 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76386eba-65cd-4397-8707-f0cf7d7edf42 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:13.308275 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76386eba-65cd-4397-8707-f0cf7d7edf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:13.308954 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76386eba-65cd-4397-8707-f0cf7d7edf42 admin admin] PATH_INFO: `/v3/users/992e61bfb655451f80bb04b469d3594e` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:13.313985 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76386eba-65cd-4397-8707-f0cf7d7edf42 admin admin] RBAC: Authorizing `identity:get_user(user_id=992e61bfb655451f80bb04b469d3594e)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:13.316045 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76386eba-65cd-4397-8707-f0cf7d7edf42 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:13.326664 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 16/31] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:13 2021] GET /identity/v3/users/992e61bfb655451f80bb04b469d3594e => generated 247 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:13.327728 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76386eba-65cd-4397-8707-f0cf7d7edf42 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:13.342628 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76386eba-65cd-4397-8707-f0cf7d7edf42 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:13.354348 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98eb85-5d12-47b7-b7b1-268135f87f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:13.355298 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98eb85-5d12-47b7-b7b1-268135f87f45 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:13.356346 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98eb85-5d12-47b7-b7b1-268135f87f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:13.356844 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98eb85-5d12-47b7-b7b1-268135f87f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:13.357854 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d98eb85-5d12-47b7-b7b1-268135f87f45 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:13.359059 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING py.warnings [None req-0d98eb85-5d12-47b7-b7b1-268135f87f45 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:15:13.359059 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: warnings.warn(msg) Nov 23 19:15:13.359059 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: Nov 23 19:15:13.360981 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d98eb85-5d12-47b7-b7b1-268135f87f45 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:13.614288 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 16/32] 10.222.0.62 () {60 vars in 1162 bytes} [Tue Nov 23 19:15:13 2021] POST /identity/v3/projects => generated 301 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:15:13.615585 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e656a-b165-4270-8fb9-15ebbfb9a710 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:13.658698 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 17/33] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:15:13 2021] POST /identity/v3/roles => generated 219 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:15:13.677775 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74928f3-5de1-4bce-b23d-36a7d9d0a2bf None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:13.678077 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74928f3-5de1-4bce-b23d-36a7d9d0a2bf None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:13.678341 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74928f3-5de1-4bce-b23d-36a7d9d0a2bf None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:13.680734 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 18/34] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:13.689458 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c963f5-6b8a-4ebc-b3b4-5eba79fd4294 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:13.689458 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c963f5-6b8a-4ebc-b3b4-5eba79fd4294 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:13.689458 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c963f5-6b8a-4ebc-b3b4-5eba79fd4294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:13.726700 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-74c963f5-6b8a-4ebc-b3b4-5eba79fd4294 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:13.728309 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-74c963f5-6b8a-4ebc-b3b4-5eba79fd4294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:13.779758 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e656a-b165-4270-8fb9-15ebbfb9a710 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:13.798283 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9f787-e5c0-472f-ac5e-84edaffedd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:13.799138 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9f787-e5c0-472f-ac5e-84edaffedd26 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:13.799454 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9f787-e5c0-472f-ac5e-84edaffedd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:13.799715 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9f787-e5c0-472f-ac5e-84edaffedd26 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:13.801055 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9f787-e5c0-472f-ac5e-84edaffedd26 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:13.803005 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9f787-e5c0-472f-ac5e-84edaffedd26 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:13.813515 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 17/35] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:15:13 2021] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:13.814560 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9f787-e5c0-472f-ac5e-84edaffedd26 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:13.834062 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9f787-e5c0-472f-ac5e-84edaffedd26 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:13.844948 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c8ad2-1a13-40e7-aa7c-a73a1303cca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:13.845949 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c8ad2-1a13-40e7-aa7c-a73a1303cca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:13.846240 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c8ad2-1a13-40e7-aa7c-a73a1303cca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:13.846524 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c8ad2-1a13-40e7-aa7c-a73a1303cca9 admin admin] PATH_INFO: `/v3/domains/default/users/992e61bfb655451f80bb04b469d3594e/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:13.857590 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c8ad2-1a13-40e7-aa7c-a73a1303cca9 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=992e61bfb655451f80bb04b469d3594e, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:13.858803 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING py.warnings [None req-8d3c8ad2-1a13-40e7-aa7c-a73a1303cca9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:15:13.858803 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: warnings.warn(msg) Nov 23 19:15:13.858803 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: Nov 23 19:15:13.861215 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c8ad2-1a13-40e7-aa7c-a73a1303cca9 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:13.892187 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 19/36] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:13 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 19:15:13.936634 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c963f5-6b8a-4ebc-b3b4-5eba79fd4294 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:13.946708 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c963f5-6b8a-4ebc-b3b4-5eba79fd4294 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:13.956248 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d04d21-b7ec-43e8-a491-661a5961ad4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:13.957266 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d04d21-b7ec-43e8-a491-661a5961ad4e admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:13.957774 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d04d21-b7ec-43e8-a491-661a5961ad4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:13.958240 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d04d21-b7ec-43e8-a491-661a5961ad4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:13.959268 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d04d21-b7ec-43e8-a491-661a5961ad4e admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:13.961643 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d04d21-b7ec-43e8-a491-661a5961ad4e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:13.976874 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 18/37] 10.222.0.62 () {58 vars in 1382 bytes} [Tue Nov 23 19:15:13 2021] PUT /identity/v3/domains/default/users/992e61bfb655451f80bb04b469d3594e/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:15:14.048249 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 20/38] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:15:13 2021] POST /identity/v3/roles => generated 225 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:15:14.348172 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b3c0e-18b3-4063-b270-763ff31683b6 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:14.348556 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b3c0e-18b3-4063-b270-763ff31683b6 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:14.348750 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b3c0e-18b3-4063-b270-763ff31683b6 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:14.350865 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 19/39] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:14.357466 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb4a2d-2321-4cc3-a187-b472123dd8de None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:14.358030 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb4a2d-2321-4cc3-a187-b472123dd8de None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:14.358503 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb4a2d-2321-4cc3-a187-b472123dd8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:14.379035 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-daeb4a2d-2321-4cc3-a187-b472123dd8de None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:14.380277 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-daeb4a2d-2321-4cc3-a187-b472123dd8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:14.441791 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 21/40] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 19:15:14.466090 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b3c0e-18b3-4063-b270-763ff31683b6 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:14.477812 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b3c0e-18b3-4063-b270-763ff31683b6 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:14.482061 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dff275-13bf-4c1e-9875-42155ba34642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:14.482839 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dff275-13bf-4c1e-9875-42155ba34642 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:14.483121 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dff275-13bf-4c1e-9875-42155ba34642 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:14.483401 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dff275-13bf-4c1e-9875-42155ba34642 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:14.484588 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dff275-13bf-4c1e-9875-42155ba34642 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:14.486583 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dff275-13bf-4c1e-9875-42155ba34642 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:14.488325 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 20/41] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:15:14 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:14.494074 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb4a2d-2321-4cc3-a187-b472123dd8de None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:14.503562 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb4a2d-2321-4cc3-a187-b472123dd8de None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:14.507886 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443b3a2-fca0-4042-9eb6-bd9bc1bd8d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:14.508533 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443b3a2-fca0-4042-9eb6-bd9bc1bd8d47 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:14.508819 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443b3a2-fca0-4042-9eb6-bd9bc1bd8d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:14.509095 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443b3a2-fca0-4042-9eb6-bd9bc1bd8d47 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:14.509851 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443b3a2-fca0-4042-9eb6-bd9bc1bd8d47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:14.510853 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING py.warnings [None req-8443b3a2-fca0-4042-9eb6-bd9bc1bd8d47 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:15:14.510853 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: warnings.warn(msg) Nov 23 19:15:14.510853 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: Nov 23 19:15:14.512141 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443b3a2-fca0-4042-9eb6-bd9bc1bd8d47 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:14.551978 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173b871-4762-4a7f-b21e-6d793f6b3857 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:14.552269 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173b871-4762-4a7f-b21e-6d793f6b3857 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:14.552584 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173b871-4762-4a7f-b21e-6d793f6b3857 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:14.554907 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 21/42] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 19:15:14.561198 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a05e6-f646-43ab-a4af-df8459efee58 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:14.561523 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a05e6-f646-43ab-a4af-df8459efee58 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:14.561811 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a05e6-f646-43ab-a4af-df8459efee58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:14.580630 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-cc4a05e6-f646-43ab-a4af-df8459efee58 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:14.582218 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-cc4a05e6-f646-43ab-a4af-df8459efee58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:14.590268 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 22/43] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 19:15:14.613491 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a05e6-f646-43ab-a4af-df8459efee58 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:14.623300 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a05e6-f646-43ab-a4af-df8459efee58 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:14.626431 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 22/44] 10.222.0.62 () {60 vars in 1162 bytes} [Tue Nov 23 19:15:14 2021] POST /identity/v3/projects => generated 312 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:15:14.628284 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3cdb9-58f7-4b12-9832-806eee41cfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:14.633989 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3cdb9-58f7-4b12-9832-806eee41cfbc admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:14.633989 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3cdb9-58f7-4b12-9832-806eee41cfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:14.633989 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3cdb9-58f7-4b12-9832-806eee41cfbc admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:14.633989 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe3cdb9-58f7-4b12-9832-806eee41cfbc admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:14.633989 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING py.warnings [None req-fbe3cdb9-58f7-4b12-9832-806eee41cfbc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:15:14.633989 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: warnings.warn(msg) Nov 23 19:15:14.633989 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: Nov 23 19:15:14.634446 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe3cdb9-58f7-4b12-9832-806eee41cfbc admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:14.731873 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 23/45] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:15:14 2021] POST /identity/v3/roles => generated 223 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:15:16.302338 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90a70b-87e0-4c57-8daa-e83229058c7c None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:16.302848 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90a70b-87e0-4c57-8daa-e83229058c7c None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:16.302933 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90a70b-87e0-4c57-8daa-e83229058c7c None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:16.304658 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 23/46] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:16.311087 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66740838-ae61-40b9-bfe5-47874ad05adf None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:16.311538 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66740838-ae61-40b9-bfe5-47874ad05adf None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:16.311626 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66740838-ae61-40b9-bfe5-47874ad05adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:16.329276 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-66740838-ae61-40b9-bfe5-47874ad05adf None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:16.330499 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-66740838-ae61-40b9-bfe5-47874ad05adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:16.387711 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 24/47] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 19:15:16.410846 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90a70b-87e0-4c57-8daa-e83229058c7c None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:16.423228 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90a70b-87e0-4c57-8daa-e83229058c7c None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:16.427418 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613d4bd-1930-40b4-9252-aecaf742128f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:16.428250 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613d4bd-1930-40b4-9252-aecaf742128f admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:16.428552 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613d4bd-1930-40b4-9252-aecaf742128f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:16.428863 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613d4bd-1930-40b4-9252-aecaf742128f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:16.439912 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1613d4bd-1930-40b4-9252-aecaf742128f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:16.447070 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-1613d4bd-1930-40b4-9252-aecaf742128f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 19:15:16.448223 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 24/48] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:15:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:15:16.454398 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66740838-ae61-40b9-bfe5-47874ad05adf None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:16.463300 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66740838-ae61-40b9-bfe5-47874ad05adf None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:16.467766 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa3e7e-fbb8-4b5b-80ce-f77c9c7adf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:16.468425 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa3e7e-fbb8-4b5b-80ce-f77c9c7adf8f admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:16.468716 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa3e7e-fbb8-4b5b-80ce-f77c9c7adf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:16.469000 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa3e7e-fbb8-4b5b-80ce-f77c9c7adf8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:16.469794 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa3e7e-fbb8-4b5b-80ce-f77c9c7adf8f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:16.470108 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa3e7e-fbb8-4b5b-80ce-f77c9c7adf8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:16.471719 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa3e7e-fbb8-4b5b-80ce-f77c9c7adf8f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:16.479811 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 25/49] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:16.486433 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613d4bd-1930-40b4-9252-aecaf742128f admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:16.496058 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613d4bd-1930-40b4-9252-aecaf742128f admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:16.500959 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb847c-5f9a-4805-add4-e6afbc686fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:16.501864 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb847c-5f9a-4805-add4-e6afbc686fbe admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:16.502149 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb847c-5f9a-4805-add4-e6afbc686fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:16.502425 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb847c-5f9a-4805-add4-e6afbc686fbe admin admin] PATH_INFO: `/v3/users/992e61bfb655451f80bb04b469d3594e` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:16.503644 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb847c-5f9a-4805-add4-e6afbc686fbe admin admin] RBAC: Authorizing `identity:get_user(user_id=992e61bfb655451f80bb04b469d3594e)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:16.505489 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb847c-5f9a-4805-add4-e6afbc686fbe admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:16.507085 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 25/50] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:16 2021] GET /identity/v3/users/992e61bfb655451f80bb04b469d3594e => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:16.512764 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa3e7e-fbb8-4b5b-80ce-f77c9c7adf8f admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:16.522298 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa3e7e-fbb8-4b5b-80ce-f77c9c7adf8f admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:16.526635 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822df61c-0440-4c6f-b119-1efc2c32d8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:16.527411 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822df61c-0440-4c6f-b119-1efc2c32d8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:16.528222 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822df61c-0440-4c6f-b119-1efc2c32d8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:16.528496 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822df61c-0440-4c6f-b119-1efc2c32d8e8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:16.529727 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822df61c-0440-4c6f-b119-1efc2c32d8e8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:16.531421 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822df61c-0440-4c6f-b119-1efc2c32d8e8 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:16.533180 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 26/51] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:15:16 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:16.538874 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb847c-5f9a-4805-add4-e6afbc686fbe admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:16.549131 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb847c-5f9a-4805-add4-e6afbc686fbe admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:16.553567 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626cce3-64e0-4e2c-ba35-9d136e33562c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:16.554166 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626cce3-64e0-4e2c-ba35-9d136e33562c admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:16.554453 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626cce3-64e0-4e2c-ba35-9d136e33562c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:16.554735 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626cce3-64e0-4e2c-ba35-9d136e33562c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:16.555581 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626cce3-64e0-4e2c-ba35-9d136e33562c admin admin] RBAC: Adding query filter params (role.id=6d9a8878ffeb49fea19d854657c6b767, scope.domain.id=default, user.id=992e61bfb655451f80bb04b469d3594e) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:16.555896 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626cce3-64e0-4e2c-ba35-9d136e33562c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:16.557797 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626cce3-64e0-4e2c-ba35-9d136e33562c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:16.563559 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 26/52] 10.222.0.62 () {56 vars in 1343 bytes} [Tue Nov 23 19:15:16 2021] GET /identity/v3/role_assignments?user.id=992e61bfb655451f80bb04b469d3594e&scope.domain.id=default&role.id=6d9a8878ffeb49fea19d854657c6b767 => generated 530 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:16.919428 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdc786-1a69-4d87-b311-ca78f69c020f None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:16.919712 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdc786-1a69-4d87-b311-ca78f69c020f None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:16.919996 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdc786-1a69-4d87-b311-ca78f69c020f None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:16.921834 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 27/53] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:16.927399 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2864f-1375-45d0-a1d3-9c8f3f4c5b73 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:16.927689 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2864f-1375-45d0-a1d3-9c8f3f4c5b73 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:16.928010 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2864f-1375-45d0-a1d3-9c8f3f4c5b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:16.945608 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-3ad2864f-1375-45d0-a1d3-9c8f3f4c5b73 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:16.946805 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-3ad2864f-1375-45d0-a1d3-9c8f3f4c5b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:16.954817 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 27/54] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:16.978874 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdc786-1a69-4d87-b311-ca78f69c020f None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:16.990890 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdc786-1a69-4d87-b311-ca78f69c020f None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:16.995271 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ed20f-75e0-4d41-9851-8566a1afa70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:16.996043 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ed20f-75e0-4d41-9851-8566a1afa70f admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:16.996408 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ed20f-75e0-4d41-9851-8566a1afa70f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:16.996742 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ed20f-75e0-4d41-9851-8566a1afa70f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:16.997961 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ed20f-75e0-4d41-9851-8566a1afa70f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:16.999638 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ed20f-75e0-4d41-9851-8566a1afa70f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:17.001194 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 28/55] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:15:16 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:17.006809 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2864f-1375-45d0-a1d3-9c8f3f4c5b73 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:17.016314 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2864f-1375-45d0-a1d3-9c8f3f4c5b73 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:17.020718 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f982f-6dfe-410d-8d78-2d2ee9716793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:17.021353 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f982f-6dfe-410d-8d78-2d2ee9716793 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:17.021672 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f982f-6dfe-410d-8d78-2d2ee9716793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:17.021955 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f982f-6dfe-410d-8d78-2d2ee9716793 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:17.022665 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f982f-6dfe-410d-8d78-2d2ee9716793 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:17.024607 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f982f-6dfe-410d-8d78-2d2ee9716793 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:17.103839 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 28/56] 10.222.0.62 () {60 vars in 1161 bytes} [Tue Nov 23 19:15:17 2021] POST /identity/v3/projects => generated 298 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:15:19.360020 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0eadf-86e8-4b86-a2c9-88c869578ea7 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:19.360550 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0eadf-86e8-4b86-a2c9-88c869578ea7 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:19.360736 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0eadf-86e8-4b86-a2c9-88c869578ea7 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:19.362443 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 29/57] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:19.368241 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5d713-c8e5-466a-aee5-ca0bd998575b None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:19.368621 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5d713-c8e5-466a-aee5-ca0bd998575b None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:19.368804 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5d713-c8e5-466a-aee5-ca0bd998575b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:19.388710 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-65f5d713-c8e5-466a-aee5-ca0bd998575b None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:19.389966 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-65f5d713-c8e5-466a-aee5-ca0bd998575b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:19.445256 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 29/58] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 19:15:19.472126 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0eadf-86e8-4b86-a2c9-88c869578ea7 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:19.484245 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0eadf-86e8-4b86-a2c9-88c869578ea7 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:19.488461 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849ff64-9faf-4445-bb06-773419989f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:19.489240 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849ff64-9faf-4445-bb06-773419989f84 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:19.489558 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849ff64-9faf-4445-bb06-773419989f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:19.489841 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849ff64-9faf-4445-bb06-773419989f84 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:19.491020 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849ff64-9faf-4445-bb06-773419989f84 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:19.492689 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849ff64-9faf-4445-bb06-773419989f84 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:19.494275 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 30/59] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:15:19 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:19.500884 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f5d713-c8e5-466a-aee5-ca0bd998575b None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:19.509712 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f5d713-c8e5-466a-aee5-ca0bd998575b None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:19.514883 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f182de0-7b85-40dc-986e-15d7a09007e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:19.515558 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f182de0-7b85-40dc-986e-15d7a09007e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:19.515845 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f182de0-7b85-40dc-986e-15d7a09007e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:19.516126 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f182de0-7b85-40dc-986e-15d7a09007e4 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:19.516846 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f182de0-7b85-40dc-986e-15d7a09007e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:19.517877 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING py.warnings [None req-4f182de0-7b85-40dc-986e-15d7a09007e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:15:19.517877 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: warnings.warn(msg) Nov 23 19:15:19.517877 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: Nov 23 19:15:19.519175 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f182de0-7b85-40dc-986e-15d7a09007e4 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:19.663026 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 30/60] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Nov 23 19:15:19 2021] POST /identity/v3/users => generated 275 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:15:23.039418 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd2cd8-9034-496c-b473-7db80c945f3e None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:23.039418 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd2cd8-9034-496c-b473-7db80c945f3e None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:23.039418 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd2cd8-9034-496c-b473-7db80c945f3e None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:23.040515 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 31/61] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:23.045181 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb021b8-8ae7-4301-b54b-f44e68034cb3 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:23.046026 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb021b8-8ae7-4301-b54b-f44e68034cb3 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:23.046516 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb021b8-8ae7-4301-b54b-f44e68034cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:23.070238 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-4cb021b8-8ae7-4301-b54b-f44e68034cb3 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:23.071808 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-4cb021b8-8ae7-4301-b54b-f44e68034cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:23.084326 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 31/62] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:23.125714 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd2cd8-9034-496c-b473-7db80c945f3e None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:23.139598 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd2cd8-9034-496c-b473-7db80c945f3e None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:23.149036 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa35fdf-823c-4733-8480-baf84faba29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:23.150127 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa35fdf-823c-4733-8480-baf84faba29d admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:23.150628 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa35fdf-823c-4733-8480-baf84faba29d admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:23.151098 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa35fdf-823c-4733-8480-baf84faba29d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:23.167562 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa35fdf-823c-4733-8480-baf84faba29d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:23.175453 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-5fa35fdf-823c-4733-8480-baf84faba29d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 19:15:23.177184 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 32/63] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:15:23 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:15:23.183351 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb021b8-8ae7-4301-b54b-f44e68034cb3 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:23.192972 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb021b8-8ae7-4301-b54b-f44e68034cb3 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:23.202033 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7620a06-797b-4948-877a-fafc886f568b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:23.202958 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7620a06-797b-4948-877a-fafc886f568b admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:23.203444 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7620a06-797b-4948-877a-fafc886f568b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:23.203930 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7620a06-797b-4948-877a-fafc886f568b admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:23.204900 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7620a06-797b-4948-877a-fafc886f568b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:23.205397 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7620a06-797b-4948-877a-fafc886f568b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:23.207236 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7620a06-797b-4948-877a-fafc886f568b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:23.221554 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 32/64] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:23 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:23.227660 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa35fdf-823c-4733-8480-baf84faba29d admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:23.242401 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa35fdf-823c-4733-8480-baf84faba29d admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:23.254117 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae5b24-9660-4ee5-93dd-0df43e5e9af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:23.255334 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae5b24-9660-4ee5-93dd-0df43e5e9af7 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:23.255820 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae5b24-9660-4ee5-93dd-0df43e5e9af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:23.256297 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae5b24-9660-4ee5-93dd-0df43e5e9af7 admin admin] PATH_INFO: `/v3/users/992e61bfb655451f80bb04b469d3594e` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:23.257814 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae5b24-9660-4ee5-93dd-0df43e5e9af7 admin admin] RBAC: Authorizing `identity:get_user(user_id=992e61bfb655451f80bb04b469d3594e)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:23.259824 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae5b24-9660-4ee5-93dd-0df43e5e9af7 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:23.261990 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 33/65] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:23 2021] GET /identity/v3/users/992e61bfb655451f80bb04b469d3594e => generated 247 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:23.268672 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7620a06-797b-4948-877a-fafc886f568b admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:23.278789 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7620a06-797b-4948-877a-fafc886f568b admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:23.286950 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb1a4e-d26b-4e80-b54b-366c396a95d9 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:23.287545 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb1a4e-d26b-4e80-b54b-366c396a95d9 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:23.288111 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb1a4e-d26b-4e80-b54b-366c396a95d9 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:23.289758 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936cca7-6fe6-44de-944e-fa1c5288ab3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:23.290414 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936cca7-6fe6-44de-944e-fa1c5288ab3a admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:23.290708 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936cca7-6fe6-44de-944e-fa1c5288ab3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:23.291053 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936cca7-6fe6-44de-944e-fa1c5288ab3a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:23.291255 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 34/66] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 19:15:23.302941 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b9817-2a99-4939-8b80-2961f7c2f95c None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:23.303246 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b9817-2a99-4939-8b80-2961f7c2f95c None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:23.303515 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b9817-2a99-4939-8b80-2961f7c2f95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:23.307930 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936cca7-6fe6-44de-944e-fa1c5288ab3a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:23.310668 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936cca7-6fe6-44de-944e-fa1c5288ab3a admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:23.334113 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 33/67] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:15:23 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:15:23.341056 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-e55b9817-2a99-4939-8b80-2961f7c2f95c None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:23.342408 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936cca7-6fe6-44de-944e-fa1c5288ab3a admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:23.342968 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-e55b9817-2a99-4939-8b80-2961f7c2f95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:23.352162 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936cca7-6fe6-44de-944e-fa1c5288ab3a admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:23.360944 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a85de-be7b-441d-8cc8-3a4e23ccecf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:23.361830 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a85de-be7b-441d-8cc8-3a4e23ccecf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:23.362113 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a85de-be7b-441d-8cc8-3a4e23ccecf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:23.362387 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a85de-be7b-441d-8cc8-3a4e23ccecf5 admin admin] PATH_INFO: `/v3/projects/febc4f33fba1433992fc8e043a47dd5c` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:23.364051 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a85de-be7b-441d-8cc8-3a4e23ccecf5 admin admin] RBAC: Authorizing `identity:get_project(project_id=febc4f33fba1433992fc8e043a47dd5c)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:23.366152 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a85de-be7b-441d-8cc8-3a4e23ccecf5 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:23.368796 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 35/68] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 19:15:23.368983 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 34/69] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:23 2021] GET /identity/v3/projects/febc4f33fba1433992fc8e043a47dd5c => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:23.382598 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b9817-2a99-4939-8b80-2961f7c2f95c None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:23.396276 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b9817-2a99-4939-8b80-2961f7c2f95c None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:23.399563 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a85de-be7b-441d-8cc8-3a4e23ccecf5 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:23.403827 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16634b-1d6b-476e-9b87-e35cc4f1e79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:23.404726 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16634b-1d6b-476e-9b87-e35cc4f1e79b admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:23.405217 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16634b-1d6b-476e-9b87-e35cc4f1e79b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:23.405732 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16634b-1d6b-476e-9b87-e35cc4f1e79b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:23.406872 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f16634b-1d6b-476e-9b87-e35cc4f1e79b admin admin] RBAC: Adding query filter params (role.id=6d9a8878ffeb49fea19d854657c6b767, scope.project.id=febc4f33fba1433992fc8e043a47dd5c, user.id=992e61bfb655451f80bb04b469d3594e) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:23.407467 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f16634b-1d6b-476e-9b87-e35cc4f1e79b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:23.408687 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING py.warnings [None req-2f16634b-1d6b-476e-9b87-e35cc4f1e79b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:15:23.408687 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: warnings.warn(msg) Nov 23 19:15:23.408687 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: Nov 23 19:15:23.410229 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f16634b-1d6b-476e-9b87-e35cc4f1e79b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:23.415136 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a85de-be7b-441d-8cc8-3a4e23ccecf5 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:23.422484 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 36/70] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:15:23 2021] GET /identity/v3/role_assignments?user.id=992e61bfb655451f80bb04b469d3594e&scope.project.id=febc4f33fba1433992fc8e043a47dd5c&role.id=6d9a8878ffeb49fea19d854657c6b767 => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:23.431751 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7e605-eba8-4841-b322-9a844dc26d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:23.432581 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7e605-eba8-4841-b322-9a844dc26d26 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:23.432866 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7e605-eba8-4841-b322-9a844dc26d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:23.433150 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7e605-eba8-4841-b322-9a844dc26d26 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:23.456226 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb7e605-eba8-4841-b322-9a844dc26d26 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:23.463381 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-3eb7e605-eba8-4841-b322-9a844dc26d26 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 19:15:23.464933 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 35/71] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:23 2021] GET /identity/v3/roles/member => generated 84 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:15:23.472000 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16634b-1d6b-476e-9b87-e35cc4f1e79b admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:23.486893 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16634b-1d6b-476e-9b87-e35cc4f1e79b admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:23.495465 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475dc6b0-64b1-4064-be85-f6c86b5d8288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:23.496514 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475dc6b0-64b1-4064-be85-f6c86b5d8288 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:23.497076 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475dc6b0-64b1-4064-be85-f6c86b5d8288 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:23.497604 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475dc6b0-64b1-4064-be85-f6c86b5d8288 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:23.498637 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475dc6b0-64b1-4064-be85-f6c86b5d8288 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:23.499018 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11120c72-67b4-42d7-ade4-c01303941ebe None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:23.499314 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11120c72-67b4-42d7-ade4-c01303941ebe None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:23.499597 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11120c72-67b4-42d7-ade4-c01303941ebe None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:23.499701 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475dc6b0-64b1-4064-be85-f6c86b5d8288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:23.501462 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 36/72] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 19:15:23.501918 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475dc6b0-64b1-4064-be85-f6c86b5d8288 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:23.507638 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38d90e-2b04-4863-ab43-4305d2f2782c None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:23.507932 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38d90e-2b04-4863-ab43-4305d2f2782c None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:23.508215 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38d90e-2b04-4863-ab43-4305d2f2782c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:23.512540 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 37/73] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Nov 23 19:15:23 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:23.519269 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475dc6b0-64b1-4064-be85-f6c86b5d8288 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:23.530296 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475dc6b0-64b1-4064-be85-f6c86b5d8288 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:23.535336 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53470189-996f-41b6-9831-4618232f2892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:23.536576 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53470189-996f-41b6-9831-4618232f2892 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:23.537083 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53470189-996f-41b6-9831-4618232f2892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:23.537602 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53470189-996f-41b6-9831-4618232f2892 admin admin] PATH_INFO: `/v3/users/1a1d51f0294041ae850c7db91f47882c` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:23.549917 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-cd38d90e-2b04-4863-ab43-4305d2f2782c None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:23.551157 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-cd38d90e-2b04-4863-ab43-4305d2f2782c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:23.564792 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 37/74] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Nov 23 19:15:23.575998 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53470189-996f-41b6-9831-4618232f2892 admin admin] RBAC: Authorizing `identity:get_user(user_id=1a1d51f0294041ae850c7db91f47882c)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:23.578209 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53470189-996f-41b6-9831-4618232f2892 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:23.580265 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 38/75] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:23 2021] GET /identity/v3/users/1a1d51f0294041ae850c7db91f47882c => generated 275 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:23.586546 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38d90e-2b04-4863-ab43-4305d2f2782c None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:23.599707 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53470189-996f-41b6-9831-4618232f2892 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:23.615119 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38d90e-2b04-4863-ab43-4305d2f2782c None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:23.618688 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53470189-996f-41b6-9831-4618232f2892 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:23.625831 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfb2a9-3167-415d-9b29-dcd7a1bc1fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:23.626519 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfb2a9-3167-415d-9b29-dcd7a1bc1fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:23.626808 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfb2a9-3167-415d-9b29-dcd7a1bc1fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:23.627092 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfb2a9-3167-415d-9b29-dcd7a1bc1fb7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:23.629463 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038f7df-0375-45a5-bf19-a24212e560bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:23.630326 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038f7df-0375-45a5-bf19-a24212e560bf admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:23.630614 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038f7df-0375-45a5-bf19-a24212e560bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:23.630893 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038f7df-0375-45a5-bf19-a24212e560bf admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:23.644947 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dfb2a9-3167-415d-9b29-dcd7a1bc1fb7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:23.646808 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dfb2a9-3167-415d-9b29-dcd7a1bc1fb7 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:23.661014 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038f7df-0375-45a5-bf19-a24212e560bf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:23.669272 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-f038f7df-0375-45a5-bf19-a24212e560bf admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 19:15:23.670868 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 39/76] 10.222.0.62 () {56 vars in 1135 bytes} [Tue Nov 23 19:15:23 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:15:23.676213 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 38/77] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:15:23 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:15:23.677359 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038f7df-0375-45a5-bf19-a24212e560bf admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:23.680371 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfb2a9-3167-415d-9b29-dcd7a1bc1fb7 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:23.691647 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfb2a9-3167-415d-9b29-dcd7a1bc1fb7 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:23.695547 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038f7df-0375-45a5-bf19-a24212e560bf admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:23.701295 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb173d-b04d-4945-b872-5033aa6a4cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:23.702191 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb173d-b04d-4945-b872-5033aa6a4cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:23.702484 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb173d-b04d-4945-b872-5033aa6a4cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:23.702766 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb173d-b04d-4945-b872-5033aa6a4cf9 admin admin] PATH_INFO: `/v3/projects/febc4f33fba1433992fc8e043a47dd5c` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:23.703999 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb173d-b04d-4945-b872-5033aa6a4cf9 admin admin] RBAC: Authorizing `identity:get_project(project_id=febc4f33fba1433992fc8e043a47dd5c)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:23.704119 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb468d0c-4d36-432c-a1b5-daa4ea68e130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:23.704787 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb468d0c-4d36-432c-a1b5-daa4ea68e130 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:23.705228 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb468d0c-4d36-432c-a1b5-daa4ea68e130 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:23.705682 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb468d0c-4d36-432c-a1b5-daa4ea68e130 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:23.706111 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb173d-b04d-4945-b872-5033aa6a4cf9 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:23.706772 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb468d0c-4d36-432c-a1b5-daa4ea68e130 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:23.707220 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb468d0c-4d36-432c-a1b5-daa4ea68e130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:23.708932 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb468d0c-4d36-432c-a1b5-daa4ea68e130 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:23.709152 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 39/78] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:23 2021] GET /identity/v3/projects/febc4f33fba1433992fc8e043a47dd5c => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:23.717296 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb173d-b04d-4945-b872-5033aa6a4cf9 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:23.721096 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 40/79] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:15:23 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:23.727078 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb468d0c-4d36-432c-a1b5-daa4ea68e130 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:23.737524 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb173d-b04d-4945-b872-5033aa6a4cf9 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:23.742766 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb468d0c-4d36-432c-a1b5-daa4ea68e130 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:23.749446 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ab7ea-3be6-4c9c-ac85-169b009bb619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:23.750405 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ab7ea-3be6-4c9c-ac85-169b009bb619 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:23.750829 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ab7ea-3be6-4c9c-ac85-169b009bb619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:23.751785 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ab7ea-3be6-4c9c-ac85-169b009bb619 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:23.752808 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ab7ea-3be6-4c9c-ac85-169b009bb619 admin admin] RBAC: Adding query filter params (role.id=f8b0ca7636ad450b94f68df7bc4497aa, scope.project.id=febc4f33fba1433992fc8e043a47dd5c, user.id=1a1d51f0294041ae850c7db91f47882c) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:23.754277 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ab7ea-3be6-4c9c-ac85-169b009bb619 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:23.755066 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e61da-6a04-45f9-a9a7-53b5260d3afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:23.757181 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ab7ea-3be6-4c9c-ac85-169b009bb619 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:23.758316 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e61da-6a04-45f9-a9a7-53b5260d3afa admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:23.758760 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e61da-6a04-45f9-a9a7-53b5260d3afa admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:23.759189 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e61da-6a04-45f9-a9a7-53b5260d3afa admin admin] PATH_INFO: `/v3/users/1a1d51f0294041ae850c7db91f47882c` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:23.764113 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e61da-6a04-45f9-a9a7-53b5260d3afa admin admin] RBAC: Authorizing `identity:get_user(user_id=1a1d51f0294041ae850c7db91f47882c)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:23.766586 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e61da-6a04-45f9-a9a7-53b5260d3afa admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:23.769511 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 41/80] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:23 2021] GET /identity/v3/users/1a1d51f0294041ae850c7db91f47882c => generated 275 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:23.771886 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 40/81] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:15:23 2021] GET /identity/v3/role_assignments?user.id=1a1d51f0294041ae850c7db91f47882c&scope.project.id=febc4f33fba1433992fc8e043a47dd5c&role.id=f8b0ca7636ad450b94f68df7bc4497aa => generated 259 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:23.778586 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e61da-6a04-45f9-a9a7-53b5260d3afa admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:23.795660 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e61da-6a04-45f9-a9a7-53b5260d3afa admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:23.807463 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25133a65-8ead-4f2d-b0e6-1a1d6e14f552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:23.808308 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25133a65-8ead-4f2d-b0e6-1a1d6e14f552 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:23.808758 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25133a65-8ead-4f2d-b0e6-1a1d6e14f552 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:23.809798 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25133a65-8ead-4f2d-b0e6-1a1d6e14f552 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:23.812766 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8ff88-c344-4376-8e89-e49fc400326f None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:23.813289 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8ff88-c344-4376-8e89-e49fc400326f None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:23.813767 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8ff88-c344-4376-8e89-e49fc400326f None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:23.815809 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 41/82] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 19:15:23.822422 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61478b-a387-4adf-9de7-19d525bb4bf1 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:23.822931 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61478b-a387-4adf-9de7-19d525bb4bf1 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:23.823386 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61478b-a387-4adf-9de7-19d525bb4bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:23.825381 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25133a65-8ead-4f2d-b0e6-1a1d6e14f552 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:23.827217 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25133a65-8ead-4f2d-b0e6-1a1d6e14f552 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:23.843554 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 42/83] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:15:23 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:15:23.843938 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-7a61478b-a387-4adf-9de7-19d525bb4bf1 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:23.845345 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-7a61478b-a387-4adf-9de7-19d525bb4bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:23.849616 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25133a65-8ead-4f2d-b0e6-1a1d6e14f552 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:23.853737 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 42/84] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 19:15:23.867843 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25133a65-8ead-4f2d-b0e6-1a1d6e14f552 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:23.879381 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f9fc4-6be7-448c-846f-cfd27ab43dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:23.880274 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f9fc4-6be7-448c-846f-cfd27ab43dee admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:23.880559 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f9fc4-6be7-448c-846f-cfd27ab43dee admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:23.880838 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f9fc4-6be7-448c-846f-cfd27ab43dee admin admin] PATH_INFO: `/v3/projects/febc4f33fba1433992fc8e043a47dd5c` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:23.881783 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61478b-a387-4adf-9de7-19d525bb4bf1 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:23.886403 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f9fc4-6be7-448c-846f-cfd27ab43dee admin admin] RBAC: Authorizing `identity:get_project(project_id=febc4f33fba1433992fc8e043a47dd5c)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:23.888594 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f9fc4-6be7-448c-846f-cfd27ab43dee admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:23.890456 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 43/85] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:23 2021] GET /identity/v3/projects/febc4f33fba1433992fc8e043a47dd5c => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:23.892597 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61478b-a387-4adf-9de7-19d525bb4bf1 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:23.896826 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f9fc4-6be7-448c-846f-cfd27ab43dee admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:23.897681 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2389ee0-9c97-4e68-8d21-900b982c8842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:23.898666 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2389ee0-9c97-4e68-8d21-900b982c8842 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:23.899097 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2389ee0-9c97-4e68-8d21-900b982c8842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:23.899534 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2389ee0-9c97-4e68-8d21-900b982c8842 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:23.910625 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f9fc4-6be7-448c-846f-cfd27ab43dee admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:23.911937 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2389ee0-9c97-4e68-8d21-900b982c8842 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:23.920105 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-e2389ee0-9c97-4e68-8d21-900b982c8842 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 19:15:23.921668 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 43/86] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:23 2021] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:15:23.928290 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcee977-c29c-494d-813d-2330ef154ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:23.928607 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2389ee0-9c97-4e68-8d21-900b982c8842 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:23.929022 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcee977-c29c-494d-813d-2330ef154ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:23.929311 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcee977-c29c-494d-813d-2330ef154ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:23.929624 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcee977-c29c-494d-813d-2330ef154ed6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:23.930503 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcee977-c29c-494d-813d-2330ef154ed6 admin admin] RBAC: Adding query filter params (role.id=bc8a8682d8f748788fb70d235f9978dc, scope.project.id=febc4f33fba1433992fc8e043a47dd5c, user.id=1a1d51f0294041ae850c7db91f47882c) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:23.930834 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcee977-c29c-494d-813d-2330ef154ed6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:23.932767 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcee977-c29c-494d-813d-2330ef154ed6 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:23.940813 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2389ee0-9c97-4e68-8d21-900b982c8842 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:23.946913 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 44/87] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:15:23 2021] GET /identity/v3/role_assignments?user.id=1a1d51f0294041ae850c7db91f47882c&scope.project.id=febc4f33fba1433992fc8e043a47dd5c&role.id=bc8a8682d8f748788fb70d235f9978dc => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:23.948125 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd4eec-f28c-4fd8-b209-e9af7c245497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:23.948967 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd4eec-f28c-4fd8-b209-e9af7c245497 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:23.949399 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd4eec-f28c-4fd8-b209-e9af7c245497 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:23.949920 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd4eec-f28c-4fd8-b209-e9af7c245497 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:23.950885 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd4eec-f28c-4fd8-b209-e9af7c245497 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:23.951359 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd4eec-f28c-4fd8-b209-e9af7c245497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:23.953169 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd4eec-f28c-4fd8-b209-e9af7c245497 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:23.963466 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34433d61-4b16-474f-aed2-b51df1cb0f54 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:23.964067 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 44/88] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Nov 23 19:15:23 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:23.964432 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34433d61-4b16-474f-aed2-b51df1cb0f54 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:23.964943 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34433d61-4b16-474f-aed2-b51df1cb0f54 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:23.967890 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 45/89] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:23 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 19:15:23.970607 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd4eec-f28c-4fd8-b209-e9af7c245497 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:23.975273 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35643f90-9247-4d1e-9fd9-de9b13badca1 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:23.975950 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35643f90-9247-4d1e-9fd9-de9b13badca1 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:23.976446 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35643f90-9247-4d1e-9fd9-de9b13badca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:23.980704 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd4eec-f28c-4fd8-b209-e9af7c245497 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:23.986761 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217274f-b755-4e43-8e79-c7a60a37ec07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:23.987334 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217274f-b755-4e43-8e79-c7a60a37ec07 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:23.987620 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217274f-b755-4e43-8e79-c7a60a37ec07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:23.987900 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217274f-b755-4e43-8e79-c7a60a37ec07 admin admin] PATH_INFO: `/v3/users/1a1d51f0294041ae850c7db91f47882c` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:23.989221 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217274f-b755-4e43-8e79-c7a60a37ec07 admin admin] RBAC: Authorizing `identity:get_user(user_id=1a1d51f0294041ae850c7db91f47882c)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:23.991474 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217274f-b755-4e43-8e79-c7a60a37ec07 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:23.993283 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 45/90] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:23 2021] GET /identity/v3/users/1a1d51f0294041ae850c7db91f47882c => generated 275 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:24.000355 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217274f-b755-4e43-8e79-c7a60a37ec07 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:24.002685 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-35643f90-9247-4d1e-9fd9-de9b13badca1 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:24.004206 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-35643f90-9247-4d1e-9fd9-de9b13badca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:24.010639 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217274f-b755-4e43-8e79-c7a60a37ec07 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:24.021471 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ce9f1-92df-42ba-a0d4-bfef2cf989d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:24.021471 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ce9f1-92df-42ba-a0d4-bfef2cf989d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:24.021471 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ce9f1-92df-42ba-a0d4-bfef2cf989d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:24.021471 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ce9f1-92df-42ba-a0d4-bfef2cf989d6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:24.022033 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 46/91] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 19:15:24.037961 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ce9f1-92df-42ba-a0d4-bfef2cf989d6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:24.040070 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ce9f1-92df-42ba-a0d4-bfef2cf989d6 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:24.042957 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35643f90-9247-4d1e-9fd9-de9b13badca1 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:24.055484 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35643f90-9247-4d1e-9fd9-de9b13badca1 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:24.067291 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcd3dd-8e84-480e-8155-461c1973ab31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:24.068193 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcd3dd-8e84-480e-8155-461c1973ab31 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:24.068487 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcd3dd-8e84-480e-8155-461c1973ab31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:24.068768 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcd3dd-8e84-480e-8155-461c1973ab31 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:24.069781 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 46/92] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:15:23 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 23 19:15:24.070492 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bcd3dd-8e84-480e-8155-461c1973ab31 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:24.072352 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bcd3dd-8e84-480e-8155-461c1973ab31 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:24.074147 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 47/93] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:15:24 2021] GET /identity/v3/domains/default => generated 199 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:24.082540 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ce9f1-92df-42ba-a0d4-bfef2cf989d6 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:24.082747 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcd3dd-8e84-480e-8155-461c1973ab31 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:24.092590 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ce9f1-92df-42ba-a0d4-bfef2cf989d6 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:24.095358 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcd3dd-8e84-480e-8155-461c1973ab31 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:24.098565 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2141a1a-6d57-428b-80b4-426e22c3ca0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:24.099495 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2141a1a-6d57-428b-80b4-426e22c3ca0c admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:24.099871 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2141a1a-6d57-428b-80b4-426e22c3ca0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:24.100252 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2141a1a-6d57-428b-80b4-426e22c3ca0c admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:24.101081 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2141a1a-6d57-428b-80b4-426e22c3ca0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:24.102577 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING py.warnings [None req-c2141a1a-6d57-428b-80b4-426e22c3ca0c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:15:24.102577 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: warnings.warn(msg) Nov 23 19:15:24.102577 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: Nov 23 19:15:24.103515 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab4b1a-bd52-459e-aad2-13a6c317c904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:24.104027 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2141a1a-6d57-428b-80b4-426e22c3ca0c admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:24.104788 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab4b1a-bd52-459e-aad2-13a6c317c904 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:24.105260 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab4b1a-bd52-459e-aad2-13a6c317c904 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:24.105802 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab4b1a-bd52-459e-aad2-13a6c317c904 admin admin] PATH_INFO: `/v3/projects/aa3804c377fa45e3bbd258b742110f95` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:24.107393 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab4b1a-bd52-459e-aad2-13a6c317c904 admin admin] RBAC: Authorizing `identity:get_project(project_id=aa3804c377fa45e3bbd258b742110f95)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:24.109732 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab4b1a-bd52-459e-aad2-13a6c317c904 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:24.111921 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 47/94] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:24 2021] GET /identity/v3/projects/aa3804c377fa45e3bbd258b742110f95 => generated 312 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:24.119883 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab4b1a-bd52-459e-aad2-13a6c317c904 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:24.132557 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab4b1a-bd52-459e-aad2-13a6c317c904 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:24.147780 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d3fd5-66ac-4e33-a913-a7ec8bff9b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:24.148477 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d3fd5-66ac-4e33-a913-a7ec8bff9b46 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:24.148763 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d3fd5-66ac-4e33-a913-a7ec8bff9b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:24.149038 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d3fd5-66ac-4e33-a913-a7ec8bff9b46 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:24.149936 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d3fd5-66ac-4e33-a913-a7ec8bff9b46 admin admin] RBAC: Adding query filter params (role.id=f8b0ca7636ad450b94f68df7bc4497aa, scope.project.id=aa3804c377fa45e3bbd258b742110f95, user.id=1a1d51f0294041ae850c7db91f47882c) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:24.150249 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d3fd5-66ac-4e33-a913-a7ec8bff9b46 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:24.152092 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d3fd5-66ac-4e33-a913-a7ec8bff9b46 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:24.167620 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 48/95] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:15:24 2021] GET /identity/v3/role_assignments?user.id=1a1d51f0294041ae850c7db91f47882c&scope.project.id=aa3804c377fa45e3bbd258b742110f95&role.id=f8b0ca7636ad450b94f68df7bc4497aa => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:24.189022 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 48/96] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Nov 23 19:15:24 2021] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:15:26.086134 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b48253-79d2-4897-a7cc-c7c6ceef3f35 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:26.086621 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b48253-79d2-4897-a7cc-c7c6ceef3f35 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:26.086621 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b48253-79d2-4897-a7cc-c7c6ceef3f35 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:26.088366 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 49/97] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:26.094931 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eecf86f-a0b5-4e6e-afa1-b589d183f13c None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:26.095346 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eecf86f-a0b5-4e6e-afa1-b589d183f13c None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:26.095538 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eecf86f-a0b5-4e6e-afa1-b589d183f13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:26.118975 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-6eecf86f-a0b5-4e6e-afa1-b589d183f13c None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:26.120164 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-6eecf86f-a0b5-4e6e-afa1-b589d183f13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:26.132386 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 49/98] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:26.168094 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b48253-79d2-4897-a7cc-c7c6ceef3f35 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:26.183067 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b48253-79d2-4897-a7cc-c7c6ceef3f35 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:26.190865 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36afae5f-4dfc-471a-90d9-4be94217822e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:26.191657 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afae5f-4dfc-471a-90d9-4be94217822e admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:26.191934 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afae5f-4dfc-471a-90d9-4be94217822e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:26.192212 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afae5f-4dfc-471a-90d9-4be94217822e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:26.207688 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36afae5f-4dfc-471a-90d9-4be94217822e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:26.218753 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-36afae5f-4dfc-471a-90d9-4be94217822e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 19:15:26.219979 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 50/99] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:15:26 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:15:26.226213 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eecf86f-a0b5-4e6e-afa1-b589d183f13c None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:26.235787 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eecf86f-a0b5-4e6e-afa1-b589d183f13c None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:26.241903 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012cc98-aeec-4afa-8a76-dd4e6c1e7d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:26.242562 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012cc98-aeec-4afa-8a76-dd4e6c1e7d39 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:26.242842 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012cc98-aeec-4afa-8a76-dd4e6c1e7d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:26.243119 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012cc98-aeec-4afa-8a76-dd4e6c1e7d39 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:26.243880 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012cc98-aeec-4afa-8a76-dd4e6c1e7d39 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:26.244185 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012cc98-aeec-4afa-8a76-dd4e6c1e7d39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:26.245821 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012cc98-aeec-4afa-8a76-dd4e6c1e7d39 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:26.260649 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 50/100] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:26 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:26.266995 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36afae5f-4dfc-471a-90d9-4be94217822e admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:26.283526 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36afae5f-4dfc-471a-90d9-4be94217822e admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:26.290914 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630669ed-5027-4a3d-a9fa-71b4c3fc94bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:26.291787 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630669ed-5027-4a3d-a9fa-71b4c3fc94bd admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:26.292067 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630669ed-5027-4a3d-a9fa-71b4c3fc94bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:26.292346 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630669ed-5027-4a3d-a9fa-71b4c3fc94bd admin admin] PATH_INFO: `/v3/users/992e61bfb655451f80bb04b469d3594e` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:26.294506 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630669ed-5027-4a3d-a9fa-71b4c3fc94bd admin admin] RBAC: Authorizing `identity:get_user(user_id=992e61bfb655451f80bb04b469d3594e)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:26.295999 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630669ed-5027-4a3d-a9fa-71b4c3fc94bd admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:26.297951 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 51/101] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:26 2021] GET /identity/v3/users/992e61bfb655451f80bb04b469d3594e => generated 247 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:26.303528 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012cc98-aeec-4afa-8a76-dd4e6c1e7d39 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:26.319051 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012cc98-aeec-4afa-8a76-dd4e6c1e7d39 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:26.327246 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06298c63-218f-4008-a69d-40fdb2a8c4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:26.328126 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06298c63-218f-4008-a69d-40fdb2a8c4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:26.328411 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06298c63-218f-4008-a69d-40fdb2a8c4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:26.328691 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06298c63-218f-4008-a69d-40fdb2a8c4f6 admin admin] PATH_INFO: `/v3/projects/febc4f33fba1433992fc8e043a47dd5c` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:26.330022 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06298c63-218f-4008-a69d-40fdb2a8c4f6 admin admin] RBAC: Authorizing `identity:get_project(project_id=febc4f33fba1433992fc8e043a47dd5c)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:26.332132 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06298c63-218f-4008-a69d-40fdb2a8c4f6 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:26.334022 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 51/102] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:26 2021] GET /identity/v3/projects/febc4f33fba1433992fc8e043a47dd5c => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:26.341594 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630669ed-5027-4a3d-a9fa-71b4c3fc94bd admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:26.354855 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630669ed-5027-4a3d-a9fa-71b4c3fc94bd admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:26.360993 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89c5d1-92ae-46e6-b712-88def16b2fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:26.361920 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89c5d1-92ae-46e6-b712-88def16b2fa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:26.362199 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89c5d1-92ae-46e6-b712-88def16b2fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:26.362474 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89c5d1-92ae-46e6-b712-88def16b2fa9 admin admin] PATH_INFO: `/v3/projects/febc4f33fba1433992fc8e043a47dd5c/users/992e61bfb655451f80bb04b469d3594e/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:26.367348 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89c5d1-92ae-46e6-b712-88def16b2fa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=febc4f33fba1433992fc8e043a47dd5c, user_id=992e61bfb655451f80bb04b469d3594e, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:26.368379 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING py.warnings [None req-6e89c5d1-92ae-46e6-b712-88def16b2fa9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:15:26.368379 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: warnings.warn(msg) Nov 23 19:15:26.368379 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: Nov 23 19:15:26.370322 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89c5d1-92ae-46e6-b712-88def16b2fa9 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:26.480852 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 52/103] 10.222.0.62 () {58 vars in 1460 bytes} [Tue Nov 23 19:15:26 2021] PUT /identity/v3/projects/febc4f33fba1433992fc8e043a47dd5c/users/992e61bfb655451f80bb04b469d3594e/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:15:26.534512 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04c233-acd2-47b7-93c7-e45d59ee8449 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:26.534926 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04c233-acd2-47b7-93c7-e45d59ee8449 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:26.535115 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04c233-acd2-47b7-93c7-e45d59ee8449 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:26.537231 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 52/104] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:26.544633 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139d4d7-d496-4998-9c3f-d9f948d31c9e None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:26.544633 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139d4d7-d496-4998-9c3f-d9f948d31c9e None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:26.545084 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139d4d7-d496-4998-9c3f-d9f948d31c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:26.570691 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-8139d4d7-d496-4998-9c3f-d9f948d31c9e None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:26.571893 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-8139d4d7-d496-4998-9c3f-d9f948d31c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:26.649622 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 53/105] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:26.682067 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04c233-acd2-47b7-93c7-e45d59ee8449 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:26.701896 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04c233-acd2-47b7-93c7-e45d59ee8449 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:26.708385 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea26f1-2c9f-4c42-b939-7bb0606e1829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:26.709250 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea26f1-2c9f-4c42-b939-7bb0606e1829 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:26.709561 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea26f1-2c9f-4c42-b939-7bb0606e1829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:26.709839 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea26f1-2c9f-4c42-b939-7bb0606e1829 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:26.727096 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea26f1-2c9f-4c42-b939-7bb0606e1829 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:26.734972 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-09ea26f1-2c9f-4c42-b939-7bb0606e1829 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 19:15:26.736459 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 53/106] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:26 2021] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:15:26.742825 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139d4d7-d496-4998-9c3f-d9f948d31c9e None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:26.759929 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139d4d7-d496-4998-9c3f-d9f948d31c9e None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:26.769793 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66368690-73e9-4329-9159-c1407d79ca8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:26.770819 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66368690-73e9-4329-9159-c1407d79ca8a admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:26.771339 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66368690-73e9-4329-9159-c1407d79ca8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:26.771810 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66368690-73e9-4329-9159-c1407d79ca8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:26.772859 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66368690-73e9-4329-9159-c1407d79ca8a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:26.773379 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66368690-73e9-4329-9159-c1407d79ca8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:26.775259 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66368690-73e9-4329-9159-c1407d79ca8a admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:26.798353 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 54/107] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Nov 23 19:15:26 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:26.804411 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea26f1-2c9f-4c42-b939-7bb0606e1829 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:26.823358 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea26f1-2c9f-4c42-b939-7bb0606e1829 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:26.831131 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07afe5-01d6-4103-8e98-4d83a2d0ae37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:26.832088 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07afe5-01d6-4103-8e98-4d83a2d0ae37 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:26.832369 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07afe5-01d6-4103-8e98-4d83a2d0ae37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:26.832692 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07afe5-01d6-4103-8e98-4d83a2d0ae37 admin admin] PATH_INFO: `/v3/users/1a1d51f0294041ae850c7db91f47882c` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:26.838533 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c07afe5-01d6-4103-8e98-4d83a2d0ae37 admin admin] RBAC: Authorizing `identity:get_user(user_id=1a1d51f0294041ae850c7db91f47882c)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:26.841092 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c07afe5-01d6-4103-8e98-4d83a2d0ae37 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:26.842792 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 54/108] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:26 2021] GET /identity/v3/users/1a1d51f0294041ae850c7db91f47882c => generated 275 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:26.848955 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66368690-73e9-4329-9159-c1407d79ca8a admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:26.869211 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66368690-73e9-4329-9159-c1407d79ca8a admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:26.877710 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2c048-d529-4886-b568-c32e37b4c083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:26.878846 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2c048-d529-4886-b568-c32e37b4c083 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:26.879358 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2c048-d529-4886-b568-c32e37b4c083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:26.879830 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2c048-d529-4886-b568-c32e37b4c083 admin admin] PATH_INFO: `/v3/projects/febc4f33fba1433992fc8e043a47dd5c` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:26.884638 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2c048-d529-4886-b568-c32e37b4c083 admin admin] RBAC: Authorizing `identity:get_project(project_id=febc4f33fba1433992fc8e043a47dd5c)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:26.887066 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2c048-d529-4886-b568-c32e37b4c083 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:26.889843 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 55/109] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:26 2021] GET /identity/v3/projects/febc4f33fba1433992fc8e043a47dd5c => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:26.896020 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2c048-d529-4886-b568-c32e37b4c083 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:26.896682 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60976aa7-7596-46d1-8b40-1f8cc185eaf4 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:26.896972 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60976aa7-7596-46d1-8b40-1f8cc185eaf4 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:26.897250 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60976aa7-7596-46d1-8b40-1f8cc185eaf4 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:26.899347 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 55/110] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:26.905777 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb6cb4-57c1-4376-a7fb-46d62c9ea72d None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:26.906116 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb6cb4-57c1-4376-a7fb-46d62c9ea72d None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:26.906493 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb6cb4-57c1-4376-a7fb-46d62c9ea72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:26.911828 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2c048-d529-4886-b568-c32e37b4c083 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:26.922709 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e666364-cb40-44a3-b500-77f030b93a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:26.923624 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e666364-cb40-44a3-b500-77f030b93a52 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:26.923917 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e666364-cb40-44a3-b500-77f030b93a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:26.924200 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e666364-cb40-44a3-b500-77f030b93a52 admin admin] PATH_INFO: `/v3/projects/febc4f33fba1433992fc8e043a47dd5c/users/1a1d51f0294041ae850c7db91f47882c/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:26.926263 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e666364-cb40-44a3-b500-77f030b93a52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=febc4f33fba1433992fc8e043a47dd5c, user_id=1a1d51f0294041ae850c7db91f47882c, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:26.927236 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-e8bb6cb4-57c1-4376-a7fb-46d62c9ea72d None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:26.928636 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-e8bb6cb4-57c1-4376-a7fb-46d62c9ea72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:26.928900 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e666364-cb40-44a3-b500-77f030b93a52 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:26.941113 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 56/111] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 19:15:26.966432 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb6cb4-57c1-4376-a7fb-46d62c9ea72d None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:26.977179 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb6cb4-57c1-4376-a7fb-46d62c9ea72d None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:26.982804 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25161ef2-4130-4b01-982f-93a5b9651b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:26.983670 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25161ef2-4130-4b01-982f-93a5b9651b23 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:26.984016 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25161ef2-4130-4b01-982f-93a5b9651b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:26.984280 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25161ef2-4130-4b01-982f-93a5b9651b23 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:26.997236 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25161ef2-4130-4b01-982f-93a5b9651b23 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:27.005072 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-25161ef2-4130-4b01-982f-93a5b9651b23 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 19:15:27.006553 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 57/112] 10.222.0.62 () {56 vars in 1135 bytes} [Tue Nov 23 19:15:26 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:15:27.012778 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25161ef2-4130-4b01-982f-93a5b9651b23 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:27.022807 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25161ef2-4130-4b01-982f-93a5b9651b23 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:27.027416 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc5797-7d51-47bd-b91e-d472891bd199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:27.028686 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc5797-7d51-47bd-b91e-d472891bd199 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:27.029016 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc5797-7d51-47bd-b91e-d472891bd199 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:27.029298 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc5797-7d51-47bd-b91e-d472891bd199 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:27.030188 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc5797-7d51-47bd-b91e-d472891bd199 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:27.030541 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc5797-7d51-47bd-b91e-d472891bd199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:27.032253 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc5797-7d51-47bd-b91e-d472891bd199 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:27.041693 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 58/113] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:15:27 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:27.048617 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc5797-7d51-47bd-b91e-d472891bd199 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:27.054541 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 56/114] 10.222.0.62 () {58 vars in 1460 bytes} [Tue Nov 23 19:15:26 2021] PUT /identity/v3/projects/febc4f33fba1433992fc8e043a47dd5c/users/1a1d51f0294041ae850c7db91f47882c/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:15:27.064165 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc5797-7d51-47bd-b91e-d472891bd199 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:27.135201 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc117aa-4d7d-4399-8af3-71f340cf1c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:27.136227 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc117aa-4d7d-4399-8af3-71f340cf1c92 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:27.136554 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc117aa-4d7d-4399-8af3-71f340cf1c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:27.136785 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc117aa-4d7d-4399-8af3-71f340cf1c92 admin admin] PATH_INFO: `/v3/users/1a1d51f0294041ae850c7db91f47882c` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:27.140341 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc117aa-4d7d-4399-8af3-71f340cf1c92 admin admin] RBAC: Authorizing `identity:get_user(user_id=1a1d51f0294041ae850c7db91f47882c)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:27.142619 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc117aa-4d7d-4399-8af3-71f340cf1c92 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:27.144381 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 59/115] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:27 2021] GET /identity/v3/users/1a1d51f0294041ae850c7db91f47882c => generated 275 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:27.150846 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e666364-cb40-44a3-b500-77f030b93a52 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:27.176025 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e666364-cb40-44a3-b500-77f030b93a52 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:27.186022 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867eb10a-5e92-4f28-bf21-746780d65b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:27.186926 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867eb10a-5e92-4f28-bf21-746780d65b80 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:27.187213 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867eb10a-5e92-4f28-bf21-746780d65b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:27.187491 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867eb10a-5e92-4f28-bf21-746780d65b80 admin admin] PATH_INFO: `/v3/projects/febc4f33fba1433992fc8e043a47dd5c` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:27.190135 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867eb10a-5e92-4f28-bf21-746780d65b80 admin admin] RBAC: Authorizing `identity:get_project(project_id=febc4f33fba1433992fc8e043a47dd5c)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:27.192251 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867eb10a-5e92-4f28-bf21-746780d65b80 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:27.194683 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 57/116] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:27 2021] GET /identity/v3/projects/febc4f33fba1433992fc8e043a47dd5c => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:27.201679 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc117aa-4d7d-4399-8af3-71f340cf1c92 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:27.215881 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc117aa-4d7d-4399-8af3-71f340cf1c92 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:27.222698 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079aaf5e-b502-4ed7-8320-734db257c2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:27.223616 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079aaf5e-b502-4ed7-8320-734db257c2e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:27.223947 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079aaf5e-b502-4ed7-8320-734db257c2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:27.224224 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079aaf5e-b502-4ed7-8320-734db257c2e2 admin admin] PATH_INFO: `/v3/projects/febc4f33fba1433992fc8e043a47dd5c/users/1a1d51f0294041ae850c7db91f47882c/roles/bc8a8682d8f748788fb70d235f9978dc` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:27.228148 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079aaf5e-b502-4ed7-8320-734db257c2e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=febc4f33fba1433992fc8e043a47dd5c, user_id=1a1d51f0294041ae850c7db91f47882c, role_id=bc8a8682d8f748788fb70d235f9978dc)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:27.231571 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079aaf5e-b502-4ed7-8320-734db257c2e2 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:27.322009 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 60/117] 10.222.0.62 () {58 vars in 1460 bytes} [Tue Nov 23 19:15:27 2021] PUT /identity/v3/projects/febc4f33fba1433992fc8e043a47dd5c/users/1a1d51f0294041ae850c7db91f47882c/roles/bc8a8682d8f748788fb70d235f9978dc => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:15:27.505493 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d8550-7a03-47f3-81d8-bec6e6ee63b3 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:27.505864 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d8550-7a03-47f3-81d8-bec6e6ee63b3 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:27.506077 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d8550-7a03-47f3-81d8-bec6e6ee63b3 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:27.508103 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 58/118] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:27.518432 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c859d-9679-47a0-a1fd-b1c9e4c63f35 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:27.518730 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c859d-9679-47a0-a1fd-b1c9e4c63f35 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:27.518995 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c859d-9679-47a0-a1fd-b1c9e4c63f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:27.545859 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-8d9c859d-9679-47a0-a1fd-b1c9e4c63f35 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:27.547106 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-8d9c859d-9679-47a0-a1fd-b1c9e4c63f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:27.616296 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 61/119] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:27.642693 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d8550-7a03-47f3-81d8-bec6e6ee63b3 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:27.659899 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d8550-7a03-47f3-81d8-bec6e6ee63b3 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:27.666101 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc167be-03da-4921-9a9e-412b09608e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:27.666903 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc167be-03da-4921-9a9e-412b09608e92 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:27.667189 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc167be-03da-4921-9a9e-412b09608e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:27.667471 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc167be-03da-4921-9a9e-412b09608e92 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:27.679058 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc167be-03da-4921-9a9e-412b09608e92 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:27.687717 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-bcc167be-03da-4921-9a9e-412b09608e92 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 19:15:27.689294 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 59/120] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:27 2021] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:15:27.695854 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c859d-9679-47a0-a1fd-b1c9e4c63f35 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:27.706217 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c859d-9679-47a0-a1fd-b1c9e4c63f35 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:27.711023 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409ef57-9f54-4a56-9ab5-6f6c9f9d84e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:27.711685 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409ef57-9f54-4a56-9ab5-6f6c9f9d84e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:27.711969 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409ef57-9f54-4a56-9ab5-6f6c9f9d84e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:27.712246 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409ef57-9f54-4a56-9ab5-6f6c9f9d84e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:27.713009 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c409ef57-9f54-4a56-9ab5-6f6c9f9d84e7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:27.713371 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c409ef57-9f54-4a56-9ab5-6f6c9f9d84e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:27.715104 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c409ef57-9f54-4a56-9ab5-6f6c9f9d84e7 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:27.725362 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 62/121] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Nov 23 19:15:27 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:27.733177 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc167be-03da-4921-9a9e-412b09608e92 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:27.743749 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc167be-03da-4921-9a9e-412b09608e92 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:27.749892 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94f125-d24a-42d0-82be-4cb2166539f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:27.750817 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94f125-d24a-42d0-82be-4cb2166539f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:27.751155 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94f125-d24a-42d0-82be-4cb2166539f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:27.751693 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94f125-d24a-42d0-82be-4cb2166539f4 admin admin] PATH_INFO: `/v3/users/1a1d51f0294041ae850c7db91f47882c` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:27.752972 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa94f125-d24a-42d0-82be-4cb2166539f4 admin admin] RBAC: Authorizing `identity:get_user(user_id=1a1d51f0294041ae850c7db91f47882c)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:27.755254 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa94f125-d24a-42d0-82be-4cb2166539f4 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:27.756976 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 60/122] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:27 2021] GET /identity/v3/users/1a1d51f0294041ae850c7db91f47882c => generated 275 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:27.764823 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409ef57-9f54-4a56-9ab5-6f6c9f9d84e7 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:27.774916 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409ef57-9f54-4a56-9ab5-6f6c9f9d84e7 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:27.780733 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fdbf7-89af-4e2b-b001-f6e1da02a89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:27.781711 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fdbf7-89af-4e2b-b001-f6e1da02a89a admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:27.782000 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fdbf7-89af-4e2b-b001-f6e1da02a89a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:27.782280 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fdbf7-89af-4e2b-b001-f6e1da02a89a admin admin] PATH_INFO: `/v3/projects/aa3804c377fa45e3bbd258b742110f95` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:27.783539 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425fdbf7-89af-4e2b-b001-f6e1da02a89a admin admin] RBAC: Authorizing `identity:get_project(project_id=aa3804c377fa45e3bbd258b742110f95)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:27.791153 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425fdbf7-89af-4e2b-b001-f6e1da02a89a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:27.792982 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 63/123] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:27 2021] GET /identity/v3/projects/aa3804c377fa45e3bbd258b742110f95 => generated 312 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:27.800480 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94f125-d24a-42d0-82be-4cb2166539f4 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:27.816160 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94f125-d24a-42d0-82be-4cb2166539f4 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:27.821237 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c649b-04b2-460b-bc78-fff4eced382d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:27.822256 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c649b-04b2-460b-bc78-fff4eced382d admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:27.822544 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c649b-04b2-460b-bc78-fff4eced382d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:27.822821 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c649b-04b2-460b-bc78-fff4eced382d admin admin] PATH_INFO: `/v3/projects/aa3804c377fa45e3bbd258b742110f95/users/1a1d51f0294041ae850c7db91f47882c/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:27.825467 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c649b-04b2-460b-bc78-fff4eced382d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa3804c377fa45e3bbd258b742110f95, user_id=1a1d51f0294041ae850c7db91f47882c, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:27.828233 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c649b-04b2-460b-bc78-fff4eced382d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:27.914754 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 61/124] 10.222.0.62 () {58 vars in 1460 bytes} [Tue Nov 23 19:15:27 2021] PUT /identity/v3/projects/aa3804c377fa45e3bbd258b742110f95/users/1a1d51f0294041ae850c7db91f47882c/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:15:28.344433 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10220397-4e6c-47d9-9594-ad8a91aedc4b None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:28.345148 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10220397-4e6c-47d9-9594-ad8a91aedc4b None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:28.345148 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10220397-4e6c-47d9-9594-ad8a91aedc4b None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:28.346964 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 64/125] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:28.358890 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0cec8-448a-4a52-b171-a4730ed2f430 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:28.359436 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0cec8-448a-4a52-b171-a4730ed2f430 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:28.359436 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0cec8-448a-4a52-b171-a4730ed2f430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:28.384784 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-c9c0cec8-448a-4a52-b171-a4730ed2f430 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:28.386026 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-c9c0cec8-448a-4a52-b171-a4730ed2f430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:28.471864 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 62/126] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:28.514851 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10220397-4e6c-47d9-9594-ad8a91aedc4b None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:28.530447 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10220397-4e6c-47d9-9594-ad8a91aedc4b None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:28.536592 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3cc4e-f65b-4e33-9773-17164c997415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:28.537401 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3cc4e-f65b-4e33-9773-17164c997415 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:28.537753 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3cc4e-f65b-4e33-9773-17164c997415 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:28.538030 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3cc4e-f65b-4e33-9773-17164c997415 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:28.539273 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3cc4e-f65b-4e33-9773-17164c997415 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:28.541095 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3cc4e-f65b-4e33-9773-17164c997415 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:28.543153 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 65/127] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:15:28 2021] GET /identity/v3/domains/default => generated 199 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:28.549264 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0cec8-448a-4a52-b171-a4730ed2f430 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:28.558714 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0cec8-448a-4a52-b171-a4730ed2f430 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:28.567031 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bea97d-652c-4551-95ed-4744b1280f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:28.567761 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bea97d-652c-4551-95ed-4744b1280f69 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:28.568087 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bea97d-652c-4551-95ed-4744b1280f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:28.568377 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bea97d-652c-4551-95ed-4744b1280f69 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:28.569120 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bea97d-652c-4551-95ed-4744b1280f69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:28.571472 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bea97d-652c-4551-95ed-4744b1280f69 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:28.594336 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac8035-263c-462f-89d6-4db30cbe8b4f None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:28.594770 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac8035-263c-462f-89d6-4db30cbe8b4f None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:28.594885 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac8035-263c-462f-89d6-4db30cbe8b4f None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:28.597031 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 66/128] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:28.603235 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71541cd-69f7-4bc0-b1cd-21f77ddcc89e None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:28.603791 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71541cd-69f7-4bc0-b1cd-21f77ddcc89e None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:28.604249 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71541cd-69f7-4bc0-b1cd-21f77ddcc89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:28.630253 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-e71541cd-69f7-4bc0-b1cd-21f77ddcc89e None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:28.631790 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-e71541cd-69f7-4bc0-b1cd-21f77ddcc89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:28.644043 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 67/129] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 19:15:28.687603 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71541cd-69f7-4bc0-b1cd-21f77ddcc89e None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:28.698929 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71541cd-69f7-4bc0-b1cd-21f77ddcc89e None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:28.705179 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfd295-a821-4f54-80a4-4c5d538f72ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:28.706227 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfd295-a821-4f54-80a4-4c5d538f72ee admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:28.706729 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfd295-a821-4f54-80a4-4c5d538f72ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:28.707225 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfd295-a821-4f54-80a4-4c5d538f72ee admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:28.727293 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdfd295-a821-4f54-80a4-4c5d538f72ee admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:28.736132 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 63/130] 10.222.0.62 () {60 vars in 1162 bytes} [Tue Nov 23 19:15:28 2021] POST /identity/v3/projects => generated 302 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:15:28.747131 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-abdfd295-a821-4f54-80a4-4c5d538f72ee admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 23 19:15:28.749066 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 68/131] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:28 2021] GET /identity/v3/roles/reader => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:15:28.755584 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bea97d-652c-4551-95ed-4744b1280f69 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:28.851011 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bea97d-652c-4551-95ed-4744b1280f69 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:28.855553 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5766461-13e1-4491-8f8d-66c79d61fa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:28.856950 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5766461-13e1-4491-8f8d-66c79d61fa46 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:28.856950 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5766461-13e1-4491-8f8d-66c79d61fa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:28.857483 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5766461-13e1-4491-8f8d-66c79d61fa46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:28.858271 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5766461-13e1-4491-8f8d-66c79d61fa46 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:28.858579 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5766461-13e1-4491-8f8d-66c79d61fa46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:28.860210 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5766461-13e1-4491-8f8d-66c79d61fa46 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:28.869469 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 64/132] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Nov 23 19:15:28 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:28.875998 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfd295-a821-4f54-80a4-4c5d538f72ee admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:28.891071 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfd295-a821-4f54-80a4-4c5d538f72ee admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:28.900820 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b364cd-72ea-4088-bad5-29ca99ec34f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:28.902113 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b364cd-72ea-4088-bad5-29ca99ec34f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:28.902632 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b364cd-72ea-4088-bad5-29ca99ec34f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:28.904303 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b364cd-72ea-4088-bad5-29ca99ec34f8 admin admin] PATH_INFO: `/v3/users/cfea5bb8b59d4da9821c179a677be7c1` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:28.924098 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b364cd-72ea-4088-bad5-29ca99ec34f8 admin admin] RBAC: Authorizing `identity:get_user(user_id=cfea5bb8b59d4da9821c179a677be7c1)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:28.926641 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b364cd-72ea-4088-bad5-29ca99ec34f8 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:28.928585 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 69/133] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:28 2021] GET /identity/v3/users/cfea5bb8b59d4da9821c179a677be7c1 => generated 289 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:28.934716 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5766461-13e1-4491-8f8d-66c79d61fa46 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:28.952132 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5766461-13e1-4491-8f8d-66c79d61fa46 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:28.961543 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fe910-30fd-4c42-885d-172e82b6b6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:28.962217 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fe910-30fd-4c42-885d-172e82b6b6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:28.962503 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fe910-30fd-4c42-885d-172e82b6b6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:28.962779 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fe910-30fd-4c42-885d-172e82b6b6e1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:28.977582 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87fe910-30fd-4c42-885d-172e82b6b6e1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:28.979395 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87fe910-30fd-4c42-885d-172e82b6b6e1 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:28.995587 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 65/134] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:15:28 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:15:29.001894 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b364cd-72ea-4088-bad5-29ca99ec34f8 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:29.019082 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b364cd-72ea-4088-bad5-29ca99ec34f8 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:29.031838 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9a01d-1f3c-4549-b731-d43b00bfae75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:29.037282 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9a01d-1f3c-4549-b731-d43b00bfae75 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:29.037282 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9a01d-1f3c-4549-b731-d43b00bfae75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:29.037282 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9a01d-1f3c-4549-b731-d43b00bfae75 admin admin] PATH_INFO: `/v3/projects/febc4f33fba1433992fc8e043a47dd5c` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:29.037282 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9a01d-1f3c-4549-b731-d43b00bfae75 admin admin] RBAC: Authorizing `identity:get_project(project_id=febc4f33fba1433992fc8e043a47dd5c)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:29.037282 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9a01d-1f3c-4549-b731-d43b00bfae75 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:29.039709 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 70/135] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:29 2021] GET /identity/v3/projects/febc4f33fba1433992fc8e043a47dd5c => generated 298 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:29.046198 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fe910-30fd-4c42-885d-172e82b6b6e1 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:29.058692 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fe910-30fd-4c42-885d-172e82b6b6e1 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:29.069188 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555f675-d404-445c-b311-daddaa9ead27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:29.070134 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555f675-d404-445c-b311-daddaa9ead27 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:29.070417 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555f675-d404-445c-b311-daddaa9ead27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:29.070691 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555f675-d404-445c-b311-daddaa9ead27 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:29.071540 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555f675-d404-445c-b311-daddaa9ead27 admin admin] RBAC: Adding query filter params (role.id=52f47babce8e4dd7ae9b425160368b17, scope.project.id=febc4f33fba1433992fc8e043a47dd5c, user.id=cfea5bb8b59d4da9821c179a677be7c1) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:29.071848 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555f675-d404-445c-b311-daddaa9ead27 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:29.073718 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555f675-d404-445c-b311-daddaa9ead27 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:29.085655 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 66/136] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:15:29 2021] GET /identity/v3/role_assignments?user.id=cfea5bb8b59d4da9821c179a677be7c1&scope.project.id=febc4f33fba1433992fc8e043a47dd5c&role.id=52f47babce8e4dd7ae9b425160368b17 => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:30.000603 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c81ed-bd21-4a88-b2fd-0f98ae7da3fe None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:30.001657 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c81ed-bd21-4a88-b2fd-0f98ae7da3fe None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:30.002147 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c81ed-bd21-4a88-b2fd-0f98ae7da3fe None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:30.004139 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 71/137] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:29 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:30.009933 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bb82c-d78e-4339-bb87-d6bf37869c5a None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:30.010772 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bb82c-d78e-4339-bb87-d6bf37869c5a None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:30.011248 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bb82c-d78e-4339-bb87-d6bf37869c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:30.034196 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-b75bb82c-d78e-4339-bb87-d6bf37869c5a None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:30.038403 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-b75bb82c-d78e-4339-bb87-d6bf37869c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:30.043323 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 67/138] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:30.069274 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c81ed-bd21-4a88-b2fd-0f98ae7da3fe None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:30.082953 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c81ed-bd21-4a88-b2fd-0f98ae7da3fe None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:30.087732 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809ce92-d45e-4baf-8c96-a77503b795bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:30.088519 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809ce92-d45e-4baf-8c96-a77503b795bc admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:30.088807 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809ce92-d45e-4baf-8c96-a77503b795bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:30.089085 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809ce92-d45e-4baf-8c96-a77503b795bc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:30.100545 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809ce92-d45e-4baf-8c96-a77503b795bc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:30.108618 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-2809ce92-d45e-4baf-8c96-a77503b795bc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 19:15:30.110130 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 72/139] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:15:30 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:15:30.116155 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75bb82c-d78e-4339-bb87-d6bf37869c5a None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:30.126242 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75bb82c-d78e-4339-bb87-d6bf37869c5a None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:30.130708 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67c4b7-bca8-4ccc-a3ba-4041b4e32b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:30.131369 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67c4b7-bca8-4ccc-a3ba-4041b4e32b84 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:30.131655 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67c4b7-bca8-4ccc-a3ba-4041b4e32b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:30.131932 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67c4b7-bca8-4ccc-a3ba-4041b4e32b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:30.132698 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67c4b7-bca8-4ccc-a3ba-4041b4e32b84 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:30.133004 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67c4b7-bca8-4ccc-a3ba-4041b4e32b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:30.134651 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67c4b7-bca8-4ccc-a3ba-4041b4e32b84 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:30.144269 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 68/140] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:30 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:30.150261 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809ce92-d45e-4baf-8c96-a77503b795bc admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:30.160596 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809ce92-d45e-4baf-8c96-a77503b795bc admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:30.165018 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898ce7f-2d00-4734-b232-aa0358a02b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:30.166129 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898ce7f-2d00-4734-b232-aa0358a02b20 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:30.166417 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898ce7f-2d00-4734-b232-aa0358a02b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:30.166730 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898ce7f-2d00-4734-b232-aa0358a02b20 admin admin] PATH_INFO: `/v3/users/992e61bfb655451f80bb04b469d3594e` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:30.167964 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a898ce7f-2d00-4734-b232-aa0358a02b20 admin admin] RBAC: Authorizing `identity:get_user(user_id=992e61bfb655451f80bb04b469d3594e)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:30.170510 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a898ce7f-2d00-4734-b232-aa0358a02b20 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:30.172341 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 73/141] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:30 2021] GET /identity/v3/users/992e61bfb655451f80bb04b469d3594e => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:30.178130 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67c4b7-bca8-4ccc-a3ba-4041b4e32b84 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:30.189569 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67c4b7-bca8-4ccc-a3ba-4041b4e32b84 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:30.194153 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2be90b-1c72-435d-8c30-d7d8e8f2f33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:30.195121 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2be90b-1c72-435d-8c30-d7d8e8f2f33b admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:30.195415 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2be90b-1c72-435d-8c30-d7d8e8f2f33b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:30.195731 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2be90b-1c72-435d-8c30-d7d8e8f2f33b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:30.205658 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2be90b-1c72-435d-8c30-d7d8e8f2f33b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:30.207503 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2be90b-1c72-435d-8c30-d7d8e8f2f33b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:30.222694 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 69/142] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:15:30 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:15:30.228833 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898ce7f-2d00-4734-b232-aa0358a02b20 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:30.241736 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898ce7f-2d00-4734-b232-aa0358a02b20 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:30.248486 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b27ce9-26f1-4e2d-b3b7-6b5e20b8f726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:30.249431 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b27ce9-26f1-4e2d-b3b7-6b5e20b8f726 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:30.249732 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b27ce9-26f1-4e2d-b3b7-6b5e20b8f726 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:30.250060 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b27ce9-26f1-4e2d-b3b7-6b5e20b8f726 admin admin] PATH_INFO: `/v3/projects/febc4f33fba1433992fc8e043a47dd5c` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:30.254417 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b27ce9-26f1-4e2d-b3b7-6b5e20b8f726 admin admin] RBAC: Authorizing `identity:get_project(project_id=febc4f33fba1433992fc8e043a47dd5c)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:30.256642 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b27ce9-26f1-4e2d-b3b7-6b5e20b8f726 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:30.258569 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 74/143] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:30 2021] GET /identity/v3/projects/febc4f33fba1433992fc8e043a47dd5c => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:30.266078 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2be90b-1c72-435d-8c30-d7d8e8f2f33b admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:30.276619 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2be90b-1c72-435d-8c30-d7d8e8f2f33b admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:30.283623 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad366bbc-8e16-4ece-aecc-c99554fdf0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:30.284508 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad366bbc-8e16-4ece-aecc-c99554fdf0ec admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:30.284800 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad366bbc-8e16-4ece-aecc-c99554fdf0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:30.285083 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad366bbc-8e16-4ece-aecc-c99554fdf0ec admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:30.286080 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad366bbc-8e16-4ece-aecc-c99554fdf0ec admin admin] RBAC: Adding query filter params (role.id=6d9a8878ffeb49fea19d854657c6b767, scope.project.id=febc4f33fba1433992fc8e043a47dd5c, user.id=992e61bfb655451f80bb04b469d3594e) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:30.286398 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad366bbc-8e16-4ece-aecc-c99554fdf0ec admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:30.288323 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad366bbc-8e16-4ece-aecc-c99554fdf0ec admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:30.295806 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 70/144] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:15:30 2021] GET /identity/v3/role_assignments?user.id=992e61bfb655451f80bb04b469d3594e&scope.project.id=febc4f33fba1433992fc8e043a47dd5c&role.id=6d9a8878ffeb49fea19d854657c6b767 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:30.593055 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f8aa6-7c47-4a9b-b1d3-21f8d4db246e None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:30.593464 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f8aa6-7c47-4a9b-b1d3-21f8d4db246e None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:30.593698 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f8aa6-7c47-4a9b-b1d3-21f8d4db246e None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:30.595734 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 75/145] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:30.601274 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe0c3d-1adf-4180-8abb-5f49d9464366 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:30.601608 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe0c3d-1adf-4180-8abb-5f49d9464366 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:30.601887 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe0c3d-1adf-4180-8abb-5f49d9464366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:30.626154 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-afbe0c3d-1adf-4180-8abb-5f49d9464366 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:30.627377 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-afbe0c3d-1adf-4180-8abb-5f49d9464366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:30.641715 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 71/146] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:30.673943 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f8aa6-7c47-4a9b-b1d3-21f8d4db246e None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:30.691509 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f8aa6-7c47-4a9b-b1d3-21f8d4db246e None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:30.703984 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e1b96-a1e9-4745-a86f-5c008bdbd207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:30.705092 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e1b96-a1e9-4745-a86f-5c008bdbd207 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:30.705620 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e1b96-a1e9-4745-a86f-5c008bdbd207 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:30.706094 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e1b96-a1e9-4745-a86f-5c008bdbd207 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:30.722782 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e1b96-a1e9-4745-a86f-5c008bdbd207 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:30.730479 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-cd1e1b96-a1e9-4745-a86f-5c008bdbd207 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 19:15:30.733020 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 76/147] 10.222.0.62 () {56 vars in 1135 bytes} [Tue Nov 23 19:15:30 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:15:30.745499 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe0c3d-1adf-4180-8abb-5f49d9464366 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:30.766486 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe0c3d-1adf-4180-8abb-5f49d9464366 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:30.774704 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292c610-cefc-4547-bb03-9faee15e4b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:30.775436 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292c610-cefc-4547-bb03-9faee15e4b1d admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:30.775727 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292c610-cefc-4547-bb03-9faee15e4b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:30.776004 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292c610-cefc-4547-bb03-9faee15e4b1d admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:30.776781 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292c610-cefc-4547-bb03-9faee15e4b1d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:30.777091 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292c610-cefc-4547-bb03-9faee15e4b1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:30.779979 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292c610-cefc-4547-bb03-9faee15e4b1d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:30.800884 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 72/148] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:15:30 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:30.807301 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e1b96-a1e9-4745-a86f-5c008bdbd207 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:30.822807 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e1b96-a1e9-4745-a86f-5c008bdbd207 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:30.833527 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbe83b-4b13-47ba-934a-c07c03c074d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:30.834527 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbe83b-4b13-47ba-934a-c07c03c074d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:30.834921 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbe83b-4b13-47ba-934a-c07c03c074d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:30.835303 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbe83b-4b13-47ba-934a-c07c03c074d9 admin admin] PATH_INFO: `/v3/users/1a1d51f0294041ae850c7db91f47882c` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:30.840045 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbe83b-4b13-47ba-934a-c07c03c074d9 admin admin] RBAC: Authorizing `identity:get_user(user_id=1a1d51f0294041ae850c7db91f47882c)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:30.842968 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbe83b-4b13-47ba-934a-c07c03c074d9 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:30.844787 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 77/149] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:30 2021] GET /identity/v3/users/1a1d51f0294041ae850c7db91f47882c => generated 275 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:30.850949 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292c610-cefc-4547-bb03-9faee15e4b1d admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:30.866868 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292c610-cefc-4547-bb03-9faee15e4b1d admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:30.874020 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25913718-2cf0-4f5c-90ef-a320c16fa05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:30.874734 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25913718-2cf0-4f5c-90ef-a320c16fa05b admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:30.875025 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25913718-2cf0-4f5c-90ef-a320c16fa05b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:30.875302 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25913718-2cf0-4f5c-90ef-a320c16fa05b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:30.892349 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25913718-2cf0-4f5c-90ef-a320c16fa05b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:30.894157 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25913718-2cf0-4f5c-90ef-a320c16fa05b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:30.905820 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 73/150] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:15:30 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:15:30.912126 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbe83b-4b13-47ba-934a-c07c03c074d9 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:30.927173 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbe83b-4b13-47ba-934a-c07c03c074d9 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:30.927852 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355ce2c-0048-40ea-969b-aea1233e67f3 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:30.928246 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355ce2c-0048-40ea-969b-aea1233e67f3 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:30.928532 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355ce2c-0048-40ea-969b-aea1233e67f3 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:30.930401 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 74/151] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 19:15:30.936877 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b01a5-57a7-4b59-b741-3abf02ac5520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:30.937902 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b01a5-57a7-4b59-b741-3abf02ac5520 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:30.938262 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b01a5-57a7-4b59-b741-3abf02ac5520 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:30.938610 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b01a5-57a7-4b59-b741-3abf02ac5520 admin admin] PATH_INFO: `/v3/projects/febc4f33fba1433992fc8e043a47dd5c` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:30.941923 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b01a5-57a7-4b59-b741-3abf02ac5520 admin admin] RBAC: Authorizing `identity:get_project(project_id=febc4f33fba1433992fc8e043a47dd5c)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:30.944094 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b01a5-57a7-4b59-b741-3abf02ac5520 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:30.946230 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 78/152] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:30 2021] GET /identity/v3/projects/febc4f33fba1433992fc8e043a47dd5c => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:30.949542 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b5fdf-9917-422d-8491-e9d389ac863f None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:30.951204 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b5fdf-9917-422d-8491-e9d389ac863f None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:30.951570 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b5fdf-9917-422d-8491-e9d389ac863f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:30.958777 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b01a5-57a7-4b59-b741-3abf02ac5520 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:30.975437 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b01a5-57a7-4b59-b741-3abf02ac5520 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:30.977025 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-ae0b5fdf-9917-422d-8491-e9d389ac863f None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:30.978444 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-ae0b5fdf-9917-422d-8491-e9d389ac863f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:30.980647 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ee86a-1dc2-43ed-bb56-ef2bcf153ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:30.981305 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ee86a-1dc2-43ed-bb56-ef2bcf153ace admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:30.981669 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ee86a-1dc2-43ed-bb56-ef2bcf153ace admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:30.981957 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ee86a-1dc2-43ed-bb56-ef2bcf153ace admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:30.982926 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ee86a-1dc2-43ed-bb56-ef2bcf153ace admin admin] RBAC: Adding query filter params (role.id=bc8a8682d8f748788fb70d235f9978dc, scope.project.id=febc4f33fba1433992fc8e043a47dd5c, user.id=1a1d51f0294041ae850c7db91f47882c) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:30.983244 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ee86a-1dc2-43ed-bb56-ef2bcf153ace admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:30.985444 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ee86a-1dc2-43ed-bb56-ef2bcf153ace admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:31.000215 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 75/154] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:31.000595 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 79/154] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:15:30 2021] GET /identity/v3/role_assignments?user.id=1a1d51f0294041ae850c7db91f47882c&scope.project.id=febc4f33fba1433992fc8e043a47dd5c&role.id=bc8a8682d8f748788fb70d235f9978dc => generated 608 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:31.042232 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b5fdf-9917-422d-8491-e9d389ac863f None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:31.059017 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b5fdf-9917-422d-8491-e9d389ac863f None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:31.070388 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289af9ad-0f06-4d5b-8c8e-5c4581e05176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:31.071229 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289af9ad-0f06-4d5b-8c8e-5c4581e05176 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:31.071511 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289af9ad-0f06-4d5b-8c8e-5c4581e05176 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:31.071786 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289af9ad-0f06-4d5b-8c8e-5c4581e05176 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:31.094117 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289af9ad-0f06-4d5b-8c8e-5c4581e05176 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:31.101477 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-289af9ad-0f06-4d5b-8c8e-5c4581e05176 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 19:15:31.102954 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 76/155] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:31 2021] GET /identity/v3/roles/member => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:15:31.110523 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ee86a-1dc2-43ed-bb56-ef2bcf153ace admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:31.127339 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ee86a-1dc2-43ed-bb56-ef2bcf153ace admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:31.136250 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a0496-cafa-495f-b300-3b89a5ba7c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:31.136925 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a0496-cafa-495f-b300-3b89a5ba7c2c admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:31.137790 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a0496-cafa-495f-b300-3b89a5ba7c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:31.138106 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a0496-cafa-495f-b300-3b89a5ba7c2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:31.138855 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a0496-cafa-495f-b300-3b89a5ba7c2c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:31.139199 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a0496-cafa-495f-b300-3b89a5ba7c2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:31.140977 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a0496-cafa-495f-b300-3b89a5ba7c2c admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:31.155395 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 80/156] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Nov 23 19:15:31 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:31.161655 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289af9ad-0f06-4d5b-8c8e-5c4581e05176 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:31.175290 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289af9ad-0f06-4d5b-8c8e-5c4581e05176 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:31.183915 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e45ab-ec3a-4f26-828f-1e5a5aa919db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:31.185544 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e45ab-ec3a-4f26-828f-1e5a5aa919db admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:31.185838 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e45ab-ec3a-4f26-828f-1e5a5aa919db admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:31.186114 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e45ab-ec3a-4f26-828f-1e5a5aa919db admin admin] PATH_INFO: `/v3/users/1a1d51f0294041ae850c7db91f47882c` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:31.187561 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e45ab-ec3a-4f26-828f-1e5a5aa919db admin admin] RBAC: Authorizing `identity:get_user(user_id=1a1d51f0294041ae850c7db91f47882c)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:31.189789 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e45ab-ec3a-4f26-828f-1e5a5aa919db admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:31.191760 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 77/157] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:31 2021] GET /identity/v3/users/1a1d51f0294041ae850c7db91f47882c => generated 275 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:31.198248 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a0496-cafa-495f-b300-3b89a5ba7c2c admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:31.215306 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a0496-cafa-495f-b300-3b89a5ba7c2c admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:31.222789 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfbc38-36fb-4db8-b0a9-408a96b565f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:31.223516 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfbc38-36fb-4db8-b0a9-408a96b565f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:31.223806 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfbc38-36fb-4db8-b0a9-408a96b565f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:31.224089 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfbc38-36fb-4db8-b0a9-408a96b565f1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:31.238478 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dfbc38-36fb-4db8-b0a9-408a96b565f1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:31.240448 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dfbc38-36fb-4db8-b0a9-408a96b565f1 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:31.253731 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 81/158] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:15:31 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:15:31.259302 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e45ab-ec3a-4f26-828f-1e5a5aa919db admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:31.279968 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e45ab-ec3a-4f26-828f-1e5a5aa919db admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:31.287823 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf29cc8-3442-4981-8c2f-0cca642f72dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:31.288681 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf29cc8-3442-4981-8c2f-0cca642f72dc admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:31.288961 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf29cc8-3442-4981-8c2f-0cca642f72dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:31.289241 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf29cc8-3442-4981-8c2f-0cca642f72dc admin admin] PATH_INFO: `/v3/projects/febc4f33fba1433992fc8e043a47dd5c` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:31.291654 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf29cc8-3442-4981-8c2f-0cca642f72dc admin admin] RBAC: Authorizing `identity:get_project(project_id=febc4f33fba1433992fc8e043a47dd5c)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:31.294591 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf29cc8-3442-4981-8c2f-0cca642f72dc admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:31.296626 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 78/159] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:31 2021] GET /identity/v3/projects/febc4f33fba1433992fc8e043a47dd5c => generated 298 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:31.302495 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfbc38-36fb-4db8-b0a9-408a96b565f1 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:31.312177 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfbc38-36fb-4db8-b0a9-408a96b565f1 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:31.320979 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd095076-b869-4623-9201-e690909ab009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:31.321664 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd095076-b869-4623-9201-e690909ab009 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:31.321946 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd095076-b869-4623-9201-e690909ab009 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:31.322225 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd095076-b869-4623-9201-e690909ab009 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:31.323073 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd095076-b869-4623-9201-e690909ab009 admin admin] RBAC: Adding query filter params (role.id=f8b0ca7636ad450b94f68df7bc4497aa, scope.project.id=febc4f33fba1433992fc8e043a47dd5c, user.id=1a1d51f0294041ae850c7db91f47882c) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:31.323384 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd095076-b869-4623-9201-e690909ab009 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:31.325855 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd095076-b869-4623-9201-e690909ab009 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:31.332353 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 82/160] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:15:31 2021] GET /identity/v3/role_assignments?user.id=1a1d51f0294041ae850c7db91f47882c&scope.project.id=febc4f33fba1433992fc8e043a47dd5c&role.id=f8b0ca7636ad450b94f68df7bc4497aa => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:31.572353 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac46ca5-f8eb-4da9-b67d-8f819d66f1c9 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:31.572735 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac46ca5-f8eb-4da9-b67d-8f819d66f1c9 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:31.572899 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac46ca5-f8eb-4da9-b67d-8f819d66f1c9 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:31.575302 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 79/161] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:31.581474 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bfd79-974f-461e-bbc0-0db4c8173080 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:31.581774 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bfd79-974f-461e-bbc0-0db4c8173080 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:31.582052 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bfd79-974f-461e-bbc0-0db4c8173080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:31.600810 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-992bfd79-974f-461e-bbc0-0db4c8173080 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:31.602058 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-992bfd79-974f-461e-bbc0-0db4c8173080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:31.610339 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 83/162] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:31.635003 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac46ca5-f8eb-4da9-b67d-8f819d66f1c9 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:31.647900 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac46ca5-f8eb-4da9-b67d-8f819d66f1c9 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:31.652597 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5393f-ec2a-4c76-baec-2460da7ab87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:31.654034 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5393f-ec2a-4c76-baec-2460da7ab87f admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:31.654311 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5393f-ec2a-4c76-baec-2460da7ab87f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:31.654639 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5393f-ec2a-4c76-baec-2460da7ab87f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:31.665993 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b5393f-ec2a-4c76-baec-2460da7ab87f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:31.673546 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-61b5393f-ec2a-4c76-baec-2460da7ab87f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 19:15:31.674813 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 80/163] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:31 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:15:31.681032 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bfd79-974f-461e-bbc0-0db4c8173080 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:31.690116 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bfd79-974f-461e-bbc0-0db4c8173080 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:31.694357 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbfc72-0c38-4efd-9766-b47aeb1c3471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:31.695276 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbfc72-0c38-4efd-9766-b47aeb1c3471 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:31.695555 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbfc72-0c38-4efd-9766-b47aeb1c3471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:31.695824 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbfc72-0c38-4efd-9766-b47aeb1c3471 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:31.696581 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbfc72-0c38-4efd-9766-b47aeb1c3471 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:31.696889 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbfc72-0c38-4efd-9766-b47aeb1c3471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:31.698490 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbfc72-0c38-4efd-9766-b47aeb1c3471 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:31.707139 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 84/164] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Nov 23 19:15:31 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:31.712946 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5393f-ec2a-4c76-baec-2460da7ab87f admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:31.723411 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5393f-ec2a-4c76-baec-2460da7ab87f admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:31.727863 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962310e5-50c4-4c3b-81ae-4f6dd064fc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:31.728767 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962310e5-50c4-4c3b-81ae-4f6dd064fc46 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:31.729046 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962310e5-50c4-4c3b-81ae-4f6dd064fc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:31.729315 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962310e5-50c4-4c3b-81ae-4f6dd064fc46 admin admin] PATH_INFO: `/v3/users/1a1d51f0294041ae850c7db91f47882c` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:31.730592 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962310e5-50c4-4c3b-81ae-4f6dd064fc46 admin admin] RBAC: Authorizing `identity:get_user(user_id=1a1d51f0294041ae850c7db91f47882c)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:31.733677 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962310e5-50c4-4c3b-81ae-4f6dd064fc46 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:31.735708 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 81/165] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:31 2021] GET /identity/v3/users/1a1d51f0294041ae850c7db91f47882c => generated 275 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:31.741371 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbfc72-0c38-4efd-9766-b47aeb1c3471 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:31.751727 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbfc72-0c38-4efd-9766-b47aeb1c3471 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:31.756060 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4ae73-4716-4617-b635-5769d8b3d60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:31.756689 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4ae73-4716-4617-b635-5769d8b3d60c admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:31.756972 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4ae73-4716-4617-b635-5769d8b3d60c admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:31.757245 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4ae73-4716-4617-b635-5769d8b3d60c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:31.765307 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4ae73-4716-4617-b635-5769d8b3d60c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:31.767176 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4ae73-4716-4617-b635-5769d8b3d60c admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:31.776328 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 85/166] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:15:31 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:15:31.782661 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962310e5-50c4-4c3b-81ae-4f6dd064fc46 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:31.792854 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962310e5-50c4-4c3b-81ae-4f6dd064fc46 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:31.797714 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51900112-5ec5-429e-83c7-9047e68f05b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:31.798548 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51900112-5ec5-429e-83c7-9047e68f05b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:31.798827 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51900112-5ec5-429e-83c7-9047e68f05b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:31.799097 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51900112-5ec5-429e-83c7-9047e68f05b7 admin admin] PATH_INFO: `/v3/projects/aa3804c377fa45e3bbd258b742110f95` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:31.800276 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51900112-5ec5-429e-83c7-9047e68f05b7 admin admin] RBAC: Authorizing `identity:get_project(project_id=aa3804c377fa45e3bbd258b742110f95)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:31.804394 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51900112-5ec5-429e-83c7-9047e68f05b7 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:31.804394 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 82/167] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:31 2021] GET /identity/v3/projects/aa3804c377fa45e3bbd258b742110f95 => generated 312 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:31.811584 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4ae73-4716-4617-b635-5769d8b3d60c admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:31.820736 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4ae73-4716-4617-b635-5769d8b3d60c admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:31.825739 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e4e86-8b22-4f53-a7c5-0295d236d01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:31.826442 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e4e86-8b22-4f53-a7c5-0295d236d01a admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:31.826802 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e4e86-8b22-4f53-a7c5-0295d236d01a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:31.827174 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e4e86-8b22-4f53-a7c5-0295d236d01a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:31.828106 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e4e86-8b22-4f53-a7c5-0295d236d01a admin admin] RBAC: Adding query filter params (role.id=f8b0ca7636ad450b94f68df7bc4497aa, scope.project.id=aa3804c377fa45e3bbd258b742110f95, user.id=1a1d51f0294041ae850c7db91f47882c) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:31.828534 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e4e86-8b22-4f53-a7c5-0295d236d01a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:31.830472 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e4e86-8b22-4f53-a7c5-0295d236d01a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:31.836639 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 86/168] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:15:31 2021] GET /identity/v3/role_assignments?user.id=1a1d51f0294041ae850c7db91f47882c&scope.project.id=aa3804c377fa45e3bbd258b742110f95&role.id=f8b0ca7636ad450b94f68df7bc4497aa => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:32.241858 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff948f-3613-4f44-a325-b9026ea7aa06 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:32.242399 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff948f-3613-4f44-a325-b9026ea7aa06 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:32.242399 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff948f-3613-4f44-a325-b9026ea7aa06 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:32.244187 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 83/169] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:32.251391 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb92d25-f869-442e-b14d-cdf461ed46a9 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:32.251772 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb92d25-f869-442e-b14d-cdf461ed46a9 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:32.251942 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb92d25-f869-442e-b14d-cdf461ed46a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:32.270012 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-1eb92d25-f869-442e-b14d-cdf461ed46a9 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:32.271208 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-1eb92d25-f869-442e-b14d-cdf461ed46a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:32.278754 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 87/170] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:32.303491 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff948f-3613-4f44-a325-b9026ea7aa06 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:32.315990 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff948f-3613-4f44-a325-b9026ea7aa06 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:32.320428 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4084b25-3254-4611-a240-0ff8af961b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:32.321204 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4084b25-3254-4611-a240-0ff8af961b72 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:32.321522 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4084b25-3254-4611-a240-0ff8af961b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:32.321801 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4084b25-3254-4611-a240-0ff8af961b72 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:32.322965 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4084b25-3254-4611-a240-0ff8af961b72 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:32.324701 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4084b25-3254-4611-a240-0ff8af961b72 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:32.327019 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 84/171] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:15:32 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:32.332496 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb92d25-f869-442e-b14d-cdf461ed46a9 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:32.342052 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb92d25-f869-442e-b14d-cdf461ed46a9 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:32.346350 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e27c7a-7f56-4673-ab39-5db2b1726860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:32.346997 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e27c7a-7f56-4673-ab39-5db2b1726860 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:32.347279 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e27c7a-7f56-4673-ab39-5db2b1726860 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:32.347550 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e27c7a-7f56-4673-ab39-5db2b1726860 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:32.348324 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e27c7a-7f56-4673-ab39-5db2b1726860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:32.350327 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e27c7a-7f56-4673-ab39-5db2b1726860 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:32.382335 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7120a40-ca39-4bf7-9341-be2d5cc4dec7 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:32.382622 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7120a40-ca39-4bf7-9341-be2d5cc4dec7 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:32.382900 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7120a40-ca39-4bf7-9341-be2d5cc4dec7 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:32.384666 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 85/172] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 19:15:32.390163 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae90a3-2c44-4a6f-8b05-6a8a823a810e None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:32.390445 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae90a3-2c44-4a6f-8b05-6a8a823a810e None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:32.390718 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae90a3-2c44-4a6f-8b05-6a8a823a810e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:32.408697 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-31ae90a3-2c44-4a6f-8b05-6a8a823a810e None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:32.410024 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-31ae90a3-2c44-4a6f-8b05-6a8a823a810e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:32.417389 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 86/173] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 19:15:32.440404 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae90a3-2c44-4a6f-8b05-6a8a823a810e None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:32.457433 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 88/174] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Nov 23 19:15:32 2021] POST /identity/v3/users => generated 283 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:15:32.457681 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae90a3-2c44-4a6f-8b05-6a8a823a810e None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:32.457681 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba6f18-006f-481e-87b8-7f9cdb394572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:32.457681 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba6f18-006f-481e-87b8-7f9cdb394572 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:32.457681 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba6f18-006f-481e-87b8-7f9cdb394572 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:32.457992 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba6f18-006f-481e-87b8-7f9cdb394572 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:32.468062 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba6f18-006f-481e-87b8-7f9cdb394572 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:32.475498 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-efba6f18-006f-481e-87b8-7f9cdb394572 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 23 19:15:32.476776 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 87/175] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:32 2021] GET /identity/v3/roles/reader => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:15:32.484115 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e27c7a-7f56-4673-ab39-5db2b1726860 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:32.494304 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e27c7a-7f56-4673-ab39-5db2b1726860 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:32.498784 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2925ad2-537c-408c-b797-4b6153c6be41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:32.499464 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2925ad2-537c-408c-b797-4b6153c6be41 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:32.499745 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2925ad2-537c-408c-b797-4b6153c6be41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:32.500018 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2925ad2-537c-408c-b797-4b6153c6be41 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:32.500796 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2925ad2-537c-408c-b797-4b6153c6be41 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:32.501168 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2925ad2-537c-408c-b797-4b6153c6be41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:32.502829 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2925ad2-537c-408c-b797-4b6153c6be41 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:32.512346 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 89/176] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Nov 23 19:15:32 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:32.518812 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba6f18-006f-481e-87b8-7f9cdb394572 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:32.529433 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba6f18-006f-481e-87b8-7f9cdb394572 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:32.533790 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444f074-6a03-40c6-89a7-b734b96ea813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:32.534673 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444f074-6a03-40c6-89a7-b734b96ea813 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:32.534952 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444f074-6a03-40c6-89a7-b734b96ea813 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:32.535222 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444f074-6a03-40c6-89a7-b734b96ea813 admin admin] PATH_INFO: `/v3/users/cfea5bb8b59d4da9821c179a677be7c1` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:32.536457 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444f074-6a03-40c6-89a7-b734b96ea813 admin admin] RBAC: Authorizing `identity:get_user(user_id=cfea5bb8b59d4da9821c179a677be7c1)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:32.538643 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444f074-6a03-40c6-89a7-b734b96ea813 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:32.540319 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 88/177] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:32 2021] GET /identity/v3/users/cfea5bb8b59d4da9821c179a677be7c1 => generated 289 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:32.547118 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2925ad2-537c-408c-b797-4b6153c6be41 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:32.557197 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2925ad2-537c-408c-b797-4b6153c6be41 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:32.561798 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a142d-8f52-4498-95ae-9b19d56a663a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:32.562737 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a142d-8f52-4498-95ae-9b19d56a663a admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:32.563022 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a142d-8f52-4498-95ae-9b19d56a663a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:32.563295 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a142d-8f52-4498-95ae-9b19d56a663a admin admin] PATH_INFO: `/v3/projects/febc4f33fba1433992fc8e043a47dd5c` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:32.564525 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a142d-8f52-4498-95ae-9b19d56a663a admin admin] RBAC: Authorizing `identity:get_project(project_id=febc4f33fba1433992fc8e043a47dd5c)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:32.566642 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a142d-8f52-4498-95ae-9b19d56a663a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:32.568399 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 90/178] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:32 2021] GET /identity/v3/projects/febc4f33fba1433992fc8e043a47dd5c => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:32.575115 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444f074-6a03-40c6-89a7-b734b96ea813 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:32.585548 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444f074-6a03-40c6-89a7-b734b96ea813 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:32.589840 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a79324-6da2-47ab-9eef-4b96c84fb605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:32.591278 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a79324-6da2-47ab-9eef-4b96c84fb605 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:32.591556 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a79324-6da2-47ab-9eef-4b96c84fb605 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:32.591829 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a79324-6da2-47ab-9eef-4b96c84fb605 admin admin] PATH_INFO: `/v3/projects/febc4f33fba1433992fc8e043a47dd5c/users/cfea5bb8b59d4da9821c179a677be7c1/roles/52f47babce8e4dd7ae9b425160368b17` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:32.593877 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a79324-6da2-47ab-9eef-4b96c84fb605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=febc4f33fba1433992fc8e043a47dd5c, user_id=cfea5bb8b59d4da9821c179a677be7c1, role_id=52f47babce8e4dd7ae9b425160368b17)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:32.596530 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a79324-6da2-47ab-9eef-4b96c84fb605 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:32.663063 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 89/179] 10.222.0.62 () {58 vars in 1460 bytes} [Tue Nov 23 19:15:32 2021] PUT /identity/v3/projects/febc4f33fba1433992fc8e043a47dd5c/users/cfea5bb8b59d4da9821c179a677be7c1/roles/52f47babce8e4dd7ae9b425160368b17 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:15:35.184993 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef4958-0c4a-4174-be45-981e9953b132 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:35.185601 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef4958-0c4a-4174-be45-981e9953b132 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:35.185601 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef4958-0c4a-4174-be45-981e9953b132 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:35.187490 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 91/180] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:35.193825 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120fc776-bdde-40bf-b9d7-6f88a6d032a7 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:35.194300 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120fc776-bdde-40bf-b9d7-6f88a6d032a7 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:35.194369 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120fc776-bdde-40bf-b9d7-6f88a6d032a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:35.222433 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-120fc776-bdde-40bf-b9d7-6f88a6d032a7 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:35.223630 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-120fc776-bdde-40bf-b9d7-6f88a6d032a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:35.365618 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7dd27-8acf-4591-903c-46908df2b355 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:35.365953 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7dd27-8acf-4591-903c-46908df2b355 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:35.366178 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7dd27-8acf-4591-903c-46908df2b355 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:35.367957 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 92/181] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 19:15:35.374435 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036d106-3a0e-4993-b10d-71435572e7cb None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:35.374725 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036d106-3a0e-4993-b10d-71435572e7cb None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:35.375008 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036d106-3a0e-4993-b10d-71435572e7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:35.394732 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-f036d106-3a0e-4993-b10d-71435572e7cb None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:35.395972 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-f036d106-3a0e-4993-b10d-71435572e7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:35.427069 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 90/182] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:35.456195 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120fc776-bdde-40bf-b9d7-6f88a6d032a7 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:35.468394 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120fc776-bdde-40bf-b9d7-6f88a6d032a7 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:35.477802 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c364cb-52d3-4fc6-baae-183632429265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:35.478632 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c364cb-52d3-4fc6-baae-183632429265 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:35.478909 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c364cb-52d3-4fc6-baae-183632429265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:35.479179 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c364cb-52d3-4fc6-baae-183632429265 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:35.503101 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c364cb-52d3-4fc6-baae-183632429265 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:35.511380 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 93/183] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 19:15:35.512392 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-69c364cb-52d3-4fc6-baae-183632429265 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 19:15:35.516379 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 91/184] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:35 2021] GET /identity/v3/roles/member => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:15:35.519175 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6990618-c496-4181-83e0-ad8226b471c9 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:35.519468 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6990618-c496-4181-83e0-ad8226b471c9 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:35.519749 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6990618-c496-4181-83e0-ad8226b471c9 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:35.521927 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 94/185] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:35.522862 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c364cb-52d3-4fc6-baae-183632429265 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:35.534825 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f7f26-c03e-4f45-866b-8a515f2c5bc3 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:35.535114 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f7f26-c03e-4f45-866b-8a515f2c5bc3 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:35.535391 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f7f26-c03e-4f45-866b-8a515f2c5bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:35.538756 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c364cb-52d3-4fc6-baae-183632429265 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:35.545633 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85599a-1ca9-4c75-beaf-b2acf5ff3ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:35.546450 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85599a-1ca9-4c75-beaf-b2acf5ff3ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:35.548276 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85599a-1ca9-4c75-beaf-b2acf5ff3ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:35.548547 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85599a-1ca9-4c75-beaf-b2acf5ff3ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:35.549304 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85599a-1ca9-4c75-beaf-b2acf5ff3ca7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:35.549636 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85599a-1ca9-4c75-beaf-b2acf5ff3ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:35.551238 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85599a-1ca9-4c75-beaf-b2acf5ff3ca7 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:35.564838 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-842f7f26-c03e-4f45-866b-8a515f2c5bc3 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:35.566168 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-842f7f26-c03e-4f45-866b-8a515f2c5bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:35.566639 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 92/186] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Nov 23 19:15:35 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:35.567724 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85599a-1ca9-4c75-beaf-b2acf5ff3ca7 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:35.576605 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 95/187] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:35.576605 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f7f26-c03e-4f45-866b-8a515f2c5bc3 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:35.582131 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85599a-1ca9-4c75-beaf-b2acf5ff3ca7 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:35.589356 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f7f26-c03e-4f45-866b-8a515f2c5bc3 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:35.592645 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728c094-7b87-415b-b8c6-70f71569865c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:35.593453 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728c094-7b87-415b-b8c6-70f71569865c admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:35.593743 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728c094-7b87-415b-b8c6-70f71569865c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:35.594016 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728c094-7b87-415b-b8c6-70f71569865c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:35.602898 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f847ee3-dfd1-4e2e-8bfc-97b5e7b13e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:35.603862 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f847ee3-dfd1-4e2e-8bfc-97b5e7b13e0d admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:35.604146 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f847ee3-dfd1-4e2e-8bfc-97b5e7b13e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:35.605213 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f847ee3-dfd1-4e2e-8bfc-97b5e7b13e0d admin admin] PATH_INFO: `/v3/users/c39507aad31a4f43b3861f10c1a8616f` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:35.610623 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b728c094-7b87-415b-b8c6-70f71569865c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:35.617850 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-b728c094-7b87-415b-b8c6-70f71569865c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 19:15:35.619244 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 93/188] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:15:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:15:35.620192 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728c094-7b87-415b-b8c6-70f71569865c admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:35.620295 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f847ee3-dfd1-4e2e-8bfc-97b5e7b13e0d admin admin] RBAC: Authorizing `identity:get_user(user_id=c39507aad31a4f43b3861f10c1a8616f)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:35.623192 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f847ee3-dfd1-4e2e-8bfc-97b5e7b13e0d admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:35.629480 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 96/189] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:35 2021] GET /identity/v3/users/c39507aad31a4f43b3861f10c1a8616f => generated 283 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:35.631511 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f847ee3-dfd1-4e2e-8bfc-97b5e7b13e0d admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:35.640081 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728c094-7b87-415b-b8c6-70f71569865c admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:35.644141 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f847ee3-dfd1-4e2e-8bfc-97b5e7b13e0d admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:35.644859 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9e480-e0b2-427f-b5b1-4cae4e83afc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:35.645803 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9e480-e0b2-427f-b5b1-4cae4e83afc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:35.646088 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9e480-e0b2-427f-b5b1-4cae4e83afc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:35.646361 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9e480-e0b2-427f-b5b1-4cae4e83afc7 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:35.648643 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45474a-7910-4dcd-832d-86df089bd577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:35.649301 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45474a-7910-4dcd-832d-86df089bd577 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:35.649611 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45474a-7910-4dcd-832d-86df089bd577 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:35.649891 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45474a-7910-4dcd-832d-86df089bd577 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:35.650654 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45474a-7910-4dcd-832d-86df089bd577 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:35.650961 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45474a-7910-4dcd-832d-86df089bd577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:35.652569 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45474a-7910-4dcd-832d-86df089bd577 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:35.657859 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9e480-e0b2-427f-b5b1-4cae4e83afc7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:35.662900 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 97/190] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:35.665370 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-59c9e480-e0b2-427f-b5b1-4cae4e83afc7 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 23 19:15:35.666274 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45474a-7910-4dcd-832d-86df089bd577 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:35.666653 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 94/191] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:35 2021] GET /identity/v3/roles/reader => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:15:35.672890 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65fdfe-ac2d-4efe-aff1-da2c5dad7f46 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:35.672890 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65fdfe-ac2d-4efe-aff1-da2c5dad7f46 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:35.672890 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65fdfe-ac2d-4efe-aff1-da2c5dad7f46 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:35.672890 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 95/192] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:35.672890 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65fdfe-ac2d-4efe-aff1-da2c5dad7f46 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:35.682858 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45474a-7910-4dcd-832d-86df089bd577 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:35.687727 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65fdfe-ac2d-4efe-aff1-da2c5dad7f46 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:35.687912 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0be0f-276d-4e42-b764-df909a83effe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:35.688425 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0be0f-276d-4e42-b764-df909a83effe admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:35.688708 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0be0f-276d-4e42-b764-df909a83effe admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:35.688983 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0be0f-276d-4e42-b764-df909a83effe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:35.692130 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5cd54-5c31-496d-81aa-60cedeb3b064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:35.693005 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5cd54-5c31-496d-81aa-60cedeb3b064 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:35.693279 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5cd54-5c31-496d-81aa-60cedeb3b064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:35.693597 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5cd54-5c31-496d-81aa-60cedeb3b064 admin admin] PATH_INFO: `/v3/users/c39507aad31a4f43b3861f10c1a8616f` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:35.695097 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe5cd54-5c31-496d-81aa-60cedeb3b064 admin admin] RBAC: Authorizing `identity:get_user(user_id=c39507aad31a4f43b3861f10c1a8616f)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:35.697212 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe5cd54-5c31-496d-81aa-60cedeb3b064 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:35.697845 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0be0f-276d-4e42-b764-df909a83effe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:35.698920 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 96/193] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:35 2021] GET /identity/v3/users/c39507aad31a4f43b3861f10c1a8616f => generated 283 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:35.699675 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5cd54-5c31-496d-81aa-60cedeb3b064 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:35.705873 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0be0f-276d-4e42-b764-df909a83effe admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:35.709785 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5cd54-5c31-496d-81aa-60cedeb3b064 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:35.714181 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97a0df-6cdb-4064-82d6-4a24cc581301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:35.714834 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97a0df-6cdb-4064-82d6-4a24cc581301 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:35.715113 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97a0df-6cdb-4064-82d6-4a24cc581301 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:35.715989 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97a0df-6cdb-4064-82d6-4a24cc581301 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:35.716704 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 98/194] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:15:35 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:15:35.716804 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97a0df-6cdb-4064-82d6-4a24cc581301 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:35.717037 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97a0df-6cdb-4064-82d6-4a24cc581301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:35.718122 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8313530-40c7-4d6d-a4c1-7f0234f9a669 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:35.718417 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8313530-40c7-4d6d-a4c1-7f0234f9a669 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:35.718645 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97a0df-6cdb-4064-82d6-4a24cc581301 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:35.718734 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8313530-40c7-4d6d-a4c1-7f0234f9a669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:35.727515 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 97/195] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Nov 23 19:15:35 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:35.729376 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97a0df-6cdb-4064-82d6-4a24cc581301 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:35.736973 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-e8313530-40c7-4d6d-a4c1-7f0234f9a669 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:35.738205 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-e8313530-40c7-4d6d-a4c1-7f0234f9a669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:35.740400 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97a0df-6cdb-4064-82d6-4a24cc581301 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:35.744697 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33530e64-e746-4fad-b0f3-2a44b06a1c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:35.745322 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33530e64-e746-4fad-b0f3-2a44b06a1c65 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:35.745669 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 99/196] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:35.746438 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8313530-40c7-4d6d-a4c1-7f0234f9a669 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:35.753587 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33530e64-e746-4fad-b0f3-2a44b06a1c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:35.753812 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33530e64-e746-4fad-b0f3-2a44b06a1c65 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:35.759789 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8313530-40c7-4d6d-a4c1-7f0234f9a669 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:35.764464 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33530e64-e746-4fad-b0f3-2a44b06a1c65 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:35.766117 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcd7ba-3caa-403a-880c-57646e015adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:35.766237 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33530e64-e746-4fad-b0f3-2a44b06a1c65 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:35.767287 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcd7ba-3caa-403a-880c-57646e015adf admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:35.767776 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcd7ba-3caa-403a-880c-57646e015adf admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:35.768236 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcd7ba-3caa-403a-880c-57646e015adf admin admin] PATH_INFO: `/v3/projects/d57902468b3746628ca506df9bca7068` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:35.769643 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dcd7ba-3caa-403a-880c-57646e015adf admin admin] RBAC: Authorizing `identity:get_project(project_id=d57902468b3746628ca506df9bca7068)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:35.771655 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dcd7ba-3caa-403a-880c-57646e015adf admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:35.773565 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 100/197] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:35 2021] GET /identity/v3/projects/d57902468b3746628ca506df9bca7068 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:35.774112 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcd7ba-3caa-403a-880c-57646e015adf admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:35.775286 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 98/198] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:15:35 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:15:35.781458 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33530e64-e746-4fad-b0f3-2a44b06a1c65 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:35.788842 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcd7ba-3caa-403a-880c-57646e015adf admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:35.792218 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33530e64-e746-4fad-b0f3-2a44b06a1c65 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:35.793723 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640e5bb-32fb-4fc3-ae09-e17e08346ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:35.794714 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640e5bb-32fb-4fc3-ae09-e17e08346ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:35.794992 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640e5bb-32fb-4fc3-ae09-e17e08346ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:35.795265 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640e5bb-32fb-4fc3-ae09-e17e08346ca5 admin admin] PATH_INFO: `/v3/users/cfea5bb8b59d4da9821c179a677be7c1` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:35.796470 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640e5bb-32fb-4fc3-ae09-e17e08346ca5 admin admin] RBAC: Authorizing `identity:get_user(user_id=cfea5bb8b59d4da9821c179a677be7c1)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:35.797714 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d52e6-b0ba-4495-b9fd-2b8810b6c4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:35.798602 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640e5bb-32fb-4fc3-ae09-e17e08346ca5 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:35.798951 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d52e6-b0ba-4495-b9fd-2b8810b6c4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:35.799429 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d52e6-b0ba-4495-b9fd-2b8810b6c4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:35.799898 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d52e6-b0ba-4495-b9fd-2b8810b6c4a7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:35.800199 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 101/199] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:35 2021] GET /identity/v3/users/cfea5bb8b59d4da9821c179a677be7c1 => generated 289 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:35.800950 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640e5bb-32fb-4fc3-ae09-e17e08346ca5 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:35.812015 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d52e6-b0ba-4495-b9fd-2b8810b6c4a7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:35.814830 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640e5bb-32fb-4fc3-ae09-e17e08346ca5 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:35.819165 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedb97b-d96d-40d9-958f-5a867bc1a5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:35.819412 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-528d52e6-b0ba-4495-b9fd-2b8810b6c4a7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 19:15:35.820069 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedb97b-d96d-40d9-958f-5a867bc1a5f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:35.820349 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedb97b-d96d-40d9-958f-5a867bc1a5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:35.820622 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedb97b-d96d-40d9-958f-5a867bc1a5f1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:35.821116 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 99/200] 10.222.0.62 () {56 vars in 1135 bytes} [Tue Nov 23 19:15:35 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:15:35.821928 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d52e6-b0ba-4495-b9fd-2b8810b6c4a7 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:35.826111 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fedb97b-d96d-40d9-958f-5a867bc1a5f1 admin admin] RBAC: Adding query filter params (role.id=f8b0ca7636ad450b94f68df7bc4497aa, scope.project.id=d57902468b3746628ca506df9bca7068, user.id=c39507aad31a4f43b3861f10c1a8616f) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:35.826798 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fedb97b-d96d-40d9-958f-5a867bc1a5f1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:35.828652 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fedb97b-d96d-40d9-958f-5a867bc1a5f1 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:35.834582 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 102/201] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:15:35 2021] GET /identity/v3/role_assignments?user.id=c39507aad31a4f43b3861f10c1a8616f&scope.project.id=d57902468b3746628ca506df9bca7068&role.id=f8b0ca7636ad450b94f68df7bc4497aa => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:35.834801 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d52e6-b0ba-4495-b9fd-2b8810b6c4a7 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:35.839072 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38227a2c-6aaf-48ec-9429-1cef6ce71547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:35.839936 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38227a2c-6aaf-48ec-9429-1cef6ce71547 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:35.840215 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38227a2c-6aaf-48ec-9429-1cef6ce71547 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:35.840579 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38227a2c-6aaf-48ec-9429-1cef6ce71547 admin admin] PATH_INFO: `/v3/projects/d57902468b3746628ca506df9bca7068` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:35.841999 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38227a2c-6aaf-48ec-9429-1cef6ce71547 admin admin] RBAC: Authorizing `identity:get_project(project_id=d57902468b3746628ca506df9bca7068)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:35.842847 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedb97b-d96d-40d9-958f-5a867bc1a5f1 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:35.844072 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38227a2c-6aaf-48ec-9429-1cef6ce71547 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:35.845905 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 100/202] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:35 2021] GET /identity/v3/projects/d57902468b3746628ca506df9bca7068 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:35.846684 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38227a2c-6aaf-48ec-9429-1cef6ce71547 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:35.854109 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedb97b-d96d-40d9-958f-5a867bc1a5f1 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:35.857340 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38227a2c-6aaf-48ec-9429-1cef6ce71547 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:35.859926 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abdd504-ca5d-47b0-9819-f06405260c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:35.860600 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdd504-ca5d-47b0-9819-f06405260c2a admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:35.860882 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdd504-ca5d-47b0-9819-f06405260c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:35.861152 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdd504-ca5d-47b0-9819-f06405260c2a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:35.862283 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef4e1c-bc46-47d9-9573-f629f3b41a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:35.862953 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef4e1c-bc46-47d9-9573-f629f3b41a22 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:35.863232 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef4e1c-bc46-47d9-9573-f629f3b41a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:35.863504 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef4e1c-bc46-47d9-9573-f629f3b41a22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:35.864270 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef4e1c-bc46-47d9-9573-f629f3b41a22 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:35.864573 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef4e1c-bc46-47d9-9573-f629f3b41a22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:35.866288 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef4e1c-bc46-47d9-9573-f629f3b41a22 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:35.869885 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abdd504-ca5d-47b0-9819-f06405260c2a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:35.871710 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abdd504-ca5d-47b0-9819-f06405260c2a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:35.875384 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 101/203] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:15:35 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:35.876247 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef4e1c-bc46-47d9-9573-f629f3b41a22 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:35.884923 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 103/204] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:15:35 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:15:35.886690 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d0c7c-339e-4237-9a86-47f607daba7b None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:35.886988 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d0c7c-339e-4237-9a86-47f607daba7b None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:35.887830 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d0c7c-339e-4237-9a86-47f607daba7b None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:35.889697 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 104/205] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:35.890893 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef4e1c-bc46-47d9-9573-f629f3b41a22 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:35.894477 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d0c7c-339e-4237-9a86-47f607daba7b None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:35.895498 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa66e25-160e-42fe-8582-7c01b555b1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:35.896170 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa66e25-160e-42fe-8582-7c01b555b1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:35.896448 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa66e25-160e-42fe-8582-7c01b555b1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:35.896722 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa66e25-160e-42fe-8582-7c01b555b1a1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:35.897625 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa66e25-160e-42fe-8582-7c01b555b1a1 admin admin] RBAC: Adding query filter params (role.id=6d9a8878ffeb49fea19d854657c6b767, scope.project.id=d57902468b3746628ca506df9bca7068, user.id=c39507aad31a4f43b3861f10c1a8616f) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:35.897939 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa66e25-160e-42fe-8582-7c01b555b1a1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:35.900782 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa66e25-160e-42fe-8582-7c01b555b1a1 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:35.906832 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 102/206] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:15:35 2021] GET /identity/v3/role_assignments?user.id=c39507aad31a4f43b3861f10c1a8616f&scope.project.id=d57902468b3746628ca506df9bca7068&role.id=6d9a8878ffeb49fea19d854657c6b767 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:35.907679 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa66e25-160e-42fe-8582-7c01b555b1a1 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:35.907805 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d0c7c-339e-4237-9a86-47f607daba7b None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:35.912012 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9ffd5-7359-491e-aaf4-772b9a80fb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:35.912899 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9ffd5-7359-491e-aaf4-772b9a80fb9f admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:35.913182 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9ffd5-7359-491e-aaf4-772b9a80fb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:35.913481 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9ffd5-7359-491e-aaf4-772b9a80fb9f admin admin] PATH_INFO: `/v3/users/c39507aad31a4f43b3861f10c1a8616f` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:35.914753 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9ffd5-7359-491e-aaf4-772b9a80fb9f admin admin] RBAC: Authorizing `identity:get_user(user_id=c39507aad31a4f43b3861f10c1a8616f)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:35.916888 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9ffd5-7359-491e-aaf4-772b9a80fb9f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:35.917661 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa66e25-160e-42fe-8582-7c01b555b1a1 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:35.919390 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 105/207] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:35 2021] GET /identity/v3/users/c39507aad31a4f43b3861f10c1a8616f => generated 283 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:35.920495 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419fedb-1801-4a0f-b7fe-7a1ddeacffca None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:35.920781 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419fedb-1801-4a0f-b7fe-7a1ddeacffca None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:35.921051 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419fedb-1801-4a0f-b7fe-7a1ddeacffca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:35.928279 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe5b5e-8999-40dc-bb50-114cf9bb283f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:35.929166 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe5b5e-8999-40dc-bb50-114cf9bb283f admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:35.934267 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe5b5e-8999-40dc-bb50-114cf9bb283f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:35.934267 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe5b5e-8999-40dc-bb50-114cf9bb283f admin admin] PATH_INFO: `/v3/projects/febc4f33fba1433992fc8e043a47dd5c` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:35.935982 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe5b5e-8999-40dc-bb50-114cf9bb283f admin admin] RBAC: Authorizing `identity:get_project(project_id=febc4f33fba1433992fc8e043a47dd5c)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:35.938576 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe5b5e-8999-40dc-bb50-114cf9bb283f admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:35.940014 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-c419fedb-1801-4a0f-b7fe-7a1ddeacffca None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:35.940903 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 103/208] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:35 2021] GET /identity/v3/projects/febc4f33fba1433992fc8e043a47dd5c => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:35.942030 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe5b5e-8999-40dc-bb50-114cf9bb283f admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:35.943194 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-c419fedb-1801-4a0f-b7fe-7a1ddeacffca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:35.957340 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe5b5e-8999-40dc-bb50-114cf9bb283f admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:35.963218 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 106/209] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:35.963994 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419fedb-1801-4a0f-b7fe-7a1ddeacffca None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:35.966301 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ac1ee-f6a1-4a72-b235-b1a581588695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:35.967532 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ac1ee-f6a1-4a72-b235-b1a581588695 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:35.968043 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ac1ee-f6a1-4a72-b235-b1a581588695 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:35.968591 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ac1ee-f6a1-4a72-b235-b1a581588695 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:35.974612 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419fedb-1801-4a0f-b7fe-7a1ddeacffca None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:35.979316 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ac1ee-f6a1-4a72-b235-b1a581588695 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:35.979704 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf01e3-9b1b-486a-8988-8e688089806f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:35.980391 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf01e3-9b1b-486a-8988-8e688089806f admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:35.980668 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf01e3-9b1b-486a-8988-8e688089806f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:35.980944 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf01e3-9b1b-486a-8988-8e688089806f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:35.982214 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf01e3-9b1b-486a-8988-8e688089806f admin admin] RBAC: Adding query filter params (role.id=52f47babce8e4dd7ae9b425160368b17, scope.project.id=febc4f33fba1433992fc8e043a47dd5c, user.id=cfea5bb8b59d4da9821c179a677be7c1) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:35.982533 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf01e3-9b1b-486a-8988-8e688089806f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:35.983244 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ac1ee-f6a1-4a72-b235-b1a581588695 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:35.984643 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf01e3-9b1b-486a-8988-8e688089806f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:35.994844 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 107/210] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:15:35 2021] GET /identity/v3/role_assignments?user.id=cfea5bb8b59d4da9821c179a677be7c1&scope.project.id=febc4f33fba1433992fc8e043a47dd5c&role.id=52f47babce8e4dd7ae9b425160368b17 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:35.994991 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 104/211] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:15:35 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:15:36.005617 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf01e3-9b1b-486a-8988-8e688089806f admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:36.007040 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ac1ee-f6a1-4a72-b235-b1a581588695 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:36.018336 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ac1ee-f6a1-4a72-b235-b1a581588695 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:36.024332 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475164cc-2ab5-4925-a76e-ed41087d1201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:36.025179 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475164cc-2ab5-4925-a76e-ed41087d1201 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:36.025554 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475164cc-2ab5-4925-a76e-ed41087d1201 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:36.025836 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475164cc-2ab5-4925-a76e-ed41087d1201 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:36.027424 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475164cc-2ab5-4925-a76e-ed41087d1201 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:36.030340 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475164cc-2ab5-4925-a76e-ed41087d1201 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:36.032327 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 105/212] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:15:36 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:36.035785 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf01e3-9b1b-486a-8988-8e688089806f admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:36.038811 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475164cc-2ab5-4925-a76e-ed41087d1201 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:36.050976 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475164cc-2ab5-4925-a76e-ed41087d1201 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:36.056077 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b4b35-90a6-44fa-9747-a441327ede0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:36.056834 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b4b35-90a6-44fa-9747-a441327ede0b admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:36.057123 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b4b35-90a6-44fa-9747-a441327ede0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:36.057430 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b4b35-90a6-44fa-9747-a441327ede0b admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:36.058189 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9ce97-3ad0-4aae-bbaa-77499ca699a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:36.058341 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b4b35-90a6-44fa-9747-a441327ede0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:36.059086 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9ce97-3ad0-4aae-bbaa-77499ca699a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:36.059911 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9ce97-3ad0-4aae-bbaa-77499ca699a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:36.060189 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9ce97-3ad0-4aae-bbaa-77499ca699a8 admin admin] PATH_INFO: `/v3/projects/d57902468b3746628ca506df9bca7068` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:36.060984 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b4b35-90a6-44fa-9747-a441327ede0b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:36.066477 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9ce97-3ad0-4aae-bbaa-77499ca699a8 admin admin] RBAC: Authorizing `identity:get_project(project_id=d57902468b3746628ca506df9bca7068)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:36.068576 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9ce97-3ad0-4aae-bbaa-77499ca699a8 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:36.070721 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 108/213] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:36 2021] GET /identity/v3/projects/d57902468b3746628ca506df9bca7068 => generated 302 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:36.078083 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9ce97-3ad0-4aae-bbaa-77499ca699a8 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:36.093567 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9ce97-3ad0-4aae-bbaa-77499ca699a8 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:36.098910 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ea177-9453-44f1-98b6-b6d438ad1137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:36.099727 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ea177-9453-44f1-98b6-b6d438ad1137 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:36.100068 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ea177-9453-44f1-98b6-b6d438ad1137 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:36.100355 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ea177-9453-44f1-98b6-b6d438ad1137 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:36.101334 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ea177-9453-44f1-98b6-b6d438ad1137 admin admin] RBAC: Adding query filter params (role.id=bc8a8682d8f748788fb70d235f9978dc, scope.project.id=d57902468b3746628ca506df9bca7068, user.id=c39507aad31a4f43b3861f10c1a8616f) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:36.101712 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ea177-9453-44f1-98b6-b6d438ad1137 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:36.103917 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ea177-9453-44f1-98b6-b6d438ad1137 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:36.111350 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 109/214] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:15:36 2021] GET /identity/v3/role_assignments?user.id=c39507aad31a4f43b3861f10c1a8616f&scope.project.id=d57902468b3746628ca506df9bca7068&role.id=bc8a8682d8f748788fb70d235f9978dc => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:36.174622 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 106/215] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Nov 23 19:15:36 2021] POST /identity/v3/users => generated 297 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:15:38.493295 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f6bcc-433f-4871-8eb3-49d21c0b538f None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:38.494417 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f6bcc-433f-4871-8eb3-49d21c0b538f None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:38.494909 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f6bcc-433f-4871-8eb3-49d21c0b538f None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:38.498016 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 110/216] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:38 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:38.503833 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8941560-96c2-4756-b0d8-f8fa3d5a22a6 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:38.504672 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8941560-96c2-4756-b0d8-f8fa3d5a22a6 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:38.505176 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8941560-96c2-4756-b0d8-f8fa3d5a22a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:38.529501 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-c8941560-96c2-4756-b0d8-f8fa3d5a22a6 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:38.531017 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-c8941560-96c2-4756-b0d8-f8fa3d5a22a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:38.543845 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 107/217] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:38.568115 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f6bcc-433f-4871-8eb3-49d21c0b538f None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:38.586075 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f6bcc-433f-4871-8eb3-49d21c0b538f None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:38.591672 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462e97a-74ab-4447-87b5-d95b24338d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:38.592793 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462e97a-74ab-4447-87b5-d95b24338d97 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:38.593323 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462e97a-74ab-4447-87b5-d95b24338d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:38.593846 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462e97a-74ab-4447-87b5-d95b24338d97 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:38.615714 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2462e97a-74ab-4447-87b5-d95b24338d97 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:38.623495 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-2462e97a-74ab-4447-87b5-d95b24338d97 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 19:15:38.625109 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 111/218] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:38 2021] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:15:38.631660 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8941560-96c2-4756-b0d8-f8fa3d5a22a6 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:38.642394 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8941560-96c2-4756-b0d8-f8fa3d5a22a6 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:38.647269 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805e764-1b7a-49c5-853f-959f9f6704df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:38.648227 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805e764-1b7a-49c5-853f-959f9f6704df admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:38.648735 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805e764-1b7a-49c5-853f-959f9f6704df admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:38.649221 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805e764-1b7a-49c5-853f-959f9f6704df admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:38.650208 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9805e764-1b7a-49c5-853f-959f9f6704df admin admin] RBAC: Adding query filter params (name=member) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:38.650723 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9805e764-1b7a-49c5-853f-959f9f6704df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:38.652494 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9805e764-1b7a-49c5-853f-959f9f6704df admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:38.665092 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 108/219] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Nov 23 19:15:38 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:38.672191 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462e97a-74ab-4447-87b5-d95b24338d97 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:38.682864 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462e97a-74ab-4447-87b5-d95b24338d97 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:38.693183 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658833b-13b6-4e06-9e92-664648dca60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:38.694483 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658833b-13b6-4e06-9e92-664648dca60a admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:38.695252 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658833b-13b6-4e06-9e92-664648dca60a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:38.695739 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658833b-13b6-4e06-9e92-664648dca60a admin admin] PATH_INFO: `/v3/users/c39507aad31a4f43b3861f10c1a8616f` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:38.697186 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658833b-13b6-4e06-9e92-664648dca60a admin admin] RBAC: Authorizing `identity:get_user(user_id=c39507aad31a4f43b3861f10c1a8616f)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:38.699495 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658833b-13b6-4e06-9e92-664648dca60a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:38.701769 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 112/220] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:38 2021] GET /identity/v3/users/c39507aad31a4f43b3861f10c1a8616f => generated 283 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:38.707484 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805e764-1b7a-49c5-853f-959f9f6704df admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:38.719179 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805e764-1b7a-49c5-853f-959f9f6704df admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:38.726895 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e8b92-f211-47a5-ae94-e47b748275a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:38.728021 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e8b92-f211-47a5-ae94-e47b748275a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:38.728502 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e8b92-f211-47a5-ae94-e47b748275a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:38.728971 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e8b92-f211-47a5-ae94-e47b748275a4 admin admin] PATH_INFO: `/v3/projects/d57902468b3746628ca506df9bca7068` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:38.730514 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e8b92-f211-47a5-ae94-e47b748275a4 admin admin] RBAC: Authorizing `identity:get_project(project_id=d57902468b3746628ca506df9bca7068)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:38.733334 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e8b92-f211-47a5-ae94-e47b748275a4 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:38.736486 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be338974-9b0f-4039-8e88-f54f0ffd739b None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:38.736998 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be338974-9b0f-4039-8e88-f54f0ffd739b None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:38.737517 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be338974-9b0f-4039-8e88-f54f0ffd739b None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:38.737843 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 109/221] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:38 2021] GET /identity/v3/projects/d57902468b3746628ca506df9bca7068 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:38.739710 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 113/222] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:38.744055 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e8b92-f211-47a5-ae94-e47b748275a4 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:38.745446 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f1e77-803b-4a97-97d2-7784bc96fb2a None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:38.745746 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f1e77-803b-4a97-97d2-7784bc96fb2a None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:38.746031 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f1e77-803b-4a97-97d2-7784bc96fb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:38.757802 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e8b92-f211-47a5-ae94-e47b748275a4 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:38.769030 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647b310-a0b4-416f-a0c2-dfa7553a7a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:38.769955 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647b310-a0b4-416f-a0c2-dfa7553a7a2d admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:38.770237 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647b310-a0b4-416f-a0c2-dfa7553a7a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:38.770514 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647b310-a0b4-416f-a0c2-dfa7553a7a2d admin admin] PATH_INFO: `/v3/projects/d57902468b3746628ca506df9bca7068/users/c39507aad31a4f43b3861f10c1a8616f/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:38.775411 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-ce4f1e77-803b-4a97-97d2-7784bc96fb2a None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:38.776602 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-ce4f1e77-803b-4a97-97d2-7784bc96fb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:38.778207 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647b310-a0b4-416f-a0c2-dfa7553a7a2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d57902468b3746628ca506df9bca7068, user_id=c39507aad31a4f43b3861f10c1a8616f, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:38.780892 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647b310-a0b4-416f-a0c2-dfa7553a7a2d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:38.794249 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 114/223] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:38.796581 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd77fcd-e173-411a-a142-c3d6697d8c39 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:38.796581 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd77fcd-e173-411a-a142-c3d6697d8c39 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:38.796581 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd77fcd-e173-411a-a142-c3d6697d8c39 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:38.798013 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 115/224] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:38.810032 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336eaadc-b0db-427a-ad10-2248f312022d None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:38.810032 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336eaadc-b0db-427a-ad10-2248f312022d None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:38.810032 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336eaadc-b0db-427a-ad10-2248f312022d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:38.827569 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-336eaadc-b0db-427a-ad10-2248f312022d None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:38.828753 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-336eaadc-b0db-427a-ad10-2248f312022d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:38.836425 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 116/225] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:38.837199 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336eaadc-b0db-427a-ad10-2248f312022d None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:38.847934 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336eaadc-b0db-427a-ad10-2248f312022d None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:38.852556 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d0925-41a2-4148-b9d4-15e33ef90318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:38.853593 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d0925-41a2-4148-b9d4-15e33ef90318 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:38.854098 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d0925-41a2-4148-b9d4-15e33ef90318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:38.854627 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d0925-41a2-4148-b9d4-15e33ef90318 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:38.866469 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d0925-41a2-4148-b9d4-15e33ef90318 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:38.874273 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-7d1d0925-41a2-4148-b9d4-15e33ef90318 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 19:15:38.875744 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 117/226] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:15:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:15:38.876336 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d0925-41a2-4148-b9d4-15e33ef90318 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:38.887799 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d0925-41a2-4148-b9d4-15e33ef90318 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:38.890915 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 110/227] 10.222.0.62 () {58 vars in 1460 bytes} [Tue Nov 23 19:15:38 2021] PUT /identity/v3/projects/d57902468b3746628ca506df9bca7068/users/c39507aad31a4f43b3861f10c1a8616f/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:15:38.892821 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647b310-a0b4-416f-a0c2-dfa7553a7a2d admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:38.948030 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d87f35-ab8f-46f0-93f7-30810a33bc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:38.948518 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d87f35-ab8f-46f0-93f7-30810a33bc69 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:38.948798 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d87f35-ab8f-46f0-93f7-30810a33bc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:38.949067 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d87f35-ab8f-46f0-93f7-30810a33bc69 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:38.960843 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d87f35-ab8f-46f0-93f7-30810a33bc69 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:38.968725 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-e7d87f35-ab8f-46f0-93f7-30810a33bc69 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 19:15:38.970167 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 118/228] 10.222.0.62 () {56 vars in 1135 bytes} [Tue Nov 23 19:15:38 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:15:38.972802 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647b310-a0b4-416f-a0c2-dfa7553a7a2d admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:38.976765 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d87f35-ab8f-46f0-93f7-30810a33bc69 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:38.978468 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700a919-1d18-432e-9ab4-2aa7aaa642eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:38.979385 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700a919-1d18-432e-9ab4-2aa7aaa642eb admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:38.979882 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700a919-1d18-432e-9ab4-2aa7aaa642eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:38.980415 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700a919-1d18-432e-9ab4-2aa7aaa642eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:38.981999 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700a919-1d18-432e-9ab4-2aa7aaa642eb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:38.982745 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700a919-1d18-432e-9ab4-2aa7aaa642eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:38.985673 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700a919-1d18-432e-9ab4-2aa7aaa642eb admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:38.990636 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d87f35-ab8f-46f0-93f7-30810a33bc69 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:38.992031 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca0853-77cc-4a20-97f2-23a5e5525bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:38.993067 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca0853-77cc-4a20-97f2-23a5e5525bce admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:38.993067 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca0853-77cc-4a20-97f2-23a5e5525bce admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:38.993257 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca0853-77cc-4a20-97f2-23a5e5525bce admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:38.994034 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca0853-77cc-4a20-97f2-23a5e5525bce admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:38.994396 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca0853-77cc-4a20-97f2-23a5e5525bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:38.995921 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca0853-77cc-4a20-97f2-23a5e5525bce admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:38.998046 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 111/229] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:39.009714 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700a919-1d18-432e-9ab4-2aa7aaa642eb admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:39.010314 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 119/230] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:15:38 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:39.016520 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca0853-77cc-4a20-97f2-23a5e5525bce admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:39.026421 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca0853-77cc-4a20-97f2-23a5e5525bce admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:39.029490 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700a919-1d18-432e-9ab4-2aa7aaa642eb admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:39.031723 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7165b-68c0-499c-90db-a4e02385d661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:39.032742 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7165b-68c0-499c-90db-a4e02385d661 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:39.033028 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7165b-68c0-499c-90db-a4e02385d661 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:39.033300 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7165b-68c0-499c-90db-a4e02385d661 admin admin] PATH_INFO: `/v3/users/c39507aad31a4f43b3861f10c1a8616f` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:39.034680 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c7165b-68c0-499c-90db-a4e02385d661 admin admin] RBAC: Authorizing `identity:get_user(user_id=c39507aad31a4f43b3861f10c1a8616f)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:39.037116 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c7165b-68c0-499c-90db-a4e02385d661 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:39.039283 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 120/231] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:39 2021] GET /identity/v3/users/c39507aad31a4f43b3861f10c1a8616f => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:39.042167 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e368df-f1bf-490b-8e22-e6185b358487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:39.043066 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e368df-f1bf-490b-8e22-e6185b358487 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:39.043352 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e368df-f1bf-490b-8e22-e6185b358487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:39.043738 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e368df-f1bf-490b-8e22-e6185b358487 admin admin] PATH_INFO: `/v3/users/c39507aad31a4f43b3861f10c1a8616f` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:39.045968 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e368df-f1bf-490b-8e22-e6185b358487 admin admin] RBAC: Authorizing `identity:get_user(user_id=c39507aad31a4f43b3861f10c1a8616f)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:39.047838 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7165b-68c0-499c-90db-a4e02385d661 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:39.048084 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e368df-f1bf-490b-8e22-e6185b358487 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:39.049928 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 112/232] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:39 2021] GET /identity/v3/users/c39507aad31a4f43b3861f10c1a8616f => generated 283 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:39.055581 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e368df-f1bf-490b-8e22-e6185b358487 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:39.056273 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7165b-68c0-499c-90db-a4e02385d661 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:39.062256 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226b8f1-34e3-4e64-848d-40a27be54bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:39.063188 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226b8f1-34e3-4e64-848d-40a27be54bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:39.063473 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226b8f1-34e3-4e64-848d-40a27be54bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:39.063748 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226b8f1-34e3-4e64-848d-40a27be54bc0 admin admin] PATH_INFO: `/v3/projects/d57902468b3746628ca506df9bca7068` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:39.065145 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226b8f1-34e3-4e64-848d-40a27be54bc0 admin admin] RBAC: Authorizing `identity:get_project(project_id=d57902468b3746628ca506df9bca7068)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:39.067438 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226b8f1-34e3-4e64-848d-40a27be54bc0 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:39.069983 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 121/233] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:39 2021] GET /identity/v3/projects/d57902468b3746628ca506df9bca7068 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:39.077174 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e368df-f1bf-490b-8e22-e6185b358487 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:39.077558 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226b8f1-34e3-4e64-848d-40a27be54bc0 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:39.088923 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226b8f1-34e3-4e64-848d-40a27be54bc0 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:39.090202 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fecf4a-8504-4205-b8df-bdedb3547d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:39.091584 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fecf4a-8504-4205-b8df-bdedb3547d9b admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:39.091987 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fecf4a-8504-4205-b8df-bdedb3547d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:39.092265 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fecf4a-8504-4205-b8df-bdedb3547d9b admin admin] PATH_INFO: `/v3/projects/d57902468b3746628ca506df9bca7068` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:39.093729 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fecf4a-8504-4205-b8df-bdedb3547d9b admin admin] RBAC: Authorizing `identity:get_project(project_id=d57902468b3746628ca506df9bca7068)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:39.093934 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5783aa0-61d7-490a-8e7f-ec42e70876bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:39.094916 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5783aa0-61d7-490a-8e7f-ec42e70876bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:39.095185 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5783aa0-61d7-490a-8e7f-ec42e70876bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:39.095528 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5783aa0-61d7-490a-8e7f-ec42e70876bb admin admin] PATH_INFO: `/v3/projects/d57902468b3746628ca506df9bca7068/users/c39507aad31a4f43b3861f10c1a8616f/roles/bc8a8682d8f748788fb70d235f9978dc` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:39.095814 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fecf4a-8504-4205-b8df-bdedb3547d9b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:39.097942 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5783aa0-61d7-490a-8e7f-ec42e70876bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d57902468b3746628ca506df9bca7068, user_id=c39507aad31a4f43b3861f10c1a8616f, role_id=bc8a8682d8f748788fb70d235f9978dc)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:39.100755 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5783aa0-61d7-490a-8e7f-ec42e70876bb admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:39.102351 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 113/234] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:39 2021] GET /identity/v3/projects/d57902468b3746628ca506df9bca7068 => generated 302 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:39.108692 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fecf4a-8504-4205-b8df-bdedb3547d9b admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:39.124825 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fecf4a-8504-4205-b8df-bdedb3547d9b admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:39.130129 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb9626-8e5e-43a1-99f6-e0196dce383f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:39.131165 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb9626-8e5e-43a1-99f6-e0196dce383f admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:39.132612 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb9626-8e5e-43a1-99f6-e0196dce383f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:39.132921 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb9626-8e5e-43a1-99f6-e0196dce383f admin admin] PATH_INFO: `/v3/projects/d57902468b3746628ca506df9bca7068/users/c39507aad31a4f43b3861f10c1a8616f/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:39.135499 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb9626-8e5e-43a1-99f6-e0196dce383f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d57902468b3746628ca506df9bca7068, user_id=c39507aad31a4f43b3861f10c1a8616f, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:39.139651 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb9626-8e5e-43a1-99f6-e0196dce383f admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:39.193387 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 122/235] 10.222.0.62 () {58 vars in 1460 bytes} [Tue Nov 23 19:15:39 2021] PUT /identity/v3/projects/d57902468b3746628ca506df9bca7068/users/c39507aad31a4f43b3861f10c1a8616f/roles/bc8a8682d8f748788fb70d235f9978dc => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:15:39.237784 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 114/236] 10.222.0.62 () {58 vars in 1460 bytes} [Tue Nov 23 19:15:39 2021] PUT /identity/v3/projects/d57902468b3746628ca506df9bca7068/users/c39507aad31a4f43b3861f10c1a8616f/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:15:39.254932 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd004d1-e05e-4280-8a6f-3a897dc1f10f None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:39.255226 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd004d1-e05e-4280-8a6f-3a897dc1f10f None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:39.255458 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd004d1-e05e-4280-8a6f-3a897dc1f10f None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:39.257318 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 123/237] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:39.264178 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4fb70-e40c-4c7b-aad6-169cd55e9643 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:39.264457 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4fb70-e40c-4c7b-aad6-169cd55e9643 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:39.264734 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d4fb70-e40c-4c7b-aad6-169cd55e9643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:39.289954 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-71d4fb70-e40c-4c7b-aad6-169cd55e9643 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:39.291191 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-71d4fb70-e40c-4c7b-aad6-169cd55e9643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:39.365770 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 115/238] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:39.391439 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd004d1-e05e-4280-8a6f-3a897dc1f10f None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:39.405824 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd004d1-e05e-4280-8a6f-3a897dc1f10f None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:39.410368 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00541d3-17a9-4580-8540-7e3370605fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:39.411426 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00541d3-17a9-4580-8540-7e3370605fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:39.411859 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00541d3-17a9-4580-8540-7e3370605fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:39.412299 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00541d3-17a9-4580-8540-7e3370605fb7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:39.424828 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00541d3-17a9-4580-8540-7e3370605fb7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:39.432457 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-b00541d3-17a9-4580-8540-7e3370605fb7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 19:15:39.434000 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 124/239] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:39 2021] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:15:39.440579 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4fb70-e40c-4c7b-aad6-169cd55e9643 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:39.451432 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d4fb70-e40c-4c7b-aad6-169cd55e9643 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:39.456506 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300fefe-b8f5-4a85-887d-4dd3d1f52a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:39.457490 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300fefe-b8f5-4a85-887d-4dd3d1f52a4e admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:39.457913 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300fefe-b8f5-4a85-887d-4dd3d1f52a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:39.458341 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300fefe-b8f5-4a85-887d-4dd3d1f52a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:39.459283 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300fefe-b8f5-4a85-887d-4dd3d1f52a4e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:39.459745 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300fefe-b8f5-4a85-887d-4dd3d1f52a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:39.461584 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300fefe-b8f5-4a85-887d-4dd3d1f52a4e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:39.472018 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 116/240] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Nov 23 19:15:39 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:39.478313 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00541d3-17a9-4580-8540-7e3370605fb7 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:39.489274 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00541d3-17a9-4580-8540-7e3370605fb7 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:39.494086 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9d13d-a0fe-4a7f-aa85-5940022138b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:39.495600 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9d13d-a0fe-4a7f-aa85-5940022138b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:39.496039 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9d13d-a0fe-4a7f-aa85-5940022138b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:39.496450 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9d13d-a0fe-4a7f-aa85-5940022138b8 admin admin] PATH_INFO: `/v3/users/b85d437dda0044f7b2a9baeef879b7c3` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:39.513271 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9d13d-a0fe-4a7f-aa85-5940022138b8 admin admin] RBAC: Authorizing `identity:get_user(user_id=b85d437dda0044f7b2a9baeef879b7c3)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:39.515642 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9d13d-a0fe-4a7f-aa85-5940022138b8 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:39.517584 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 125/241] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:39 2021] GET /identity/v3/users/b85d437dda0044f7b2a9baeef879b7c3 => generated 297 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:39.523863 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300fefe-b8f5-4a85-887d-4dd3d1f52a4e admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:39.535684 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300fefe-b8f5-4a85-887d-4dd3d1f52a4e admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:39.540676 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9334f-773c-4071-8cfd-3f16e0372c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:39.541514 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9334f-773c-4071-8cfd-3f16e0372c4f admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:39.541936 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9334f-773c-4071-8cfd-3f16e0372c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:39.542346 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9334f-773c-4071-8cfd-3f16e0372c4f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:39.551491 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e9334f-773c-4071-8cfd-3f16e0372c4f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:39.553542 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e9334f-773c-4071-8cfd-3f16e0372c4f admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:39.564169 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 117/242] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:15:39 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:15:39.570778 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9d13d-a0fe-4a7f-aa85-5940022138b8 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:39.582087 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9d13d-a0fe-4a7f-aa85-5940022138b8 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:39.585080 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588bafb-72ac-4b93-a828-ebec917098f0 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:39.585579 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588bafb-72ac-4b93-a828-ebec917098f0 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:39.586005 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588bafb-72ac-4b93-a828-ebec917098f0 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:39.588945 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 118/243] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:39.592738 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad9ba6-22f8-4d4a-bb57-a2187bbf8fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:39.594891 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfaaa0-9d4d-4825-87fd-fa785cbc7d6e None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:39.595397 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfaaa0-9d4d-4825-87fd-fa785cbc7d6e None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:39.595812 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecfaaa0-9d4d-4825-87fd-fa785cbc7d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:39.598005 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad9ba6-22f8-4d4a-bb57-a2187bbf8fbd admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:39.598436 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad9ba6-22f8-4d4a-bb57-a2187bbf8fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:39.598875 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad9ba6-22f8-4d4a-bb57-a2187bbf8fbd admin admin] PATH_INFO: `/v3/projects/d57902468b3746628ca506df9bca7068` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:39.600486 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad9ba6-22f8-4d4a-bb57-a2187bbf8fbd admin admin] RBAC: Authorizing `identity:get_project(project_id=d57902468b3746628ca506df9bca7068)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:39.602858 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad9ba6-22f8-4d4a-bb57-a2187bbf8fbd admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:39.605058 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 126/244] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:39 2021] GET /identity/v3/projects/d57902468b3746628ca506df9bca7068 => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:39.611850 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad9ba6-22f8-4d4a-bb57-a2187bbf8fbd admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:39.622550 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad9ba6-22f8-4d4a-bb57-a2187bbf8fbd admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:39.626397 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-7ecfaaa0-9d4d-4825-87fd-fa785cbc7d6e None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:39.627594 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-7ecfaaa0-9d4d-4825-87fd-fa785cbc7d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:39.628289 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe013a-40a9-4492-bf08-768f20b280a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:39.629128 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe013a-40a9-4492-bf08-768f20b280a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:39.629584 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe013a-40a9-4492-bf08-768f20b280a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:39.629994 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe013a-40a9-4492-bf08-768f20b280a6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:39.631072 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe013a-40a9-4492-bf08-768f20b280a6 admin admin] RBAC: Adding query filter params (role.id=f8b0ca7636ad450b94f68df7bc4497aa, scope.project.id=d57902468b3746628ca506df9bca7068, user.id=b85d437dda0044f7b2a9baeef879b7c3) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:39.631521 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe013a-40a9-4492-bf08-768f20b280a6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:39.633587 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe013a-40a9-4492-bf08-768f20b280a6 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:39.643209 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 127/245] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:15:39 2021] GET /identity/v3/role_assignments?user.id=b85d437dda0044f7b2a9baeef879b7c3&scope.project.id=d57902468b3746628ca506df9bca7068&role.id=f8b0ca7636ad450b94f68df7bc4497aa => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:39.651353 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 119/246] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 19:15:39.702299 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe013a-40a9-4492-bf08-768f20b280a6 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:39.716217 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe013a-40a9-4492-bf08-768f20b280a6 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:39.722453 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19cc16c-4cc1-4035-b4fa-28778e217501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:39.723486 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19cc16c-4cc1-4035-b4fa-28778e217501 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:39.723923 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19cc16c-4cc1-4035-b4fa-28778e217501 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:39.724385 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19cc16c-4cc1-4035-b4fa-28778e217501 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:39.725787 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19cc16c-4cc1-4035-b4fa-28778e217501 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:39.727622 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19cc16c-4cc1-4035-b4fa-28778e217501 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:39.733845 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 128/247] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:15:39 2021] GET /identity/v3/domains/default => generated 199 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:39.736242 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfaaa0-9d4d-4825-87fd-fa785cbc7d6e None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:39.745823 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecfaaa0-9d4d-4825-87fd-fa785cbc7d6e None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:39.752516 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f566f6-5565-43f1-98a0-b97c0408318a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:39.753452 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f566f6-5565-43f1-98a0-b97c0408318a admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:39.753933 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f566f6-5565-43f1-98a0-b97c0408318a admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:39.754364 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f566f6-5565-43f1-98a0-b97c0408318a admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:39.755233 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f566f6-5565-43f1-98a0-b97c0408318a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:39.757375 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f566f6-5565-43f1-98a0-b97c0408318a admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:39.882343 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 120/248] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Nov 23 19:15:39 2021] POST /identity/v3/users => generated 297 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:15:41.962800 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685a1d2-3c04-48a6-bb0e-38f5e644cd52 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:41.963789 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685a1d2-3c04-48a6-bb0e-38f5e644cd52 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:41.964266 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685a1d2-3c04-48a6-bb0e-38f5e644cd52 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:41.966644 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 129/249] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:41 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:41.972150 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc248bb-f867-48c5-85d9-76006810acca None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:41.973020 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc248bb-f867-48c5-85d9-76006810acca None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:41.973509 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc248bb-f867-48c5-85d9-76006810acca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:41.997832 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-2fc248bb-f867-48c5-85d9-76006810acca None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:41.999378 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-2fc248bb-f867-48c5-85d9-76006810acca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:42.007221 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 121/250] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:41 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:42.015907 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0357b7-e31c-4714-9991-b35ae6e6d899 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:42.016440 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0357b7-e31c-4714-9991-b35ae6e6d899 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:42.016886 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0357b7-e31c-4714-9991-b35ae6e6d899 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:42.018838 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 130/251] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:42.034089 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc248bb-f867-48c5-85d9-76006810acca None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:42.043343 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62783ca3-4364-48ea-84ca-2f2a848f50d9 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:42.044846 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62783ca3-4364-48ea-84ca-2f2a848f50d9 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:42.045257 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62783ca3-4364-48ea-84ca-2f2a848f50d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:42.047749 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc248bb-f867-48c5-85d9-76006810acca None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:42.072793 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9ef9f-ed93-4311-a4d8-713e4d42d563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:42.073922 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9ef9f-ed93-4311-a4d8-713e4d42d563 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:42.074379 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9ef9f-ed93-4311-a4d8-713e4d42d563 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:42.074820 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9ef9f-ed93-4311-a4d8-713e4d42d563 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:42.082442 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-62783ca3-4364-48ea-84ca-2f2a848f50d9 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:42.083641 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-62783ca3-4364-48ea-84ca-2f2a848f50d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:42.095095 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9ef9f-ed93-4311-a4d8-713e4d42d563 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:42.102625 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-46b9ef9f-ed93-4311-a4d8-713e4d42d563 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 19:15:42.109603 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 122/252] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:42 2021] GET /identity/v3/roles/member => generated 84 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:15:42.111077 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 131/253] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:42 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Nov 23 19:15:42.117101 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9ef9f-ed93-4311-a4d8-713e4d42d563 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:42.130597 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9ef9f-ed93-4311-a4d8-713e4d42d563 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:42.141566 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6959b-6ae5-4957-824d-eb2f61a0bd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:42.142457 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6959b-6ae5-4957-824d-eb2f61a0bd57 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:42.142909 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6959b-6ae5-4957-824d-eb2f61a0bd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:42.143368 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6959b-6ae5-4957-824d-eb2f61a0bd57 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:42.144320 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6959b-6ae5-4957-824d-eb2f61a0bd57 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:42.144802 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6959b-6ae5-4957-824d-eb2f61a0bd57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:42.146676 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6959b-6ae5-4957-824d-eb2f61a0bd57 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:42.147002 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460a615-0961-49c8-b871-7e274dca35dd None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:42.147291 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460a615-0961-49c8-b871-7e274dca35dd None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:42.147564 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460a615-0961-49c8-b871-7e274dca35dd None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:42.153520 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 132/254] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:42.165227 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 123/255] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Nov 23 19:15:42 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:42.167581 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460a615-0961-49c8-b871-7e274dca35dd None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:42.173213 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6959b-6ae5-4957-824d-eb2f61a0bd57 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:42.185681 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6959b-6ae5-4957-824d-eb2f61a0bd57 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:42.189989 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460a615-0961-49c8-b871-7e274dca35dd None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:42.194729 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70893686-aabd-4238-9917-251f0f0df396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:42.195862 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70893686-aabd-4238-9917-251f0f0df396 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:42.196139 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70893686-aabd-4238-9917-251f0f0df396 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:42.196429 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70893686-aabd-4238-9917-251f0f0df396 admin admin] PATH_INFO: `/v3/users/c39507aad31a4f43b3861f10c1a8616f` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:42.198314 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70893686-aabd-4238-9917-251f0f0df396 admin admin] RBAC: Authorizing `identity:get_user(user_id=c39507aad31a4f43b3861f10c1a8616f)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:42.200625 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70893686-aabd-4238-9917-251f0f0df396 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:42.200733 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7265c-36ed-4853-a76d-6a61abe71101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:42.201507 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7265c-36ed-4853-a76d-6a61abe71101 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:42.201793 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7265c-36ed-4853-a76d-6a61abe71101 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:42.202062 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7265c-36ed-4853-a76d-6a61abe71101 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:42.202464 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 124/256] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:42 2021] GET /identity/v3/users/c39507aad31a4f43b3861f10c1a8616f => generated 283 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:42.203416 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db12576-b297-4002-9e1c-acad6c7c40f6 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:42.203697 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db12576-b297-4002-9e1c-acad6c7c40f6 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:42.203972 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db12576-b297-4002-9e1c-acad6c7c40f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:42.227967 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e7265c-36ed-4853-a76d-6a61abe71101 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:42.237904 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-21e7265c-36ed-4853-a76d-6a61abe71101 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 19:15:42.239676 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 133/257] 10.222.0.62 () {56 vars in 1135 bytes} [Tue Nov 23 19:15:42 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:15:42.240633 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7265c-36ed-4853-a76d-6a61abe71101 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:42.245467 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-0db12576-b297-4002-9e1c-acad6c7c40f6 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:42.245467 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-0db12576-b297-4002-9e1c-acad6c7c40f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:42.258025 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7265c-36ed-4853-a76d-6a61abe71101 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:42.260594 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 125/258] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:42 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:42.261975 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db12576-b297-4002-9e1c-acad6c7c40f6 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:42.270585 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60131217-5796-48bd-b456-68618aecfe32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:42.271536 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60131217-5796-48bd-b456-68618aecfe32 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:42.272027 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60131217-5796-48bd-b456-68618aecfe32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:42.272490 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60131217-5796-48bd-b456-68618aecfe32 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:42.283422 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db12576-b297-4002-9e1c-acad6c7c40f6 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:42.288936 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60131217-5796-48bd-b456-68618aecfe32 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:42.291634 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60131217-5796-48bd-b456-68618aecfe32 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:42.296434 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf31372-fb05-40f7-b3b2-8b83949c6965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:42.297570 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf31372-fb05-40f7-b3b2-8b83949c6965 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:42.298047 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf31372-fb05-40f7-b3b2-8b83949c6965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:42.298666 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf31372-fb05-40f7-b3b2-8b83949c6965 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:42.299664 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf31372-fb05-40f7-b3b2-8b83949c6965 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:42.300170 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf31372-fb05-40f7-b3b2-8b83949c6965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:42.302027 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf31372-fb05-40f7-b3b2-8b83949c6965 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:42.316452 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 134/259] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:15:42 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:15:42.318773 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 126/260] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:15:42 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:42.320121 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60131217-5796-48bd-b456-68618aecfe32 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:42.326425 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf31372-fb05-40f7-b3b2-8b83949c6965 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:42.337588 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60131217-5796-48bd-b456-68618aecfe32 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:42.339727 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf31372-fb05-40f7-b3b2-8b83949c6965 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:42.348401 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e2d0e-9f24-4315-b7d9-e049c8b746ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:42.349189 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd32001-ced9-400d-957d-61532aa854ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:42.350685 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd32001-ced9-400d-957d-61532aa854ec admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:42.351337 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e2d0e-9f24-4315-b7d9-e049c8b746ec admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:42.351825 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e2d0e-9f24-4315-b7d9-e049c8b746ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:42.352285 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd32001-ced9-400d-957d-61532aa854ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:42.352967 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd32001-ced9-400d-957d-61532aa854ec admin admin] PATH_INFO: `/v3/projects/d57902468b3746628ca506df9bca7068` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:42.353238 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e2d0e-9f24-4315-b7d9-e049c8b746ec admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:42.355257 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd32001-ced9-400d-957d-61532aa854ec admin admin] RBAC: Authorizing `identity:get_project(project_id=d57902468b3746628ca506df9bca7068)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:42.359757 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd32001-ced9-400d-957d-61532aa854ec admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:42.364548 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 127/261] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:42 2021] GET /identity/v3/projects/d57902468b3746628ca506df9bca7068 => generated 302 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:42.365812 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd32001-ced9-400d-957d-61532aa854ec admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:42.376666 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e2d0e-9f24-4315-b7d9-e049c8b746ec admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:42.388212 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd32001-ced9-400d-957d-61532aa854ec admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:42.390552 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-113e2d0e-9f24-4315-b7d9-e049c8b746ec admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 19:15:42.393366 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 135/262] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:15:42 2021] GET /identity/v3/roles/admin => generated 83 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:15:42.395122 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e2d0e-9f24-4315-b7d9-e049c8b746ec admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:42.396721 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8e3f0-48f7-41a0-8ab1-0b52e4c9710a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:42.398026 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8e3f0-48f7-41a0-8ab1-0b52e4c9710a admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:42.400257 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8e3f0-48f7-41a0-8ab1-0b52e4c9710a admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:42.400750 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8e3f0-48f7-41a0-8ab1-0b52e4c9710a admin admin] PATH_INFO: `/v3/users/c39507aad31a4f43b3861f10c1a8616f` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:42.404486 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8e3f0-48f7-41a0-8ab1-0b52e4c9710a admin admin] RBAC: Authorizing `identity:get_user(user_id=c39507aad31a4f43b3861f10c1a8616f)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:42.406924 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8e3f0-48f7-41a0-8ab1-0b52e4c9710a admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:42.411104 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 128/263] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:42 2021] GET /identity/v3/users/c39507aad31a4f43b3861f10c1a8616f => generated 283 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:42.412067 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8e3f0-48f7-41a0-8ab1-0b52e4c9710a admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:42.420455 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e2d0e-9f24-4315-b7d9-e049c8b746ec admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:42.432334 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa109d-f0ab-469b-ad14-3dedf42707a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:42.433324 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa109d-f0ab-469b-ad14-3dedf42707a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:42.433839 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa109d-f0ab-469b-ad14-3dedf42707a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:42.434705 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa109d-f0ab-469b-ad14-3dedf42707a3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:42.436443 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa109d-f0ab-469b-ad14-3dedf42707a3 admin admin] RBAC: Adding query filter params (role.id=f8b0ca7636ad450b94f68df7bc4497aa, scope.project.id=d57902468b3746628ca506df9bca7068, user.id=c39507aad31a4f43b3861f10c1a8616f) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:42.438264 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8e3f0-48f7-41a0-8ab1-0b52e4c9710a admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:42.438829 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa109d-f0ab-469b-ad14-3dedf42707a3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:42.441531 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa109d-f0ab-469b-ad14-3dedf42707a3 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:42.449512 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6abe6-b94b-4fbd-b676-43cac5d91fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:42.451355 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6abe6-b94b-4fbd-b676-43cac5d91fce admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:42.452549 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6abe6-b94b-4fbd-b676-43cac5d91fce admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:42.453191 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6abe6-b94b-4fbd-b676-43cac5d91fce admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:42.455921 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6abe6-b94b-4fbd-b676-43cac5d91fce admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:42.456459 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6abe6-b94b-4fbd-b676-43cac5d91fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:42.457265 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 136/264] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:15:42 2021] GET /identity/v3/role_assignments?user.id=c39507aad31a4f43b3861f10c1a8616f&scope.project.id=d57902468b3746628ca506df9bca7068&role.id=f8b0ca7636ad450b94f68df7bc4497aa => generated 608 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:42.458927 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6abe6-b94b-4fbd-b676-43cac5d91fce admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:42.460009 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa109d-f0ab-469b-ad14-3dedf42707a3 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:42.476424 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 129/265] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:42 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:42.479115 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa109d-f0ab-469b-ad14-3dedf42707a3 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:42.483849 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d282da-cb96-4734-bcaa-8a268e64e0a6 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:42.484362 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d282da-cb96-4734-bcaa-8a268e64e0a6 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:42.484793 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d282da-cb96-4734-bcaa-8a268e64e0a6 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:42.486805 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 130/266] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:42.496239 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613cb342-29a8-4bb7-a7e3-253d29d7ae18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:42.496391 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d282da-cb96-4734-bcaa-8a268e64e0a6 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:42.496466 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cb342-29a8-4bb7-a7e3-253d29d7ae18 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:42.496466 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cb342-29a8-4bb7-a7e3-253d29d7ae18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:42.496466 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cb342-29a8-4bb7-a7e3-253d29d7ae18 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:42.509470 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613cb342-29a8-4bb7-a7e3-253d29d7ae18 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:42.509470 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613cb342-29a8-4bb7-a7e3-253d29d7ae18 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:42.518809 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d282da-cb96-4734-bcaa-8a268e64e0a6 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:42.526736 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 137/267] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:15:42 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:15:42.527854 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d81ab-7a37-4be2-be74-80de58a453f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:42.530816 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d81ab-7a37-4be2-be74-80de58a453f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:42.531100 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d81ab-7a37-4be2-be74-80de58a453f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:42.531375 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d81ab-7a37-4be2-be74-80de58a453f4 admin admin] PATH_INFO: `/v3/users/c39507aad31a4f43b3861f10c1a8616f` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:42.531999 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6275df5-0ed6-49a3-8e69-5bad7d022fdd None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:42.532311 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6275df5-0ed6-49a3-8e69-5bad7d022fdd None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:42.532637 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6275df5-0ed6-49a3-8e69-5bad7d022fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:42.534802 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d81ab-7a37-4be2-be74-80de58a453f4 admin admin] RBAC: Authorizing `identity:get_user(user_id=c39507aad31a4f43b3861f10c1a8616f)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:42.542441 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d81ab-7a37-4be2-be74-80de58a453f4 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:42.547207 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 131/268] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:42 2021] GET /identity/v3/users/c39507aad31a4f43b3861f10c1a8616f => generated 283 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:42.549825 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d81ab-7a37-4be2-be74-80de58a453f4 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:42.569646 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d81ab-7a37-4be2-be74-80de58a453f4 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:42.577885 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-b6275df5-0ed6-49a3-8e69-5bad7d022fdd None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:42.580377 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-b6275df5-0ed6-49a3-8e69-5bad7d022fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:42.582522 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14cad4-5ffc-44e4-91b6-c5939d77756d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:42.584473 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14cad4-5ffc-44e4-91b6-c5939d77756d admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:42.584757 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14cad4-5ffc-44e4-91b6-c5939d77756d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:42.585436 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14cad4-5ffc-44e4-91b6-c5939d77756d admin admin] PATH_INFO: `/v3/projects/d57902468b3746628ca506df9bca7068` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:42.588558 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14cad4-5ffc-44e4-91b6-c5939d77756d admin admin] RBAC: Authorizing `identity:get_project(project_id=d57902468b3746628ca506df9bca7068)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:42.596116 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14cad4-5ffc-44e4-91b6-c5939d77756d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:42.597451 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 138/269] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:42 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:42.602417 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6275df5-0ed6-49a3-8e69-5bad7d022fdd None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:42.603996 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 132/270] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:42 2021] GET /identity/v3/projects/d57902468b3746628ca506df9bca7068 => generated 302 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:42.614482 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14cad4-5ffc-44e4-91b6-c5939d77756d admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:42.633699 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6275df5-0ed6-49a3-8e69-5bad7d022fdd None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:42.635199 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14cad4-5ffc-44e4-91b6-c5939d77756d admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:42.643566 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59895e29-e1b9-410d-947e-aeac04f75c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:42.644389 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59895e29-e1b9-410d-947e-aeac04f75c8f admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:42.644677 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59895e29-e1b9-410d-947e-aeac04f75c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:42.644955 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59895e29-e1b9-410d-947e-aeac04f75c8f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:42.645981 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59895e29-e1b9-410d-947e-aeac04f75c8f admin admin] RBAC: Adding query filter params (role.id=bc8a8682d8f748788fb70d235f9978dc, scope.project.id=d57902468b3746628ca506df9bca7068, user.id=c39507aad31a4f43b3861f10c1a8616f) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:42.646299 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59895e29-e1b9-410d-947e-aeac04f75c8f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:42.648344 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59895e29-e1b9-410d-947e-aeac04f75c8f admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:42.649983 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b287625-e31f-402e-a570-8701a93108ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:42.650881 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b287625-e31f-402e-a570-8701a93108ea admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:42.651351 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b287625-e31f-402e-a570-8701a93108ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:42.651812 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b287625-e31f-402e-a570-8701a93108ea admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:42.656207 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 133/271] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:15:42 2021] GET /identity/v3/role_assignments?user.id=c39507aad31a4f43b3861f10c1a8616f&scope.project.id=d57902468b3746628ca506df9bca7068&role.id=bc8a8682d8f748788fb70d235f9978dc => generated 608 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:42.669444 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59895e29-e1b9-410d-947e-aeac04f75c8f admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:42.673679 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b287625-e31f-402e-a570-8701a93108ea admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:42.675642 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b287625-e31f-402e-a570-8701a93108ea admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:42.688704 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59895e29-e1b9-410d-947e-aeac04f75c8f admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:42.693825 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 139/272] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:15:42 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:15:42.700237 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b287625-e31f-402e-a570-8701a93108ea admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:42.701143 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e0097-30c4-4a90-aff2-e4fc815a2d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:42.702041 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e0097-30c4-4a90-aff2-e4fc815a2d5f admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:42.702325 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e0097-30c4-4a90-aff2-e4fc815a2d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:42.702603 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e0097-30c4-4a90-aff2-e4fc815a2d5f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:42.720090 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b287625-e31f-402e-a570-8701a93108ea admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:42.730225 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e0097-30c4-4a90-aff2-e4fc815a2d5f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:42.738124 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b675b7b-54e6-4e10-83b2-4c9cac49313f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:42.739075 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-a82e0097-30c4-4a90-aff2-e4fc815a2d5f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 19:15:42.739563 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b675b7b-54e6-4e10-83b2-4c9cac49313f admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:42.740067 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b675b7b-54e6-4e10-83b2-4c9cac49313f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:42.740545 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 134/273] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:42 2021] GET /identity/v3/roles/member => generated 84 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:15:42.740650 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b675b7b-54e6-4e10-83b2-4c9cac49313f admin admin] PATH_INFO: `/v3/projects/d57902468b3746628ca506df9bca7068` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:42.746357 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b675b7b-54e6-4e10-83b2-4c9cac49313f admin admin] RBAC: Authorizing `identity:get_project(project_id=d57902468b3746628ca506df9bca7068)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:42.748369 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e0097-30c4-4a90-aff2-e4fc815a2d5f admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:42.750017 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b675b7b-54e6-4e10-83b2-4c9cac49313f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:42.752675 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 140/274] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:42 2021] GET /identity/v3/projects/d57902468b3746628ca506df9bca7068 => generated 302 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:42.763077 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b675b7b-54e6-4e10-83b2-4c9cac49313f admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:42.768133 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e0097-30c4-4a90-aff2-e4fc815a2d5f admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:42.779703 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b675b7b-54e6-4e10-83b2-4c9cac49313f admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:42.782327 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7756e2a-5363-4ca9-80f8-73137e6f8e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:42.783014 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7756e2a-5363-4ca9-80f8-73137e6f8e0f admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:42.783303 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7756e2a-5363-4ca9-80f8-73137e6f8e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:42.783584 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7756e2a-5363-4ca9-80f8-73137e6f8e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:42.784604 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7756e2a-5363-4ca9-80f8-73137e6f8e0f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:42.784924 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7756e2a-5363-4ca9-80f8-73137e6f8e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:42.786782 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7756e2a-5363-4ca9-80f8-73137e6f8e0f admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:42.790739 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35d70d-4fa7-4fa7-89e1-4b266c934d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:42.791709 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35d70d-4fa7-4fa7-89e1-4b266c934d7f admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:42.792288 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35d70d-4fa7-4fa7-89e1-4b266c934d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:42.792792 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35d70d-4fa7-4fa7-89e1-4b266c934d7f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:42.794542 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c35d70d-4fa7-4fa7-89e1-4b266c934d7f admin admin] RBAC: Adding query filter params (role.id=6d9a8878ffeb49fea19d854657c6b767, scope.project.id=d57902468b3746628ca506df9bca7068, user.id=c39507aad31a4f43b3861f10c1a8616f) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:42.795120 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c35d70d-4fa7-4fa7-89e1-4b266c934d7f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:42.797239 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c35d70d-4fa7-4fa7-89e1-4b266c934d7f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:42.805478 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 135/275] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Nov 23 19:15:42 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:42.807134 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7756e2a-5363-4ca9-80f8-73137e6f8e0f admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:42.812762 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 141/276] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:15:42 2021] GET /identity/v3/role_assignments?user.id=c39507aad31a4f43b3861f10c1a8616f&scope.project.id=d57902468b3746628ca506df9bca7068&role.id=6d9a8878ffeb49fea19d854657c6b767 => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:42.822901 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7756e2a-5363-4ca9-80f8-73137e6f8e0f admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:42.828367 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78f16d-a5e5-4378-a319-994a412cb7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:42.829192 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78f16d-a5e5-4378-a319-994a412cb7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:42.829509 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78f16d-a5e5-4378-a319-994a412cb7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:42.829790 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78f16d-a5e5-4378-a319-994a412cb7b1 admin admin] PATH_INFO: `/v3/users/b85d437dda0044f7b2a9baeef879b7c3` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:42.831099 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d78f16d-a5e5-4378-a319-994a412cb7b1 admin admin] RBAC: Authorizing `identity:get_user(user_id=b85d437dda0044f7b2a9baeef879b7c3)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:42.833239 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d78f16d-a5e5-4378-a319-994a412cb7b1 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:42.835217 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 136/277] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:42 2021] GET /identity/v3/users/b85d437dda0044f7b2a9baeef879b7c3 => generated 297 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:42.842709 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35d70d-4fa7-4fa7-89e1-4b266c934d7f admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:42.854019 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35d70d-4fa7-4fa7-89e1-4b266c934d7f admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:42.859714 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67a25f-1548-4f03-bbd2-d3df7979ec17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:42.860665 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67a25f-1548-4f03-bbd2-d3df7979ec17 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:42.860994 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67a25f-1548-4f03-bbd2-d3df7979ec17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:42.861275 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67a25f-1548-4f03-bbd2-d3df7979ec17 admin admin] PATH_INFO: `/v3/projects/d57902468b3746628ca506df9bca7068` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:42.862885 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67a25f-1548-4f03-bbd2-d3df7979ec17 admin admin] RBAC: Authorizing `identity:get_project(project_id=d57902468b3746628ca506df9bca7068)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:42.865096 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67a25f-1548-4f03-bbd2-d3df7979ec17 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:42.873301 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 142/278] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:42 2021] GET /identity/v3/projects/d57902468b3746628ca506df9bca7068 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:42.874762 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78f16d-a5e5-4378-a319-994a412cb7b1 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:42.886055 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78f16d-a5e5-4378-a319-994a412cb7b1 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:42.893014 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb373c1f-ca34-4eb0-99d9-2c31b2f114c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:42.894016 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb373c1f-ca34-4eb0-99d9-2c31b2f114c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:42.894298 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb373c1f-ca34-4eb0-99d9-2c31b2f114c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:42.894571 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb373c1f-ca34-4eb0-99d9-2c31b2f114c1 admin admin] PATH_INFO: `/v3/projects/d57902468b3746628ca506df9bca7068/users/b85d437dda0044f7b2a9baeef879b7c3/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:42.896784 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb373c1f-ca34-4eb0-99d9-2c31b2f114c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d57902468b3746628ca506df9bca7068, user_id=b85d437dda0044f7b2a9baeef879b7c3, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:42.899721 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb373c1f-ca34-4eb0-99d9-2c31b2f114c1 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:43.025727 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 137/279] 10.222.0.62 () {58 vars in 1460 bytes} [Tue Nov 23 19:15:42 2021] PUT /identity/v3/projects/d57902468b3746628ca506df9bca7068/users/b85d437dda0044f7b2a9baeef879b7c3/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:15:43.715357 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdea71b-9da9-4254-b917-ad342bc75852 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:43.716956 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdea71b-9da9-4254-b917-ad342bc75852 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:43.716956 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdea71b-9da9-4254-b917-ad342bc75852 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:43.718423 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 143/280] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:43.723849 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c847a36-dfac-447e-bed2-6dc75b42484a None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:43.724141 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c847a36-dfac-447e-bed2-6dc75b42484a None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:43.724449 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c847a36-dfac-447e-bed2-6dc75b42484a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:43.742843 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-6c847a36-dfac-447e-bed2-6dc75b42484a None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:43.744020 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-6c847a36-dfac-447e-bed2-6dc75b42484a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:43.794866 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1caac4-fb38-4bce-873a-c72eb57a660e None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:43.795152 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1caac4-fb38-4bce-873a-c72eb57a660e None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:43.795428 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1caac4-fb38-4bce-873a-c72eb57a660e None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:43.797191 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 144/281] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 19:15:43.803176 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821d25f-6bd3-408b-b331-b4802558000f None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:43.803643 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821d25f-6bd3-408b-b331-b4802558000f None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:43.803752 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 138/282] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:43.804134 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821d25f-6bd3-408b-b331-b4802558000f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:43.827856 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c847a36-dfac-447e-bed2-6dc75b42484a None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:43.837347 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c847a36-dfac-447e-bed2-6dc75b42484a None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:43.842807 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9407a-1724-463f-ab42-62998ebce120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:43.843627 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9407a-1724-463f-ab42-62998ebce120 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:43.843915 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9407a-1724-463f-ab42-62998ebce120 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:43.844191 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9407a-1724-463f-ab42-62998ebce120 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:43.855798 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c9407a-1724-463f-ab42-62998ebce120 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:43.863832 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-b3c9407a-1724-463f-ab42-62998ebce120 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 23 19:15:43.865131 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 139/283] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:43 2021] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:15:43.871673 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9407a-1724-463f-ab42-62998ebce120 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:43.882544 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9407a-1724-463f-ab42-62998ebce120 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:43.887033 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57209a-d307-4a9e-8037-3165c95bfaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:43.888262 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57209a-d307-4a9e-8037-3165c95bfaae admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:43.888723 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57209a-d307-4a9e-8037-3165c95bfaae admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:43.888993 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57209a-d307-4a9e-8037-3165c95bfaae admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:43.889764 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57209a-d307-4a9e-8037-3165c95bfaae admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:43.890072 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57209a-d307-4a9e-8037-3165c95bfaae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:43.891698 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57209a-d307-4a9e-8037-3165c95bfaae admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:43.901030 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 140/284] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Nov 23 19:15:43 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:43.906990 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57209a-d307-4a9e-8037-3165c95bfaae admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:43.916782 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57209a-d307-4a9e-8037-3165c95bfaae admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:43.922639 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92851015-d7ea-44c2-9371-d108876a8bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:43.923520 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92851015-d7ea-44c2-9371-d108876a8bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:43.923803 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92851015-d7ea-44c2-9371-d108876a8bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:43.924077 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92851015-d7ea-44c2-9371-d108876a8bf1 admin admin] PATH_INFO: `/v3/users/e0a66e94cc9046f38618de8c4b6a1b1c` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:43.932643 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-c821d25f-6bd3-408b-b331-b4802558000f None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:43.933846 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-c821d25f-6bd3-408b-b331-b4802558000f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:43.939109 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92851015-d7ea-44c2-9371-d108876a8bf1 admin admin] RBAC: Authorizing `identity:get_user(user_id=e0a66e94cc9046f38618de8c4b6a1b1c)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:43.941218 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92851015-d7ea-44c2-9371-d108876a8bf1 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:43.941478 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 145/285] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 19:15:43.943342 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 141/286] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:43 2021] GET /identity/v3/users/e0a66e94cc9046f38618de8c4b6a1b1c => generated 297 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:43.949210 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821d25f-6bd3-408b-b331-b4802558000f None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:43.958903 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821d25f-6bd3-408b-b331-b4802558000f None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:43.964060 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd8f7a-9845-4b18-8a0f-c0cd2533bf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:43.964726 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd8f7a-9845-4b18-8a0f-c0cd2533bf1b admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:43.965015 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd8f7a-9845-4b18-8a0f-c0cd2533bf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:43.965287 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd8f7a-9845-4b18-8a0f-c0cd2533bf1b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:43.968488 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92851015-d7ea-44c2-9371-d108876a8bf1 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:43.973980 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd8f7a-9845-4b18-8a0f-c0cd2533bf1b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:43.975745 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd8f7a-9845-4b18-8a0f-c0cd2533bf1b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:43.977934 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92851015-d7ea-44c2-9371-d108876a8bf1 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:43.982499 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21605b17-e408-4cf2-bd47-15c9473a024b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:43.993547 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21605b17-e408-4cf2-bd47-15c9473a024b admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:43.993547 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21605b17-e408-4cf2-bd47-15c9473a024b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:43.993547 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21605b17-e408-4cf2-bd47-15c9473a024b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:43.993547 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21605b17-e408-4cf2-bd47-15c9473a024b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:43.993547 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21605b17-e408-4cf2-bd47-15c9473a024b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:43.993547 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 142/287] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:15:43 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:43.993925 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 146/288] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:15:43 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 23 19:15:43.994278 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21605b17-e408-4cf2-bd47-15c9473a024b admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:43.994376 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd8f7a-9845-4b18-8a0f-c0cd2533bf1b admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:44.002879 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd8f7a-9845-4b18-8a0f-c0cd2533bf1b admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:44.003552 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21605b17-e408-4cf2-bd47-15c9473a024b admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:44.007168 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5de29c-d7e5-400d-9dc7-44fc2f6c5533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:44.007927 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7ec98-25ca-4c3a-9dda-cc3048bcdf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:44.008051 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5de29c-d7e5-400d-9dc7-44fc2f6c5533 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:44.008265 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5de29c-d7e5-400d-9dc7-44fc2f6c5533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:44.008521 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5de29c-d7e5-400d-9dc7-44fc2f6c5533 admin admin] PATH_INFO: `/v3/projects/d57902468b3746628ca506df9bca7068` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:44.008674 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7ec98-25ca-4c3a-9dda-cc3048bcdf4b admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:44.008955 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7ec98-25ca-4c3a-9dda-cc3048bcdf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:44.009231 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7ec98-25ca-4c3a-9dda-cc3048bcdf4b admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:44.009831 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5de29c-d7e5-400d-9dc7-44fc2f6c5533 admin admin] RBAC: Authorizing `identity:get_project(project_id=d57902468b3746628ca506df9bca7068)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:44.009987 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7ec98-25ca-4c3a-9dda-cc3048bcdf4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:44.011816 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7ec98-25ca-4c3a-9dda-cc3048bcdf4b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:44.011907 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5de29c-d7e5-400d-9dc7-44fc2f6c5533 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:44.014260 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 147/289] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:43 2021] GET /identity/v3/projects/d57902468b3746628ca506df9bca7068 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:44.020047 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5de29c-d7e5-400d-9dc7-44fc2f6c5533 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:44.030472 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5de29c-d7e5-400d-9dc7-44fc2f6c5533 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:44.034685 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4317b-ce30-476b-b957-9709570a2a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:44.035303 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4317b-ce30-476b-b957-9709570a2a26 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:44.035583 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4317b-ce30-476b-b957-9709570a2a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:44.035857 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4317b-ce30-476b-b957-9709570a2a26 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:44.036711 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4317b-ce30-476b-b957-9709570a2a26 admin admin] RBAC: Adding query filter params (role.id=52f47babce8e4dd7ae9b425160368b17, scope.project.id=d57902468b3746628ca506df9bca7068, user.id=e0a66e94cc9046f38618de8c4b6a1b1c) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:44.037019 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4317b-ce30-476b-b957-9709570a2a26 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:44.038834 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4317b-ce30-476b-b957-9709570a2a26 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:44.044622 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 148/290] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:15:44 2021] GET /identity/v3/role_assignments?user.id=e0a66e94cc9046f38618de8c4b6a1b1c&scope.project.id=d57902468b3746628ca506df9bca7068&role.id=52f47babce8e4dd7ae9b425160368b17 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:44.104478 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 143/291] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Nov 23 19:15:43 2021] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:15:45.366674 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b37271-1383-41f7-9fab-02004df20dae None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:45.367204 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b37271-1383-41f7-9fab-02004df20dae None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:45.367471 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b37271-1383-41f7-9fab-02004df20dae None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:45.369284 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 149/292] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:45.376589 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cbefa-379a-4225-bded-1b382d1ed034 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:45.377105 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cbefa-379a-4225-bded-1b382d1ed034 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:45.377389 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cbefa-379a-4225-bded-1b382d1ed034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:45.397676 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-e86cbefa-379a-4225-bded-1b382d1ed034 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:45.398887 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-e86cbefa-379a-4225-bded-1b382d1ed034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:45.408091 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 144/293] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:45 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:45.433170 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b37271-1383-41f7-9fab-02004df20dae None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:45.446331 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b37271-1383-41f7-9fab-02004df20dae None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:45.451701 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447e27d-c0ee-4057-a155-0bee2b07e729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:45.452718 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447e27d-c0ee-4057-a155-0bee2b07e729 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:45.453213 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447e27d-c0ee-4057-a155-0bee2b07e729 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:45.453709 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447e27d-c0ee-4057-a155-0bee2b07e729 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:45.464174 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447e27d-c0ee-4057-a155-0bee2b07e729 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:45.471495 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-8447e27d-c0ee-4057-a155-0bee2b07e729 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 19:15:45.473175 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 150/294] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:45 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:15:45.479123 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86cbefa-379a-4225-bded-1b382d1ed034 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:45.489128 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86cbefa-379a-4225-bded-1b382d1ed034 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:45.493600 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e9f4c-9cb8-489c-bc76-38188aaeb3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:45.494257 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e9f4c-9cb8-489c-bc76-38188aaeb3ca admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:45.494539 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e9f4c-9cb8-489c-bc76-38188aaeb3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:45.494809 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e9f4c-9cb8-489c-bc76-38188aaeb3ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:45.495565 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e9f4c-9cb8-489c-bc76-38188aaeb3ca admin admin] RBAC: Adding query filter params (name=member) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:45.495869 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e9f4c-9cb8-489c-bc76-38188aaeb3ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:45.498668 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e9f4c-9cb8-489c-bc76-38188aaeb3ca admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:45.507387 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 145/295] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Nov 23 19:15:45 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:45.514370 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447e27d-c0ee-4057-a155-0bee2b07e729 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:45.524631 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447e27d-c0ee-4057-a155-0bee2b07e729 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:45.530237 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07237e-4512-4457-b64e-b69aa8ef193e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:45.531095 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07237e-4512-4457-b64e-b69aa8ef193e admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:45.531373 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07237e-4512-4457-b64e-b69aa8ef193e admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:45.531640 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07237e-4512-4457-b64e-b69aa8ef193e admin admin] PATH_INFO: `/v3/users/b85d437dda0044f7b2a9baeef879b7c3` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:45.532855 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07237e-4512-4457-b64e-b69aa8ef193e admin admin] RBAC: Authorizing `identity:get_user(user_id=b85d437dda0044f7b2a9baeef879b7c3)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:45.535108 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07237e-4512-4457-b64e-b69aa8ef193e admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:45.536720 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 151/296] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:45 2021] GET /identity/v3/users/b85d437dda0044f7b2a9baeef879b7c3 => generated 297 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:45.542606 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e9f4c-9cb8-489c-bc76-38188aaeb3ca admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:45.553044 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e9f4c-9cb8-489c-bc76-38188aaeb3ca admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:45.557426 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139213a0-8217-414f-afb4-96c110f08d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:45.558073 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139213a0-8217-414f-afb4-96c110f08d71 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:45.558354 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139213a0-8217-414f-afb4-96c110f08d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:45.558632 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139213a0-8217-414f-afb4-96c110f08d71 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:45.571818 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139213a0-8217-414f-afb4-96c110f08d71 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:45.573595 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139213a0-8217-414f-afb4-96c110f08d71 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:45.582877 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 146/297] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:15:45 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:15:45.589037 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07237e-4512-4457-b64e-b69aa8ef193e admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:45.599466 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07237e-4512-4457-b64e-b69aa8ef193e admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:45.603863 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92fb99-9d0b-4273-9bf0-36d9a1ea7a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:45.604718 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92fb99-9d0b-4273-9bf0-36d9a1ea7a45 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:45.604998 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92fb99-9d0b-4273-9bf0-36d9a1ea7a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:45.605271 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92fb99-9d0b-4273-9bf0-36d9a1ea7a45 admin admin] PATH_INFO: `/v3/projects/d57902468b3746628ca506df9bca7068` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:45.607625 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92fb99-9d0b-4273-9bf0-36d9a1ea7a45 admin admin] RBAC: Authorizing `identity:get_project(project_id=d57902468b3746628ca506df9bca7068)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:45.609669 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92fb99-9d0b-4273-9bf0-36d9a1ea7a45 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:45.611630 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 152/298] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:45 2021] GET /identity/v3/projects/d57902468b3746628ca506df9bca7068 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:45.618114 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139213a0-8217-414f-afb4-96c110f08d71 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:45.627933 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139213a0-8217-414f-afb4-96c110f08d71 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:45.632357 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a830c-2551-4464-afd5-0a0287900116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:45.632990 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a830c-2551-4464-afd5-0a0287900116 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:45.633267 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a830c-2551-4464-afd5-0a0287900116 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:45.633581 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a830c-2551-4464-afd5-0a0287900116 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:45.634415 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a830c-2551-4464-afd5-0a0287900116 admin admin] RBAC: Adding query filter params (role.id=f8b0ca7636ad450b94f68df7bc4497aa, scope.project.id=d57902468b3746628ca506df9bca7068, user.id=b85d437dda0044f7b2a9baeef879b7c3) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:45.634727 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a830c-2551-4464-afd5-0a0287900116 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:45.636533 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a830c-2551-4464-afd5-0a0287900116 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:45.643172 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 147/299] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:15:45 2021] GET /identity/v3/role_assignments?user.id=b85d437dda0044f7b2a9baeef879b7c3&scope.project.id=d57902468b3746628ca506df9bca7068&role.id=f8b0ca7636ad450b94f68df7bc4497aa => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:46.382266 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5643bd-9d42-40bf-848b-8490ad2e7bbf None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:46.382825 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5643bd-9d42-40bf-848b-8490ad2e7bbf None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:46.382825 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5643bd-9d42-40bf-848b-8490ad2e7bbf None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:46.384617 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 153/300] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:46.391147 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea08308-80ba-4dee-b489-fc4b28f1411d None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:46.391932 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea08308-80ba-4dee-b489-fc4b28f1411d None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:46.392416 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea08308-80ba-4dee-b489-fc4b28f1411d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:46.410475 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-cea08308-80ba-4dee-b489-fc4b28f1411d None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:46.411907 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-cea08308-80ba-4dee-b489-fc4b28f1411d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:46.419914 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 148/301] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:46.442705 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5643bd-9d42-40bf-848b-8490ad2e7bbf None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:46.456010 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5643bd-9d42-40bf-848b-8490ad2e7bbf None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:46.460318 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aeb402-1d6c-4c76-b047-b09495d7d215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:46.461305 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aeb402-1d6c-4c76-b047-b09495d7d215 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:46.461757 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aeb402-1d6c-4c76-b047-b09495d7d215 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:46.462169 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aeb402-1d6c-4c76-b047-b09495d7d215 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:46.473121 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aeb402-1d6c-4c76-b047-b09495d7d215 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:46.480206 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-83aeb402-1d6c-4c76-b047-b09495d7d215 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 23 19:15:46.482056 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 154/302] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:46 2021] GET /identity/v3/roles/reader => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:15:46.488519 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea08308-80ba-4dee-b489-fc4b28f1411d None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:46.498320 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea08308-80ba-4dee-b489-fc4b28f1411d None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:46.502750 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997e61b-d12c-4347-a670-28856444811b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:46.503555 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997e61b-d12c-4347-a670-28856444811b admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:46.503973 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997e61b-d12c-4347-a670-28856444811b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:46.504396 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997e61b-d12c-4347-a670-28856444811b admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:46.505293 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997e61b-d12c-4347-a670-28856444811b admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:46.505779 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997e61b-d12c-4347-a670-28856444811b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:46.507481 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997e61b-d12c-4347-a670-28856444811b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:46.516183 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 149/303] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Nov 23 19:15:46 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:46.522658 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aeb402-1d6c-4c76-b047-b09495d7d215 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:46.525199 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc17a2-df14-4e41-b5be-5162123d060e None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:46.525515 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc17a2-df14-4e41-b5be-5162123d060e None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:46.525792 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc17a2-df14-4e41-b5be-5162123d060e None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:46.527632 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 150/304] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 19:15:46.529271 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c42acd-72e8-4c2d-8fc0-de7cd79e5c1e None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:46.529713 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c42acd-72e8-4c2d-8fc0-de7cd79e5c1e None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:46.529995 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c42acd-72e8-4c2d-8fc0-de7cd79e5c1e None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:46.531591 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 151/305] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:46.533827 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbb1e0-153c-40ad-b0e3-81eb71d1a979 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:46.534114 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbb1e0-153c-40ad-b0e3-81eb71d1a979 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:46.534389 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbb1e0-153c-40ad-b0e3-81eb71d1a979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:46.534484 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aeb402-1d6c-4c76-b047-b09495d7d215 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:46.538687 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4b02f-99ca-4fa7-b314-e6fc0ee1dea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:46.539520 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4b02f-99ca-4fa7-b314-e6fc0ee1dea8 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:46.539794 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4b02f-99ca-4fa7-b314-e6fc0ee1dea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:46.540080 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4b02f-99ca-4fa7-b314-e6fc0ee1dea8 admin admin] PATH_INFO: `/v3/users/e0a66e94cc9046f38618de8c4b6a1b1c` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:46.541263 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4b02f-99ca-4fa7-b314-e6fc0ee1dea8 admin admin] RBAC: Authorizing `identity:get_user(user_id=e0a66e94cc9046f38618de8c4b6a1b1c)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:46.543365 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4b02f-99ca-4fa7-b314-e6fc0ee1dea8 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:46.545684 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 155/306] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:46 2021] GET /identity/v3/users/e0a66e94cc9046f38618de8c4b6a1b1c => generated 297 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:46.546855 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf64beb-bf80-4293-abcf-eb7fc1a9efe3 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:46.547141 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf64beb-bf80-4293-abcf-eb7fc1a9efe3 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:46.547415 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf64beb-bf80-4293-abcf-eb7fc1a9efe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:46.553558 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-d4dbb1e0-153c-40ad-b0e3-81eb71d1a979 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:46.554743 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-d4dbb1e0-153c-40ad-b0e3-81eb71d1a979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:46.562402 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 152/307] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:46.563170 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dbb1e0-153c-40ad-b0e3-81eb71d1a979 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:46.564158 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-caf64beb-bf80-4293-abcf-eb7fc1a9efe3 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:46.565482 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-caf64beb-bf80-4293-abcf-eb7fc1a9efe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:46.572322 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dbb1e0-153c-40ad-b0e3-81eb71d1a979 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:46.573754 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 156/308] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:46.576773 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9fb93-2fb9-4686-a5af-676f224e310c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:46.581433 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9fb93-2fb9-4686-a5af-676f224e310c admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:46.581433 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9fb93-2fb9-4686-a5af-676f224e310c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:46.581433 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9fb93-2fb9-4686-a5af-676f224e310c admin admin] PATH_INFO: `/v3/projects/d57902468b3746628ca506df9bca7068` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:46.581433 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9fb93-2fb9-4686-a5af-676f224e310c admin admin] RBAC: Authorizing `identity:get_project(project_id=d57902468b3746628ca506df9bca7068)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:46.581433 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9fb93-2fb9-4686-a5af-676f224e310c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:46.587702 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 153/309] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:46 2021] GET /identity/v3/projects/d57902468b3746628ca506df9bca7068 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:46.589275 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf64beb-bf80-4293-abcf-eb7fc1a9efe3 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:46.589792 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9fb93-2fb9-4686-a5af-676f224e310c admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:46.599709 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf64beb-bf80-4293-abcf-eb7fc1a9efe3 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:46.600334 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9fb93-2fb9-4686-a5af-676f224e310c admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:46.604011 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79e60d-de6f-423c-a0c9-51da85971f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:46.604470 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a45626-b52d-4691-9503-ec67a486da0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:46.604886 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79e60d-de6f-423c-a0c9-51da85971f62 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:46.605165 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79e60d-de6f-423c-a0c9-51da85971f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:46.605284 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a45626-b52d-4691-9503-ec67a486da0e admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:46.605467 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79e60d-de6f-423c-a0c9-51da85971f62 admin admin] PATH_INFO: `/v3/projects/d57902468b3746628ca506df9bca7068/users/e0a66e94cc9046f38618de8c4b6a1b1c/roles/52f47babce8e4dd7ae9b425160368b17` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:46.605562 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a45626-b52d-4691-9503-ec67a486da0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:46.605786 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a45626-b52d-4691-9503-ec67a486da0e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:46.607442 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79e60d-de6f-423c-a0c9-51da85971f62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d57902468b3746628ca506df9bca7068, user_id=e0a66e94cc9046f38618de8c4b6a1b1c, role_id=52f47babce8e4dd7ae9b425160368b17)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:46.610012 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79e60d-de6f-423c-a0c9-51da85971f62 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:46.615750 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a45626-b52d-4691-9503-ec67a486da0e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:46.623435 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-e5a45626-b52d-4691-9503-ec67a486da0e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 19:15:46.624592 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 154/310] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:46 2021] GET /identity/v3/roles/member => generated 84 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:15:46.625355 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a45626-b52d-4691-9503-ec67a486da0e admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:46.634837 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a45626-b52d-4691-9503-ec67a486da0e admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:46.639536 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc91651-63c7-4ce4-8195-2be97757d1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:46.640233 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc91651-63c7-4ce4-8195-2be97757d1af admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:46.640509 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc91651-63c7-4ce4-8195-2be97757d1af admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:46.640776 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc91651-63c7-4ce4-8195-2be97757d1af admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:46.641953 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc91651-63c7-4ce4-8195-2be97757d1af admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:46.643602 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc91651-63c7-4ce4-8195-2be97757d1af admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:46.645098 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 155/311] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:15:46 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:46.645858 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc91651-63c7-4ce4-8195-2be97757d1af admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:46.654797 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc91651-63c7-4ce4-8195-2be97757d1af admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:46.658876 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1a687-0b50-4911-814a-aa027ef96a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:46.659440 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1a687-0b50-4911-814a-aa027ef96a93 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:46.659719 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1a687-0b50-4911-814a-aa027ef96a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:46.659989 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1a687-0b50-4911-814a-aa027ef96a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:46.660701 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1a687-0b50-4911-814a-aa027ef96a93 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:46.660996 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1a687-0b50-4911-814a-aa027ef96a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:46.662460 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1a687-0b50-4911-814a-aa027ef96a93 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:46.670463 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 156/312] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Nov 23 19:15:46 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:46.671185 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1a687-0b50-4911-814a-aa027ef96a93 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:46.679874 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1a687-0b50-4911-814a-aa027ef96a93 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:46.683999 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef9f4d-99fe-48a1-8041-7a37fb56ab44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:46.685109 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef9f4d-99fe-48a1-8041-7a37fb56ab44 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:46.685387 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef9f4d-99fe-48a1-8041-7a37fb56ab44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:46.685681 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef9f4d-99fe-48a1-8041-7a37fb56ab44 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:46.686361 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef9f4d-99fe-48a1-8041-7a37fb56ab44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:46.688297 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef9f4d-99fe-48a1-8041-7a37fb56ab44 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:46.704600 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 157/313] 10.222.0.62 () {58 vars in 1460 bytes} [Tue Nov 23 19:15:46 2021] PUT /identity/v3/projects/d57902468b3746628ca506df9bca7068/users/e0a66e94cc9046f38618de8c4b6a1b1c/roles/52f47babce8e4dd7ae9b425160368b17 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:15:46.705468 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79e60d-de6f-423c-a0c9-51da85971f62 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:46.745783 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 157/314] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Nov 23 19:15:46 2021] POST /identity/v3/users => generated 293 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:15:46.772553 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79e60d-de6f-423c-a0c9-51da85971f62 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:46.777305 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba39474-d773-49bc-a616-d56a89b3b569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:46.778883 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba39474-d773-49bc-a616-d56a89b3b569 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:46.779214 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba39474-d773-49bc-a616-d56a89b3b569 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:46.779491 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba39474-d773-49bc-a616-d56a89b3b569 admin admin] PATH_INFO: `/v3/users/d78c1c0ea0974e9b9e11195cc01841d6` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:46.797198 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba39474-d773-49bc-a616-d56a89b3b569 admin admin] RBAC: Authorizing `identity:get_user(user_id=d78c1c0ea0974e9b9e11195cc01841d6)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:46.799396 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba39474-d773-49bc-a616-d56a89b3b569 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:46.801435 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 158/315] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:46 2021] GET /identity/v3/users/d78c1c0ea0974e9b9e11195cc01841d6 => generated 293 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:46.807783 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef9f4d-99fe-48a1-8041-7a37fb56ab44 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:46.818149 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef9f4d-99fe-48a1-8041-7a37fb56ab44 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:46.822948 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa649e-45e2-47f2-be3d-a0eaf4dfe4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:46.823626 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa649e-45e2-47f2-be3d-a0eaf4dfe4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:46.823905 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa649e-45e2-47f2-be3d-a0eaf4dfe4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:46.824178 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa649e-45e2-47f2-be3d-a0eaf4dfe4f5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:46.825087 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa649e-45e2-47f2-be3d-a0eaf4dfe4f5 admin admin] RBAC: Adding query filter params (role.id=f8b0ca7636ad450b94f68df7bc4497aa, user.id=d78c1c0ea0974e9b9e11195cc01841d6, scope.system=all) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:46.825575 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa649e-45e2-47f2-be3d-a0eaf4dfe4f5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:46.827438 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa649e-45e2-47f2-be3d-a0eaf4dfe4f5 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:46.841737 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 158/316] 10.222.0.62 () {56 vars in 1329 bytes} [Tue Nov 23 19:15:46 2021] GET /identity/v3/role_assignments?user.id=d78c1c0ea0974e9b9e11195cc01841d6&scope.system=all&role.id=f8b0ca7636ad450b94f68df7bc4497aa => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:49.022345 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b88f4-3394-417f-a4fc-8b2f090f960e None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:49.022893 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b88f4-3394-417f-a4fc-8b2f090f960e None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:49.023164 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b88f4-3394-417f-a4fc-8b2f090f960e None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:49.025211 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 159/317] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:49.032950 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67343572-5c11-4776-b64f-4abfe9fba89a None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:49.033509 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67343572-5c11-4776-b64f-4abfe9fba89a None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:49.033719 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67343572-5c11-4776-b64f-4abfe9fba89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:49.054521 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-67343572-5c11-4776-b64f-4abfe9fba89a None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:49.055772 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-67343572-5c11-4776-b64f-4abfe9fba89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:49.064785 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 159/318] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:49 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:49.089452 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b88f4-3394-417f-a4fc-8b2f090f960e None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:49.101668 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b88f4-3394-417f-a4fc-8b2f090f960e None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:49.110078 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216f920-a611-4803-9838-97fb9be39751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:49.111117 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216f920-a611-4803-9838-97fb9be39751 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:49.111588 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216f920-a611-4803-9838-97fb9be39751 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:49.112075 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216f920-a611-4803-9838-97fb9be39751 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:49.119612 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823a4a8-5e69-44db-8448-2832d593ecbe None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:49.119953 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823a4a8-5e69-44db-8448-2832d593ecbe None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:49.120226 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823a4a8-5e69-44db-8448-2832d593ecbe None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:49.123029 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 160/319] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:49.126806 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216f920-a611-4803-9838-97fb9be39751 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:49.128698 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa43e04-e328-4058-ac88-a204c9c254b5 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:49.129021 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa43e04-e328-4058-ac88-a204c9c254b5 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:49.129328 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa43e04-e328-4058-ac88-a204c9c254b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:49.135257 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-f216f920-a611-4803-9838-97fb9be39751 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 23 19:15:49.136684 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 160/320] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:49 2021] GET /identity/v3/roles/reader => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:15:49.142807 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216f920-a611-4803-9838-97fb9be39751 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:49.150006 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-9aa43e04-e328-4058-ac88-a204c9c254b5 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:49.151183 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-9aa43e04-e328-4058-ac88-a204c9c254b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:49.155378 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216f920-a611-4803-9838-97fb9be39751 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:49.159310 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 161/321] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:49 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 19:15:49.162041 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b132d-b44a-4675-9f1d-cbf740a2aec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:49.162910 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b132d-b44a-4675-9f1d-cbf740a2aec9 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:49.163389 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b132d-b44a-4675-9f1d-cbf740a2aec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:49.163867 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b132d-b44a-4675-9f1d-cbf740a2aec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:49.164819 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b132d-b44a-4675-9f1d-cbf740a2aec9 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:49.165353 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b132d-b44a-4675-9f1d-cbf740a2aec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:49.167146 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b132d-b44a-4675-9f1d-cbf740a2aec9 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:49.177252 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 161/322] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Nov 23 19:15:49 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:49.183299 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b132d-b44a-4675-9f1d-cbf740a2aec9 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:49.184042 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa43e04-e328-4058-ac88-a204c9c254b5 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:49.196390 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa43e04-e328-4058-ac88-a204c9c254b5 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:49.196661 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b132d-b44a-4675-9f1d-cbf740a2aec9 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:49.201243 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf054ca-12b3-4ff8-8f21-42dc77037ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:49.202136 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf054ca-12b3-4ff8-8f21-42dc77037ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:49.202416 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf054ca-12b3-4ff8-8f21-42dc77037ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:49.202688 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf054ca-12b3-4ff8-8f21-42dc77037ea7 admin admin] PATH_INFO: `/v3/users/e0a66e94cc9046f38618de8c4b6a1b1c` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:49.202971 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f4891-89ed-4896-b3e0-bdc1ba36fc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:49.204005 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf054ca-12b3-4ff8-8f21-42dc77037ea7 admin admin] RBAC: Authorizing `identity:get_user(user_id=e0a66e94cc9046f38618de8c4b6a1b1c)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:49.204312 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f4891-89ed-4896-b3e0-bdc1ba36fc4b admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:49.204791 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f4891-89ed-4896-b3e0-bdc1ba36fc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:49.205252 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f4891-89ed-4896-b3e0-bdc1ba36fc4b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:49.206134 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf054ca-12b3-4ff8-8f21-42dc77037ea7 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:49.207757 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 162/323] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:49 2021] GET /identity/v3/users/e0a66e94cc9046f38618de8c4b6a1b1c => generated 297 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:49.213831 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf054ca-12b3-4ff8-8f21-42dc77037ea7 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:49.219325 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f4891-89ed-4896-b3e0-bdc1ba36fc4b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:49.224095 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf054ca-12b3-4ff8-8f21-42dc77037ea7 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:49.226477 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-829f4891-89ed-4896-b3e0-bdc1ba36fc4b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 19:15:49.229438 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 162/324] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:49 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:15:49.229438 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05bd91-edc3-4d1b-9cb0-06062a94c422 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:49.229438 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05bd91-edc3-4d1b-9cb0-06062a94c422 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:49.229438 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05bd91-edc3-4d1b-9cb0-06062a94c422 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:49.231175 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 163/325] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:49.232847 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842eca4b-f99b-4b93-bf16-bab135ba5308 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:49.233130 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842eca4b-f99b-4b93-bf16-bab135ba5308 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:49.233429 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842eca4b-f99b-4b93-bf16-bab135ba5308 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:49.233793 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff33ad-e342-475e-9a2d-2a5837c700c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:49.234659 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff33ad-e342-475e-9a2d-2a5837c700c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:49.235116 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff33ad-e342-475e-9a2d-2a5837c700c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:49.235221 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 164/326] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:49.235293 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff33ad-e342-475e-9a2d-2a5837c700c0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:49.235682 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842eca4b-f99b-4b93-bf16-bab135ba5308 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:49.245039 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff33ad-e342-475e-9a2d-2a5837c700c0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:49.246803 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff33ad-e342-475e-9a2d-2a5837c700c0 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:49.248261 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842eca4b-f99b-4b93-bf16-bab135ba5308 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:49.252436 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11bcc0-5265-4bdf-bfdf-ffebeeeb6122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:49.254912 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11bcc0-5265-4bdf-bfdf-ffebeeeb6122 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:49.254912 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11bcc0-5265-4bdf-bfdf-ffebeeeb6122 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:49.254912 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11bcc0-5265-4bdf-bfdf-ffebeeeb6122 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:49.254912 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11bcc0-5265-4bdf-bfdf-ffebeeeb6122 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:49.254912 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11bcc0-5265-4bdf-bfdf-ffebeeeb6122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:49.256157 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11bcc0-5265-4bdf-bfdf-ffebeeeb6122 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:49.261382 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 163/327] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:15:49 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:15:49.261382 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cf030-d7af-4859-9290-ed0da4353e3f None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:49.261382 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cf030-d7af-4859-9290-ed0da4353e3f None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:49.261382 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cf030-d7af-4859-9290-ed0da4353e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:49.269063 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 165/328] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Nov 23 19:15:49 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:49.270221 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b6c4d-2698-48bb-a2ec-c957729c8bfa None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:49.270510 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b6c4d-2698-48bb-a2ec-c957729c8bfa None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:49.270791 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b6c4d-2698-48bb-a2ec-c957729c8bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:49.276180 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-6f3cf030-d7af-4859-9290-ed0da4353e3f None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:49.277380 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-6f3cf030-d7af-4859-9290-ed0da4353e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:49.284900 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 164/329] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:49 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:49.286586 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cf030-d7af-4859-9290-ed0da4353e3f None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:49.287667 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-be8b6c4d-2698-48bb-a2ec-c957729c8bfa None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:49.288814 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-be8b6c4d-2698-48bb-a2ec-c957729c8bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:49.295836 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cf030-d7af-4859-9290-ed0da4353e3f None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:49.297396 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 166/330] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:49 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:49.298050 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b6c4d-2698-48bb-a2ec-c957729c8bfa None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:49.305525 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ea8f1-9877-447c-8314-29d15f32a5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:49.306664 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ea8f1-9877-447c-8314-29d15f32a5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:49.306790 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b6c4d-2698-48bb-a2ec-c957729c8bfa None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:49.307402 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ea8f1-9877-447c-8314-29d15f32a5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:49.307965 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ea8f1-9877-447c-8314-29d15f32a5f0 admin admin] PATH_INFO: `/v3/projects/d57902468b3746628ca506df9bca7068` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:49.310436 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ea8f1-9877-447c-8314-29d15f32a5f0 admin admin] RBAC: Authorizing `identity:get_project(project_id=d57902468b3746628ca506df9bca7068)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:49.311748 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91393a39-06e5-4774-a784-043baaaa6716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:49.312573 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91393a39-06e5-4774-a784-043baaaa6716 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:49.312676 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ea8f1-9877-447c-8314-29d15f32a5f0 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:49.312857 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91393a39-06e5-4774-a784-043baaaa6716 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:49.313129 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91393a39-06e5-4774-a784-043baaaa6716 admin admin] PATH_INFO: `/v3/users/d78c1c0ea0974e9b9e11195cc01841d6` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:49.314482 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 165/331] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:49 2021] GET /identity/v3/projects/d57902468b3746628ca506df9bca7068 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:49.314583 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91393a39-06e5-4774-a784-043baaaa6716 admin admin] RBAC: Authorizing `identity:get_user(user_id=d78c1c0ea0974e9b9e11195cc01841d6)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:49.316546 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91393a39-06e5-4774-a784-043baaaa6716 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:49.318250 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 167/332] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:49 2021] GET /identity/v3/users/d78c1c0ea0974e9b9e11195cc01841d6 => generated 293 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:49.320415 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ea8f1-9877-447c-8314-29d15f32a5f0 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:49.320520 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91393a39-06e5-4774-a784-043baaaa6716 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:49.329849 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91393a39-06e5-4774-a784-043baaaa6716 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:49.330142 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ea8f1-9877-447c-8314-29d15f32a5f0 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:49.334120 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a52f8-e096-4964-b5c1-d51c1c834f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:49.334329 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd97de9-e1dd-4c27-a4cf-8302ce5a349f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:49.334729 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a52f8-e096-4964-b5c1-d51c1c834f0f admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:49.335006 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a52f8-e096-4964-b5c1-d51c1c834f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:49.335092 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd97de9-e1dd-4c27-a4cf-8302ce5a349f admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:49.335280 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a52f8-e096-4964-b5c1-d51c1c834f0f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:49.335365 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd97de9-e1dd-4c27-a4cf-8302ce5a349f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:49.335650 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd97de9-e1dd-4c27-a4cf-8302ce5a349f admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:49.336106 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a52f8-e096-4964-b5c1-d51c1c834f0f admin admin] RBAC: Adding query filter params (role.id=52f47babce8e4dd7ae9b425160368b17, scope.project.id=d57902468b3746628ca506df9bca7068, user.id=e0a66e94cc9046f38618de8c4b6a1b1c) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:49.336415 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a52f8-e096-4964-b5c1-d51c1c834f0f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:49.338216 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a52f8-e096-4964-b5c1-d51c1c834f0f admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:49.343847 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 168/333] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:15:49 2021] GET /identity/v3/role_assignments?user.id=e0a66e94cc9046f38618de8c4b6a1b1c&scope.project.id=d57902468b3746628ca506df9bca7068&role.id=52f47babce8e4dd7ae9b425160368b17 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:49.344578 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a52f8-e096-4964-b5c1-d51c1c834f0f admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:49.347163 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd97de9-e1dd-4c27-a4cf-8302ce5a349f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:49.353842 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a52f8-e096-4964-b5c1-d51c1c834f0f admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:49.354505 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-6cd97de9-e1dd-4c27-a4cf-8302ce5a349f admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 23 19:15:49.355876 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 166/334] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:49 2021] GET /identity/v3/roles/reader => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:15:49.357357 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd97de9-e1dd-4c27-a4cf-8302ce5a349f admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:49.363923 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e1050-af59-4e62-ac13-3637f99e2b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:49.364819 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e1050-af59-4e62-ac13-3637f99e2b9c admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:49.365106 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e1050-af59-4e62-ac13-3637f99e2b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:49.365383 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e1050-af59-4e62-ac13-3637f99e2b9c admin admin] PATH_INFO: `/v3/system/users/d78c1c0ea0974e9b9e11195cc01841d6/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:49.367021 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e1050-af59-4e62-ac13-3637f99e2b9c admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d78c1c0ea0974e9b9e11195cc01841d6, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:49.368091 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING py.warnings [None req-687e1050-af59-4e62-ac13-3637f99e2b9c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_system_grant_for_user failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:15:49.368091 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: warnings.warn(msg) Nov 23 19:15:49.368091 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: Nov 23 19:15:49.368310 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd97de9-e1dd-4c27-a4cf-8302ce5a349f admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:49.368969 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e1050-af59-4e62-ac13-3637f99e2b9c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:49.372935 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91ce51-50f1-42c7-b95b-d598c06aab58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:49.373654 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91ce51-50f1-42c7-b95b-d598c06aab58 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:49.373944 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91ce51-50f1-42c7-b95b-d598c06aab58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:49.374219 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91ce51-50f1-42c7-b95b-d598c06aab58 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:49.375492 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a91ce51-50f1-42c7-b95b-d598c06aab58 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:49.377252 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a91ce51-50f1-42c7-b95b-d598c06aab58 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:49.378973 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 167/335] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:15:49 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:49.382426 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91ce51-50f1-42c7-b95b-d598c06aab58 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:49.392988 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91ce51-50f1-42c7-b95b-d598c06aab58 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:49.397314 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a569c52-97ea-4d13-9c38-ed3ebf2586e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:49.398018 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a569c52-97ea-4d13-9c38-ed3ebf2586e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:49.398299 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a569c52-97ea-4d13-9c38-ed3ebf2586e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:49.398570 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a569c52-97ea-4d13-9c38-ed3ebf2586e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:49.399342 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a569c52-97ea-4d13-9c38-ed3ebf2586e2 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:49.399671 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a569c52-97ea-4d13-9c38-ed3ebf2586e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:49.401272 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a569c52-97ea-4d13-9c38-ed3ebf2586e2 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:49.410930 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 168/336] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Nov 23 19:15:49 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:49.411594 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a569c52-97ea-4d13-9c38-ed3ebf2586e2 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:49.422248 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a569c52-97ea-4d13-9c38-ed3ebf2586e2 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:49.426797 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4193a-86b9-441f-82ce-3c5c95e48019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:49.427477 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4193a-86b9-441f-82ce-3c5c95e48019 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:49.427756 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4193a-86b9-441f-82ce-3c5c95e48019 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:49.428026 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4193a-86b9-441f-82ce-3c5c95e48019 admin admin] PATH_INFO: `/v3/groups` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:49.430421 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4193a-86b9-441f-82ce-3c5c95e48019 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:49.430421 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING py.warnings [None req-0ba4193a-86b9-441f-82ce-3c5c95e48019 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:15:49.430421 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: warnings.warn(msg) Nov 23 19:15:49.430421 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: Nov 23 19:15:49.430949 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4193a-86b9-441f-82ce-3c5c95e48019 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:49.442360 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 169/337] 10.222.0.62 () {58 vars in 1355 bytes} [Tue Nov 23 19:15:49 2021] PUT /identity/v3/system/users/d78c1c0ea0974e9b9e11195cc01841d6/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:15:49.443400 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e1050-af59-4e62-ac13-3637f99e2b9c admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:49.455170 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e1050-af59-4e62-ac13-3637f99e2b9c admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:49.459910 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335be326-3463-408f-8cef-e9986ede23aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:49.460847 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335be326-3463-408f-8cef-e9986ede23aa admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:49.461112 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335be326-3463-408f-8cef-e9986ede23aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:49.461388 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335be326-3463-408f-8cef-e9986ede23aa admin admin] PATH_INFO: `/v3/users/cd4dea87cea64becb47792b9fba01ed5` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:49.479542 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335be326-3463-408f-8cef-e9986ede23aa admin admin] RBAC: Authorizing `identity:get_user(user_id=cd4dea87cea64becb47792b9fba01ed5)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:49.482305 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335be326-3463-408f-8cef-e9986ede23aa admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:49.484445 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 170/338] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:49 2021] GET /identity/v3/users/cd4dea87cea64becb47792b9fba01ed5 => generated 293 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:49.490696 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335be326-3463-408f-8cef-e9986ede23aa admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:49.505448 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 169/339] 10.222.0.62 () {60 vars in 1155 bytes} [Tue Nov 23 19:15:49 2021] POST /identity/v3/groups => generated 229 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:15:49.508838 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335be326-3463-408f-8cef-e9986ede23aa admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:49.516443 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f2299-9927-4cc0-a06f-f4a551e380ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:49.517215 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f2299-9927-4cc0-a06f-f4a551e380ac admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:49.517541 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f2299-9927-4cc0-a06f-f4a551e380ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:49.517822 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f2299-9927-4cc0-a06f-f4a551e380ac admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:49.518799 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f2299-9927-4cc0-a06f-f4a551e380ac admin admin] RBAC: Adding query filter params (role.id=52f47babce8e4dd7ae9b425160368b17, user.id=cd4dea87cea64becb47792b9fba01ed5, scope.system=all) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:49.519106 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f2299-9927-4cc0-a06f-f4a551e380ac admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:49.521619 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f2299-9927-4cc0-a06f-f4a551e380ac admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:49.537335 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 171/340] 10.222.0.62 () {56 vars in 1329 bytes} [Tue Nov 23 19:15:49 2021] GET /identity/v3/role_assignments?user.id=cd4dea87cea64becb47792b9fba01ed5&scope.system=all&role.id=52f47babce8e4dd7ae9b425160368b17 => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:51.788799 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd52a97-1c4b-480b-ab4f-513965919c8c None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:51.788799 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd52a97-1c4b-480b-ab4f-513965919c8c None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:51.788799 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd52a97-1c4b-480b-ab4f-513965919c8c None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:51.789566 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 170/341] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:51.796683 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b4053-6357-46fc-a0a4-ed78e7b1574d None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:51.797242 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b4053-6357-46fc-a0a4-ed78e7b1574d None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:51.797242 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b4053-6357-46fc-a0a4-ed78e7b1574d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:51.816657 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-e26b4053-6357-46fc-a0a4-ed78e7b1574d None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:51.817906 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-e26b4053-6357-46fc-a0a4-ed78e7b1574d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:51.827113 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 172/342] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:51.851561 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd52a97-1c4b-480b-ab4f-513965919c8c None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:51.863966 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd52a97-1c4b-480b-ab4f-513965919c8c None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:51.868108 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839013f-7e90-481d-9257-e23f94dcf5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:51.868887 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839013f-7e90-481d-9257-e23f94dcf5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:51.869168 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839013f-7e90-481d-9257-e23f94dcf5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:51.869472 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839013f-7e90-481d-9257-e23f94dcf5f6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:51.881016 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839013f-7e90-481d-9257-e23f94dcf5f6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:51.889079 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-8839013f-7e90-481d-9257-e23f94dcf5f6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 19:15:51.890548 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 171/343] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:51 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:15:51.896529 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b4053-6357-46fc-a0a4-ed78e7b1574d None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:51.905965 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b4053-6357-46fc-a0a4-ed78e7b1574d None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:51.910408 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a0b390-7bf4-434b-82fa-5d66fcb91034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:51.911137 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0b390-7bf4-434b-82fa-5d66fcb91034 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:51.911492 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0b390-7bf4-434b-82fa-5d66fcb91034 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:51.911840 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0b390-7bf4-434b-82fa-5d66fcb91034 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:51.912664 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a0b390-7bf4-434b-82fa-5d66fcb91034 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:51.913039 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a0b390-7bf4-434b-82fa-5d66fcb91034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:51.914741 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a0b390-7bf4-434b-82fa-5d66fcb91034 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:51.923394 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 173/344] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Nov 23 19:15:51 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:51.929281 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839013f-7e90-481d-9257-e23f94dcf5f6 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:51.932022 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f05ce-7f6d-4dd1-8098-b2dac7ebe163 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:51.932312 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f05ce-7f6d-4dd1-8098-b2dac7ebe163 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:51.932590 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f05ce-7f6d-4dd1-8098-b2dac7ebe163 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:51.935014 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 174/345] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 19:15:51.939992 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839013f-7e90-481d-9257-e23f94dcf5f6 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:51.940906 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b264bf-c4cd-416b-98d1-a9f52dcffc53 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:51.941193 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b264bf-c4cd-416b-98d1-a9f52dcffc53 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:51.941508 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b264bf-c4cd-416b-98d1-a9f52dcffc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:51.944333 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1bd98-0bb6-4faa-89d1-821500d39299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:51.945466 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1bd98-0bb6-4faa-89d1-821500d39299 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:51.945759 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1bd98-0bb6-4faa-89d1-821500d39299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:51.946033 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1bd98-0bb6-4faa-89d1-821500d39299 admin admin] PATH_INFO: `/v3/users/d78c1c0ea0974e9b9e11195cc01841d6` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:51.947229 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba1bd98-0bb6-4faa-89d1-821500d39299 admin admin] RBAC: Authorizing `identity:get_user(user_id=d78c1c0ea0974e9b9e11195cc01841d6)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:51.949393 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba1bd98-0bb6-4faa-89d1-821500d39299 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:51.956942 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 172/346] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:51 2021] GET /identity/v3/users/d78c1c0ea0974e9b9e11195cc01841d6 => generated 293 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:51.957785 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1bd98-0bb6-4faa-89d1-821500d39299 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:51.960495 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-64b264bf-c4cd-416b-98d1-a9f52dcffc53 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:51.961691 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-64b264bf-c4cd-416b-98d1-a9f52dcffc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:51.967490 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1bd98-0bb6-4faa-89d1-821500d39299 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:51.969960 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 175/347] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:51.971938 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb7ab3-aef8-49d4-937d-5787267c2102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:51.972608 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb7ab3-aef8-49d4-937d-5787267c2102 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:51.972855 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb7ab3-aef8-49d4-937d-5787267c2102 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:51.973131 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb7ab3-aef8-49d4-937d-5787267c2102 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:51.974006 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb7ab3-aef8-49d4-937d-5787267c2102 admin admin] RBAC: Adding query filter params (role.id=f8b0ca7636ad450b94f68df7bc4497aa, user.id=d78c1c0ea0974e9b9e11195cc01841d6, scope.system=all) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:51.974320 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb7ab3-aef8-49d4-937d-5787267c2102 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:51.976148 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb7ab3-aef8-49d4-937d-5787267c2102 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:51.977633 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aeeb0b-9037-48ad-b339-60fb8fee05e1 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:51.977922 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aeeb0b-9037-48ad-b339-60fb8fee05e1 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:51.978195 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aeeb0b-9037-48ad-b339-60fb8fee05e1 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:51.980024 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 176/348] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 19:15:51.985565 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cb451-3535-4f8c-bee9-0eb56221334a None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:51.989113 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cb451-3535-4f8c-bee9-0eb56221334a None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:51.989113 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cb451-3535-4f8c-bee9-0eb56221334a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:51.994713 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 173/349] 10.222.0.62 () {56 vars in 1329 bytes} [Tue Nov 23 19:15:51 2021] GET /identity/v3/role_assignments?user.id=d78c1c0ea0974e9b9e11195cc01841d6&scope.system=all&role.id=f8b0ca7636ad450b94f68df7bc4497aa => generated 510 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:51.996552 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb7ab3-aef8-49d4-937d-5787267c2102 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:52.004879 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-f85cb451-3535-4f8c-bee9-0eb56221334a None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:52.006214 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-f85cb451-3535-4f8c-bee9-0eb56221334a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:52.007697 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb7ab3-aef8-49d4-937d-5787267c2102 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:52.012368 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a01c84-6387-4bb1-914d-c1c034a163e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:52.013754 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a01c84-6387-4bb1-914d-c1c034a163e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:52.014043 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a01c84-6387-4bb1-914d-c1c034a163e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:52.014322 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a01c84-6387-4bb1-914d-c1c034a163e6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:52.014831 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 177/350] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 19:15:52.015750 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a01c84-6387-4bb1-914d-c1c034a163e6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:52.017516 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a01c84-6387-4bb1-914d-c1c034a163e6 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:52.019324 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 174/351] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:15:51 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:52.025471 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85cb451-3535-4f8c-bee9-0eb56221334a None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:52.036896 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85cb451-3535-4f8c-bee9-0eb56221334a None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:52.039697 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a01c84-6387-4bb1-914d-c1c034a163e6 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:52.041721 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54d23c-3692-4b7e-a043-7c9540b1b138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:52.042400 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54d23c-3692-4b7e-a043-7c9540b1b138 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:52.042684 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54d23c-3692-4b7e-a043-7c9540b1b138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:52.042959 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54d23c-3692-4b7e-a043-7c9540b1b138 admin admin] PATH_INFO: `/v3/groups` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:52.043671 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54d23c-3692-4b7e-a043-7c9540b1b138 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:52.046000 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING py.warnings [None req-4c54d23c-3692-4b7e-a043-7c9540b1b138 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:15:52.046000 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: warnings.warn(msg) Nov 23 19:15:52.046000 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: Nov 23 19:15:52.047178 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54d23c-3692-4b7e-a043-7c9540b1b138 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:52.052954 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a01c84-6387-4bb1-914d-c1c034a163e6 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:52.057496 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62aab1-79fc-4745-8931-586b36c3b57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:52.058318 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62aab1-79fc-4745-8931-586b36c3b57d admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:52.058600 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62aab1-79fc-4745-8931-586b36c3b57d admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:52.058875 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62aab1-79fc-4745-8931-586b36c3b57d admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:52.071256 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62aab1-79fc-4745-8931-586b36c3b57d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:52.079338 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-cc62aab1-79fc-4745-8931-586b36c3b57d admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 23 19:15:52.080587 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 175/352] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:52 2021] GET /identity/v3/roles/reader => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:15:52.087117 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62aab1-79fc-4745-8931-586b36c3b57d admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:52.099865 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62aab1-79fc-4745-8931-586b36c3b57d admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:52.104289 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7129c-f329-43d9-be62-0095cabf7f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:52.104953 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7129c-f329-43d9-be62-0095cabf7f12 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:52.105241 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7129c-f329-43d9-be62-0095cabf7f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:52.105562 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7129c-f329-43d9-be62-0095cabf7f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:52.106340 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c7129c-f329-43d9-be62-0095cabf7f12 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:52.107366 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c7129c-f329-43d9-be62-0095cabf7f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:52.109068 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c7129c-f329-43d9-be62-0095cabf7f12 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:52.118187 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 176/353] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Nov 23 19:15:52 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:52.125617 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7129c-f329-43d9-be62-0095cabf7f12 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:52.135624 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7129c-f329-43d9-be62-0095cabf7f12 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:52.140124 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada5789-3231-4621-9469-f69b219ce956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:52.141007 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada5789-3231-4621-9469-f69b219ce956 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:52.141295 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada5789-3231-4621-9469-f69b219ce956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:52.141607 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada5789-3231-4621-9469-f69b219ce956 admin admin] PATH_INFO: `/v3/users/cd4dea87cea64becb47792b9fba01ed5` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:52.142870 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada5789-3231-4621-9469-f69b219ce956 admin admin] RBAC: Authorizing `identity:get_user(user_id=cd4dea87cea64becb47792b9fba01ed5)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:52.145030 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada5789-3231-4621-9469-f69b219ce956 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:52.146745 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 177/354] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:52 2021] GET /identity/v3/users/cd4dea87cea64becb47792b9fba01ed5 => generated 293 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:52.153007 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada5789-3231-4621-9469-f69b219ce956 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:52.162938 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada5789-3231-4621-9469-f69b219ce956 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:52.167319 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d32c3-9264-48d5-a69e-c1edf4e2b1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:52.168187 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d32c3-9264-48d5-a69e-c1edf4e2b1b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:52.168471 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d32c3-9264-48d5-a69e-c1edf4e2b1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:52.168748 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d32c3-9264-48d5-a69e-c1edf4e2b1b8 admin admin] PATH_INFO: `/v3/system/users/cd4dea87cea64becb47792b9fba01ed5/roles/52f47babce8e4dd7ae9b425160368b17` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:52.170902 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d32c3-9264-48d5-a69e-c1edf4e2b1b8 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cd4dea87cea64becb47792b9fba01ed5, role_id=52f47babce8e4dd7ae9b425160368b17)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:52.171927 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING py.warnings [None req-9f4d32c3-9264-48d5-a69e-c1edf4e2b1b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_system_grant_for_user failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:15:52.171927 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: warnings.warn(msg) Nov 23 19:15:52.171927 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: Nov 23 19:15:52.172814 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d32c3-9264-48d5-a69e-c1edf4e2b1b8 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:52.241629 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 178/355] 10.222.0.62 () {60 vars in 1155 bytes} [Tue Nov 23 19:15:52 2021] POST /identity/v3/groups => generated 226 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:15:52.265472 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 178/356] 10.222.0.62 () {58 vars in 1355 bytes} [Tue Nov 23 19:15:52 2021] PUT /identity/v3/system/users/cd4dea87cea64becb47792b9fba01ed5/roles/52f47babce8e4dd7ae9b425160368b17 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:15:54.879600 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca7b6c-7df1-4583-99c8-e6dc302797a7 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:54.880605 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca7b6c-7df1-4583-99c8-e6dc302797a7 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:54.881143 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca7b6c-7df1-4583-99c8-e6dc302797a7 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:54.883531 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 179/357] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:54 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:54.893319 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3492b0-76b3-456f-acf6-21e1c63d2b7a None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:54.893853 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3492b0-76b3-456f-acf6-21e1c63d2b7a None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:54.893926 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3492b0-76b3-456f-acf6-21e1c63d2b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:54.925984 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-8a3492b0-76b3-456f-acf6-21e1c63d2b7a None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:54.927211 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-8a3492b0-76b3-456f-acf6-21e1c63d2b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:54.938924 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 179/358] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:55.006953 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca7b6c-7df1-4583-99c8-e6dc302797a7 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:55.023442 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca7b6c-7df1-4583-99c8-e6dc302797a7 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:55.031877 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ed8d5-c233-4a0d-b0a9-305e127f140c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:55.032674 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ed8d5-c233-4a0d-b0a9-305e127f140c admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:55.032956 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ed8d5-c233-4a0d-b0a9-305e127f140c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:55.033233 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ed8d5-c233-4a0d-b0a9-305e127f140c admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:55.047404 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ed8d5-c233-4a0d-b0a9-305e127f140c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:55.055139 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-230ed8d5-c233-4a0d-b0a9-305e127f140c admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 23 19:15:55.057084 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 180/359] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:55 2021] GET /identity/v3/roles/reader => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:15:55.064150 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3492b0-76b3-456f-acf6-21e1c63d2b7a None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:55.079027 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3492b0-76b3-456f-acf6-21e1c63d2b7a None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:55.084218 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002a7ac-6135-4420-8e08-8658805f98e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:55.085122 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002a7ac-6135-4420-8e08-8658805f98e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:55.085645 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002a7ac-6135-4420-8e08-8658805f98e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:55.089844 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002a7ac-6135-4420-8e08-8658805f98e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:55.090974 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a002a7ac-6135-4420-8e08-8658805f98e1 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:55.091496 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a002a7ac-6135-4420-8e08-8658805f98e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:55.093349 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a002a7ac-6135-4420-8e08-8658805f98e1 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:55.105102 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 180/360] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Nov 23 19:15:55 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:55.110560 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25689f99-ef96-42bd-89eb-4d508d938bf2 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:55.110949 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25689f99-ef96-42bd-89eb-4d508d938bf2 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:55.111123 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25689f99-ef96-42bd-89eb-4d508d938bf2 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:55.112472 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002a7ac-6135-4420-8e08-8658805f98e1 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:55.112909 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 181/361] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:55.124923 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35231a-b64d-4a4e-a1f4-696b100502f3 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:55.125200 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35231a-b64d-4a4e-a1f4-696b100502f3 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:55.125506 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35231a-b64d-4a4e-a1f4-696b100502f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:55.126867 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002a7ac-6135-4420-8e08-8658805f98e1 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:55.136848 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125b7d8-b980-45ed-ad07-02c62321e3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:55.137743 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125b7d8-b980-45ed-ad07-02c62321e3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:55.138103 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125b7d8-b980-45ed-ad07-02c62321e3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:55.138325 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125b7d8-b980-45ed-ad07-02c62321e3e3 admin admin] PATH_INFO: `/v3/users/cd4dea87cea64becb47792b9fba01ed5` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:55.142190 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125b7d8-b980-45ed-ad07-02c62321e3e3 admin admin] RBAC: Authorizing `identity:get_user(user_id=cd4dea87cea64becb47792b9fba01ed5)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:55.144298 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125b7d8-b980-45ed-ad07-02c62321e3e3 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:55.146284 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 181/362] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:15:55 2021] GET /identity/v3/users/cd4dea87cea64becb47792b9fba01ed5 => generated 293 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:55.153793 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125b7d8-b980-45ed-ad07-02c62321e3e3 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:55.166412 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125b7d8-b980-45ed-ad07-02c62321e3e3 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:55.166595 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-fc35231a-b64d-4a4e-a1f4-696b100502f3 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:55.167649 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-fc35231a-b64d-4a4e-a1f4-696b100502f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:55.178731 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6906a39-be05-4d31-8a74-5eac3c8fea2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:55.179400 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6906a39-be05-4d31-8a74-5eac3c8fea2b admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:55.179687 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6906a39-be05-4d31-8a74-5eac3c8fea2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:55.179966 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6906a39-be05-4d31-8a74-5eac3c8fea2b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:55.180820 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6906a39-be05-4d31-8a74-5eac3c8fea2b admin admin] RBAC: Adding query filter params (role.id=52f47babce8e4dd7ae9b425160368b17, user.id=cd4dea87cea64becb47792b9fba01ed5, scope.system=all) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:55.181192 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6906a39-be05-4d31-8a74-5eac3c8fea2b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:55.183131 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6906a39-be05-4d31-8a74-5eac3c8fea2b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:55.191657 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 182/363] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Nov 23 19:15:55.204758 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 182/364] 10.222.0.62 () {56 vars in 1329 bytes} [Tue Nov 23 19:15:55 2021] GET /identity/v3/role_assignments?user.id=cd4dea87cea64becb47792b9fba01ed5&scope.system=all&role.id=52f47babce8e4dd7ae9b425160368b17 => generated 510 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:55.227318 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220930d-e470-49bb-87ae-f74954bd9e79 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:55.227675 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220930d-e470-49bb-87ae-f74954bd9e79 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:55.227874 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220930d-e470-49bb-87ae-f74954bd9e79 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:55.229965 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 183/365] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:55.241160 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86548030-55e8-4136-a8d7-522aa282dde0 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:55.241515 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86548030-55e8-4136-a8d7-522aa282dde0 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:55.241752 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86548030-55e8-4136-a8d7-522aa282dde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:55.244498 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220930d-e470-49bb-87ae-f74954bd9e79 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:55.263788 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220930d-e470-49bb-87ae-f74954bd9e79 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:55.274712 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-86548030-55e8-4136-a8d7-522aa282dde0 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:55.275978 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-86548030-55e8-4136-a8d7-522aa282dde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:55.279026 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f41c4e-30ce-48c4-8f05-99380e31ddf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:55.279866 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f41c4e-30ce-48c4-8f05-99380e31ddf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:55.280152 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f41c4e-30ce-48c4-8f05-99380e31ddf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:55.280430 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f41c4e-30ce-48c4-8f05-99380e31ddf3 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:55.289467 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 183/366] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 19:15:55.298479 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f41c4e-30ce-48c4-8f05-99380e31ddf3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:55.310670 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-31f41c4e-30ce-48c4-8f05-99380e31ddf3 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 19:15:55.312340 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 184/367] 10.222.0.62 () {56 vars in 1135 bytes} [Tue Nov 23 19:15:55 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:15:55.318597 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86548030-55e8-4136-a8d7-522aa282dde0 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:55.334213 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86548030-55e8-4136-a8d7-522aa282dde0 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:55.338269 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f41c4e-30ce-48c4-8f05-99380e31ddf3 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:55.346271 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458d7cd-e017-4d3f-904a-fd2f9cd40a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:55.346976 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458d7cd-e017-4d3f-904a-fd2f9cd40a49 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:55.347261 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458d7cd-e017-4d3f-904a-fd2f9cd40a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:55.347542 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458d7cd-e017-4d3f-904a-fd2f9cd40a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:55.348839 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458d7cd-e017-4d3f-904a-fd2f9cd40a49 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:55.348839 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458d7cd-e017-4d3f-904a-fd2f9cd40a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:55.350344 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458d7cd-e017-4d3f-904a-fd2f9cd40a49 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:55.352399 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f41c4e-30ce-48c4-8f05-99380e31ddf3 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:55.361269 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 184/368] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:15:55 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:55.366222 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c4fcd-37a5-4f25-9fba-ab444f04171d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:55.367051 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c4fcd-37a5-4f25-9fba-ab444f04171d admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:55.367217 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458d7cd-e017-4d3f-904a-fd2f9cd40a49 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:55.367386 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c4fcd-37a5-4f25-9fba-ab444f04171d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:55.367590 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c4fcd-37a5-4f25-9fba-ab444f04171d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:55.382056 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458d7cd-e017-4d3f-904a-fd2f9cd40a49 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:55.390475 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870cefd-a3a2-4523-8ff3-8430089ce17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:55.391511 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870cefd-a3a2-4523-8ff3-8430089ce17f admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:55.391802 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870cefd-a3a2-4523-8ff3-8430089ce17f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:55.392083 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870cefd-a3a2-4523-8ff3-8430089ce17f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:55.394704 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c4fcd-37a5-4f25-9fba-ab444f04171d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:55.403250 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-e21c4fcd-37a5-4f25-9fba-ab444f04171d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 19:15:55.405388 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 185/369] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:55 2021] GET /identity/v3/roles/member => generated 84 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:15:55.409733 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5870cefd-a3a2-4523-8ff3-8430089ce17f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:55.411498 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5870cefd-a3a2-4523-8ff3-8430089ce17f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:55.412341 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c4fcd-37a5-4f25-9fba-ab444f04171d admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:55.427806 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 185/370] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:15:55 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 23 19:15:55.433906 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870cefd-a3a2-4523-8ff3-8430089ce17f admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:55.436343 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c4fcd-37a5-4f25-9fba-ab444f04171d admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:55.446128 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870cefd-a3a2-4523-8ff3-8430089ce17f admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:55.454881 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79fc48-99ad-4ef7-acc3-2ecc2180063d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:55.455204 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37421ce8-ca14-47a7-811c-449d9c1d42f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:55.455676 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37421ce8-ca14-47a7-811c-449d9c1d42f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:55.455858 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79fc48-99ad-4ef7-acc3-2ecc2180063d admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:55.456003 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37421ce8-ca14-47a7-811c-449d9c1d42f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:55.456145 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79fc48-99ad-4ef7-acc3-2ecc2180063d admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:55.456297 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37421ce8-ca14-47a7-811c-449d9c1d42f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:55.456438 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79fc48-99ad-4ef7-acc3-2ecc2180063d admin admin] PATH_INFO: `/v3/projects/febc4f33fba1433992fc8e043a47dd5c` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:55.456975 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37421ce8-ca14-47a7-811c-449d9c1d42f1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:55.457281 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37421ce8-ca14-47a7-811c-449d9c1d42f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:55.458461 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79fc48-99ad-4ef7-acc3-2ecc2180063d admin admin] RBAC: Authorizing `identity:get_project(project_id=febc4f33fba1433992fc8e043a47dd5c)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:55.458921 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37421ce8-ca14-47a7-811c-449d9c1d42f1 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:55.460606 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79fc48-99ad-4ef7-acc3-2ecc2180063d admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:55.462752 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 186/371] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:55 2021] GET /identity/v3/projects/febc4f33fba1433992fc8e043a47dd5c => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:55.469753 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79fc48-99ad-4ef7-acc3-2ecc2180063d admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:55.477225 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 186/372] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Nov 23 19:15:55 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:55.483859 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37421ce8-ca14-47a7-811c-449d9c1d42f1 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:55.484627 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79fc48-99ad-4ef7-acc3-2ecc2180063d admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:55.493523 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea269a9-b942-4b43-bf20-644646e52680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:55.494454 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea269a9-b942-4b43-bf20-644646e52680 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:55.494737 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea269a9-b942-4b43-bf20-644646e52680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:55.495017 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea269a9-b942-4b43-bf20-644646e52680 admin admin] PATH_INFO: `/v3/groups/5a59719437d94ebbb0ac266175d5c666` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:55.505184 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea269a9-b942-4b43-bf20-644646e52680 admin admin] RBAC: Authorizing `identity:get_group(group_id=5a59719437d94ebbb0ac266175d5c666)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:55.506310 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING py.warnings [None req-eea269a9-b942-4b43-bf20-644646e52680 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:15:55.506310 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: warnings.warn(msg) Nov 23 19:15:55.506310 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: Nov 23 19:15:55.507503 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea269a9-b942-4b43-bf20-644646e52680 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:55.507961 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37421ce8-ca14-47a7-811c-449d9c1d42f1 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:55.509309 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 187/373] 10.222.0.62 () {56 vars in 1201 bytes} [Tue Nov 23 19:15:55 2021] GET /identity/v3/groups/5a59719437d94ebbb0ac266175d5c666 => generated 226 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:55.517180 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea269a9-b942-4b43-bf20-644646e52680 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:55.525511 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b624fd-b2ef-4feb-993f-a79e9f04a091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:55.526176 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b624fd-b2ef-4feb-993f-a79e9f04a091 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:55.526458 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b624fd-b2ef-4feb-993f-a79e9f04a091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:55.526733 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b624fd-b2ef-4feb-993f-a79e9f04a091 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:55.535078 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea269a9-b942-4b43-bf20-644646e52680 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:55.541514 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b624fd-b2ef-4feb-993f-a79e9f04a091 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:55.543334 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b624fd-b2ef-4feb-993f-a79e9f04a091 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:55.553571 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19304d96-623c-4b47-afcc-8b66c6c63034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:55.553571 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19304d96-623c-4b47-afcc-8b66c6c63034 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:55.553571 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19304d96-623c-4b47-afcc-8b66c6c63034 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:55.553571 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19304d96-623c-4b47-afcc-8b66c6c63034 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:55.555596 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19304d96-623c-4b47-afcc-8b66c6c63034 admin admin] RBAC: Adding query filter params (group.id=5a59719437d94ebbb0ac266175d5c666, role.id=bc8a8682d8f748788fb70d235f9978dc, scope.project.id=febc4f33fba1433992fc8e043a47dd5c) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:55.555596 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19304d96-623c-4b47-afcc-8b66c6c63034 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:55.555908 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 187/374] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:15:55 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 23 19:15:55.555908 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988d6e7-6ee9-4c9c-9449-009290772391 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:55.556178 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988d6e7-6ee9-4c9c-9449-009290772391 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:55.556324 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988d6e7-6ee9-4c9c-9449-009290772391 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:55.558190 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 188/375] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:55.559885 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19304d96-623c-4b47-afcc-8b66c6c63034 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:55.569252 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988d6e7-6ee9-4c9c-9449-009290772391 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:55.570217 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 188/376] 10.222.0.62 () {56 vars in 1397 bytes} [Tue Nov 23 19:15:55 2021] GET /identity/v3/role_assignments?group.id=5a59719437d94ebbb0ac266175d5c666&scope.project.id=febc4f33fba1433992fc8e043a47dd5c&role.id=bc8a8682d8f748788fb70d235f9978dc => generated 260 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:55.572136 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692094e-6890-468c-95db-d28395c65ebf None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:55.572636 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692094e-6890-468c-95db-d28395c65ebf None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:55.573137 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692094e-6890-468c-95db-d28395c65ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:55.596992 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-6692094e-6890-468c-95db-d28395c65ebf None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:55.599423 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988d6e7-6ee9-4c9c-9449-009290772391 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:55.601004 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-6692094e-6890-468c-95db-d28395c65ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:55.610447 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fcf67-1594-4922-bf9e-aa91537cabd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:55.611322 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fcf67-1594-4922-bf9e-aa91537cabd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:55.612191 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fcf67-1594-4922-bf9e-aa91537cabd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:55.612191 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fcf67-1594-4922-bf9e-aa91537cabd5 admin admin] PATH_INFO: `/v3/projects/febc4f33fba1433992fc8e043a47dd5c` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:55.613378 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543fcf67-1594-4922-bf9e-aa91537cabd5 admin admin] RBAC: Authorizing `identity:get_project(project_id=febc4f33fba1433992fc8e043a47dd5c)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:55.615472 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543fcf67-1594-4922-bf9e-aa91537cabd5 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:55.616857 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 189/377] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:55.617725 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 189/378] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:55 2021] GET /identity/v3/projects/febc4f33fba1433992fc8e043a47dd5c => generated 298 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:55.623919 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692094e-6890-468c-95db-d28395c65ebf None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:55.640181 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692094e-6890-468c-95db-d28395c65ebf None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:55.647078 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb1d9a-936e-4d75-983a-f90e4da794d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:55.648067 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb1d9a-936e-4d75-983a-f90e4da794d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:55.648404 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb1d9a-936e-4d75-983a-f90e4da794d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:55.648734 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb1d9a-936e-4d75-983a-f90e4da794d4 admin admin] PATH_INFO: `/v3/groups/5a59719437d94ebbb0ac266175d5c666` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:55.655260 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb1d9a-936e-4d75-983a-f90e4da794d4 admin admin] RBAC: Authorizing `identity:get_group(group_id=5a59719437d94ebbb0ac266175d5c666)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:55.657387 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb1d9a-936e-4d75-983a-f90e4da794d4 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:55.659644 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 190/379] 10.222.0.62 () {56 vars in 1201 bytes} [Tue Nov 23 19:15:55 2021] GET /identity/v3/groups/5a59719437d94ebbb0ac266175d5c666 => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:55.664191 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fcf67-1594-4922-bf9e-aa91537cabd5 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:55.672254 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb1d9a-936e-4d75-983a-f90e4da794d4 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:55.677050 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fcf67-1594-4922-bf9e-aa91537cabd5 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:55.686564 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb1d9a-936e-4d75-983a-f90e4da794d4 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:55.692921 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828dde7-dc83-4636-a5e0-4957cb12584a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:55.693773 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828dde7-dc83-4636-a5e0-4957cb12584a admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:55.694057 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828dde7-dc83-4636-a5e0-4957cb12584a admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:55.694409 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828dde7-dc83-4636-a5e0-4957cb12584a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:55.695189 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d783f-6b76-4031-a5f9-2b53977ed987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:55.696163 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d783f-6b76-4031-a5f9-2b53977ed987 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:55.696540 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d783f-6b76-4031-a5f9-2b53977ed987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:55.696873 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d783f-6b76-4031-a5f9-2b53977ed987 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:55.697918 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d783f-6b76-4031-a5f9-2b53977ed987 admin admin] RBAC: Adding query filter params (group.id=5a59719437d94ebbb0ac266175d5c666, role.id=f8b0ca7636ad450b94f68df7bc4497aa, scope.project.id=febc4f33fba1433992fc8e043a47dd5c) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:55.698293 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d783f-6b76-4031-a5f9-2b53977ed987 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:55.700914 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d783f-6b76-4031-a5f9-2b53977ed987 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:55.711971 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 191/380] 10.222.0.62 () {56 vars in 1397 bytes} [Tue Nov 23 19:15:55 2021] GET /identity/v3/role_assignments?group.id=5a59719437d94ebbb0ac266175d5c666&scope.project.id=febc4f33fba1433992fc8e043a47dd5c&role.id=f8b0ca7636ad450b94f68df7bc4497aa => generated 260 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:55.726697 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828dde7-dc83-4636-a5e0-4957cb12584a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:55.733939 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-8828dde7-dc83-4636-a5e0-4957cb12584a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 19:15:55.735512 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 190/381] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:55 2021] GET /identity/v3/roles/member => generated 84 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:15:55.742110 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d783f-6b76-4031-a5f9-2b53977ed987 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:55.755983 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d783f-6b76-4031-a5f9-2b53977ed987 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:55.770021 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed0bcd-b545-49cf-82f6-7df5b58c77bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:55.770774 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed0bcd-b545-49cf-82f6-7df5b58c77bd admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:55.771117 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed0bcd-b545-49cf-82f6-7df5b58c77bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:55.771402 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed0bcd-b545-49cf-82f6-7df5b58c77bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:55.772197 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed0bcd-b545-49cf-82f6-7df5b58c77bd admin admin] RBAC: Adding query filter params (name=member) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:55.772566 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed0bcd-b545-49cf-82f6-7df5b58c77bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:55.774311 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed0bcd-b545-49cf-82f6-7df5b58c77bd admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:55.807541 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 192/382] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Nov 23 19:15:55 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:55.814886 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828dde7-dc83-4636-a5e0-4957cb12584a admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:55.836261 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828dde7-dc83-4636-a5e0-4957cb12584a admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:55.847267 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e29b5b-f8e2-419a-be4c-47a0a510ddc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:55.847929 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e29b5b-f8e2-419a-be4c-47a0a510ddc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:55.848206 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e29b5b-f8e2-419a-be4c-47a0a510ddc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:55.848474 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e29b5b-f8e2-419a-be4c-47a0a510ddc7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:55.865544 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e29b5b-f8e2-419a-be4c-47a0a510ddc7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:55.867313 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e29b5b-f8e2-419a-be4c-47a0a510ddc7 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:55.883682 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 191/383] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:15:55 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:15:55.890379 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed0bcd-b545-49cf-82f6-7df5b58c77bd admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:55.904917 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed0bcd-b545-49cf-82f6-7df5b58c77bd admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:55.913298 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b7c5d4-a888-4567-bac6-6de7f6542ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:55.914279 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7c5d4-a888-4567-bac6-6de7f6542ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:55.914563 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7c5d4-a888-4567-bac6-6de7f6542ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:55.914843 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7c5d4-a888-4567-bac6-6de7f6542ad5 admin admin] PATH_INFO: `/v3/projects/d57902468b3746628ca506df9bca7068` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:55.916178 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b7c5d4-a888-4567-bac6-6de7f6542ad5 admin admin] RBAC: Authorizing `identity:get_project(project_id=d57902468b3746628ca506df9bca7068)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:55.918351 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b7c5d4-a888-4567-bac6-6de7f6542ad5 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:55.921247 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 193/384] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:55 2021] GET /identity/v3/projects/d57902468b3746628ca506df9bca7068 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:55.927575 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e29b5b-f8e2-419a-be4c-47a0a510ddc7 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:55.942824 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e29b5b-f8e2-419a-be4c-47a0a510ddc7 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:55.954399 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f392b37-0ea6-403d-a51e-2075ffee5385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:55.955282 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f392b37-0ea6-403d-a51e-2075ffee5385 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:55.955549 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f392b37-0ea6-403d-a51e-2075ffee5385 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:55.955820 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f392b37-0ea6-403d-a51e-2075ffee5385 admin admin] PATH_INFO: `/v3/groups/5a59719437d94ebbb0ac266175d5c666` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:55.961464 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f392b37-0ea6-403d-a51e-2075ffee5385 admin admin] RBAC: Authorizing `identity:get_group(group_id=5a59719437d94ebbb0ac266175d5c666)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:55.961464 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING py.warnings [None req-9f392b37-0ea6-403d-a51e-2075ffee5385 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:15:55.961464 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: warnings.warn(msg) Nov 23 19:15:55.961464 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: Nov 23 19:15:55.961464 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f392b37-0ea6-403d-a51e-2075ffee5385 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:55.963054 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 192/385] 10.222.0.62 () {56 vars in 1201 bytes} [Tue Nov 23 19:15:55 2021] GET /identity/v3/groups/5a59719437d94ebbb0ac266175d5c666 => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:55.969987 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b7c5d4-a888-4567-bac6-6de7f6542ad5 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:55.987852 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b7c5d4-a888-4567-bac6-6de7f6542ad5 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:55.994769 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65dbc2b-60c1-464b-a873-801e1de28786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:55.995504 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65dbc2b-60c1-464b-a873-801e1de28786 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:55.995788 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65dbc2b-60c1-464b-a873-801e1de28786 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:55.996115 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65dbc2b-60c1-464b-a873-801e1de28786 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:55.996977 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65dbc2b-60c1-464b-a873-801e1de28786 admin admin] RBAC: Adding query filter params (group.id=5a59719437d94ebbb0ac266175d5c666, role.id=f8b0ca7636ad450b94f68df7bc4497aa, scope.project.id=d57902468b3746628ca506df9bca7068) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:55.998386 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65dbc2b-60c1-464b-a873-801e1de28786 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:56.000512 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65dbc2b-60c1-464b-a873-801e1de28786 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:56.010264 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 194/386] 10.222.0.62 () {56 vars in 1397 bytes} [Tue Nov 23 19:15:55 2021] GET /identity/v3/role_assignments?group.id=5a59719437d94ebbb0ac266175d5c666&scope.project.id=d57902468b3746628ca506df9bca7068&role.id=f8b0ca7636ad450b94f68df7bc4497aa => generated 260 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:57.058624 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5508b85-abb0-4cff-bc11-3a0004fb26be None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:57.060206 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5508b85-abb0-4cff-bc11-3a0004fb26be None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:57.060701 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5508b85-abb0-4cff-bc11-3a0004fb26be None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:57.062913 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 193/387] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:57 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:57.069132 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828f3d1-e112-40e3-bb22-ac93447ce5e2 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:57.070049 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828f3d1-e112-40e3-bb22-ac93447ce5e2 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:57.070793 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828f3d1-e112-40e3-bb22-ac93447ce5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:57.098073 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-2828f3d1-e112-40e3-bb22-ac93447ce5e2 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:57.099697 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-2828f3d1-e112-40e3-bb22-ac93447ce5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:57.113275 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 195/388] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 19:15:57.135119 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb154d-3392-4bbc-a2d2-05983d4bb406 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:57.135755 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb154d-3392-4bbc-a2d2-05983d4bb406 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:57.136237 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb154d-3392-4bbc-a2d2-05983d4bb406 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:57.139111 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 194/389] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:57 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:57.148794 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7aa267-67ce-4058-b866-3cf5f084fd83 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:57.149394 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7aa267-67ce-4058-b866-3cf5f084fd83 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:57.149909 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7aa267-67ce-4058-b866-3cf5f084fd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:57.155678 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb154d-3392-4bbc-a2d2-05983d4bb406 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:57.170464 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-aa7aa267-67ce-4058-b866-3cf5f084fd83 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:57.172008 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-aa7aa267-67ce-4058-b866-3cf5f084fd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:57.177436 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb154d-3392-4bbc-a2d2-05983d4bb406 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:57.178846 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386551ad-c9a6-47b8-a5e0-2b04c11f08ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:57.179817 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386551ad-c9a6-47b8-a5e0-2b04c11f08ba admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:57.180101 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386551ad-c9a6-47b8-a5e0-2b04c11f08ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:57.180377 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386551ad-c9a6-47b8-a5e0-2b04c11f08ba admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:57.189023 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 196/390] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:57.198736 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386551ad-c9a6-47b8-a5e0-2b04c11f08ba admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:57.207015 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-386551ad-c9a6-47b8-a5e0-2b04c11f08ba admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 19:15:57.208486 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 195/391] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:15:57 2021] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:15:57.214756 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7aa267-67ce-4058-b866-3cf5f084fd83 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:57.224865 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7aa267-67ce-4058-b866-3cf5f084fd83 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:57.225029 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386551ad-c9a6-47b8-a5e0-2b04c11f08ba admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:57.230097 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a23fb1-8735-42ba-83a6-79ff3516f19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:57.231012 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a23fb1-8735-42ba-83a6-79ff3516f19d admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:57.231530 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a23fb1-8735-42ba-83a6-79ff3516f19d admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:57.232008 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a23fb1-8735-42ba-83a6-79ff3516f19d admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:57.232976 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a23fb1-8735-42ba-83a6-79ff3516f19d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:57.233528 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a23fb1-8735-42ba-83a6-79ff3516f19d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:57.235380 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a23fb1-8735-42ba-83a6-79ff3516f19d admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:57.240659 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386551ad-c9a6-47b8-a5e0-2b04c11f08ba admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:57.249482 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 197/392] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:57 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:57.254675 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afd4c1-2ba5-4e61-8cd5-dbab599f7a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:57.255497 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afd4c1-2ba5-4e61-8cd5-dbab599f7a3e admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:57.255780 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afd4c1-2ba5-4e61-8cd5-dbab599f7a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:57.256059 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afd4c1-2ba5-4e61-8cd5-dbab599f7a3e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:57.256611 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a23fb1-8735-42ba-83a6-79ff3516f19d admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:57.267252 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a23fb1-8735-42ba-83a6-79ff3516f19d admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:57.272376 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8c279-bc8a-487b-9248-195e2e05e49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:57.273311 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8c279-bc8a-487b-9248-195e2e05e49f admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:57.273884 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8c279-bc8a-487b-9248-195e2e05e49f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:57.274379 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8c279-bc8a-487b-9248-195e2e05e49f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:57.284390 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8c279-bc8a-487b-9248-195e2e05e49f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:57.287315 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9afd4c1-2ba5-4e61-8cd5-dbab599f7a3e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:57.288803 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8c279-bc8a-487b-9248-195e2e05e49f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:57.293912 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-b9afd4c1-2ba5-4e61-8cd5-dbab599f7a3e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 19:15:57.295316 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 196/393] 10.222.0.62 () {56 vars in 1135 bytes} [Tue Nov 23 19:15:57 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:15:57.302179 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 198/394] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:15:57 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:15:57.305373 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8c279-bc8a-487b-9248-195e2e05e49f admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:57.305532 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afd4c1-2ba5-4e61-8cd5-dbab599f7a3e admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:57.316211 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8c279-bc8a-487b-9248-195e2e05e49f admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:57.321222 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afd4c1-2ba5-4e61-8cd5-dbab599f7a3e admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:57.321775 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb911b-bbb0-4c20-a53e-32a2ada17976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:57.322971 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb911b-bbb0-4c20-a53e-32a2ada17976 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:57.323466 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb911b-bbb0-4c20-a53e-32a2ada17976 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:57.323959 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb911b-bbb0-4c20-a53e-32a2ada17976 admin admin] PATH_INFO: `/v3/projects/bbbece3b7f8c49dc96e2d01b1a42f43c` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:57.325574 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb911b-bbb0-4c20-a53e-32a2ada17976 admin admin] RBAC: Authorizing `identity:get_project(project_id=bbbece3b7f8c49dc96e2d01b1a42f43c)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:57.328107 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb911b-bbb0-4c20-a53e-32a2ada17976 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:57.330889 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 199/395] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:57 2021] GET /identity/v3/projects/bbbece3b7f8c49dc96e2d01b1a42f43c => generated 344 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:57.332072 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af58bd-f9e8-4238-8990-5ccc33764e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:57.332751 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af58bd-f9e8-4238-8990-5ccc33764e56 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:57.333065 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af58bd-f9e8-4238-8990-5ccc33764e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:57.333307 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af58bd-f9e8-4238-8990-5ccc33764e56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:57.334109 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af58bd-f9e8-4238-8990-5ccc33764e56 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:57.334414 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af58bd-f9e8-4238-8990-5ccc33764e56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:57.336090 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb911b-bbb0-4c20-a53e-32a2ada17976 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:57.336311 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af58bd-f9e8-4238-8990-5ccc33764e56 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:57.347462 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb911b-bbb0-4c20-a53e-32a2ada17976 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:57.352566 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec918d0-3138-4c16-979f-98fe06e230fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:57.352875 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 197/396] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:15:57 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:57.354205 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec918d0-3138-4c16-979f-98fe06e230fe admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:57.354714 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec918d0-3138-4c16-979f-98fe06e230fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:57.355261 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec918d0-3138-4c16-979f-98fe06e230fe admin admin] PATH_INFO: `/v3/groups/8f66b39f2d1a476cbd33600fa3b12bc0` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:57.359270 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af58bd-f9e8-4238-8990-5ccc33764e56 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:57.362437 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec918d0-3138-4c16-979f-98fe06e230fe admin admin] RBAC: Authorizing `identity:get_group(group_id=8f66b39f2d1a476cbd33600fa3b12bc0)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:57.364729 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec918d0-3138-4c16-979f-98fe06e230fe admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:57.367655 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 200/397] 10.222.0.62 () {56 vars in 1201 bytes} [Tue Nov 23 19:15:57 2021] GET /identity/v3/groups/8f66b39f2d1a476cbd33600fa3b12bc0 => generated 229 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:57.373508 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec918d0-3138-4c16-979f-98fe06e230fe admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:57.381118 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af58bd-f9e8-4238-8990-5ccc33764e56 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:57.389101 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec918d0-3138-4c16-979f-98fe06e230fe admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:57.392309 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f5699-3033-407d-8624-c93a7e3b0bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:57.392960 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f5699-3033-407d-8624-c93a7e3b0bba admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:57.393237 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f5699-3033-407d-8624-c93a7e3b0bba admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:57.393533 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f5699-3033-407d-8624-c93a7e3b0bba admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:57.405919 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200a5d9-bc73-48a9-9641-13dfb84fad2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:57.406574 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200a5d9-bc73-48a9-9641-13dfb84fad2b admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:57.406850 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200a5d9-bc73-48a9-9641-13dfb84fad2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:57.407123 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200a5d9-bc73-48a9-9641-13dfb84fad2b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:57.407960 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1200a5d9-bc73-48a9-9641-13dfb84fad2b admin admin] RBAC: Adding query filter params (group.id=8f66b39f2d1a476cbd33600fa3b12bc0, role.id=6d9a8878ffeb49fea19d854657c6b767, scope.project.id=bbbece3b7f8c49dc96e2d01b1a42f43c) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:57.408267 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1200a5d9-bc73-48a9-9641-13dfb84fad2b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:57.410095 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1200a5d9-bc73-48a9-9641-13dfb84fad2b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:57.410417 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f5699-3033-407d-8624-c93a7e3b0bba admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:57.412291 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f5699-3033-407d-8624-c93a7e3b0bba admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:57.425858 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 201/398] 10.222.0.62 () {56 vars in 1397 bytes} [Tue Nov 23 19:15:57 2021] GET /identity/v3/role_assignments?group.id=8f66b39f2d1a476cbd33600fa3b12bc0&scope.project.id=bbbece3b7f8c49dc96e2d01b1a42f43c&role.id=6d9a8878ffeb49fea19d854657c6b767 => generated 260 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:57.426500 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 198/399] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:15:57 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 23 19:15:57.432741 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200a5d9-bc73-48a9-9641-13dfb84fad2b admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:57.447192 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200a5d9-bc73-48a9-9641-13dfb84fad2b admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:57.457631 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae28305-f901-4ed8-b6ef-887140782749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:57.458528 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae28305-f901-4ed8-b6ef-887140782749 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:57.458816 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae28305-f901-4ed8-b6ef-887140782749 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:57.459110 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae28305-f901-4ed8-b6ef-887140782749 admin admin] PATH_INFO: `/v3/projects/d57902468b3746628ca506df9bca7068` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:57.461296 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae28305-f901-4ed8-b6ef-887140782749 admin admin] RBAC: Authorizing `identity:get_project(project_id=d57902468b3746628ca506df9bca7068)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:57.463423 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae28305-f901-4ed8-b6ef-887140782749 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:57.465511 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 202/400] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:57 2021] GET /identity/v3/projects/d57902468b3746628ca506df9bca7068 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:57.472017 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f5699-3033-407d-8624-c93a7e3b0bba admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:57.487509 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f5699-3033-407d-8624-c93a7e3b0bba admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:57.494769 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97da03-97fd-463f-8399-45f291f32caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:57.495670 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97da03-97fd-463f-8399-45f291f32caa admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:57.495930 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97da03-97fd-463f-8399-45f291f32caa admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:57.496209 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97da03-97fd-463f-8399-45f291f32caa admin admin] PATH_INFO: `/v3/groups/5a59719437d94ebbb0ac266175d5c666` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:57.498087 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97da03-97fd-463f-8399-45f291f32caa admin admin] RBAC: Authorizing `identity:get_group(group_id=5a59719437d94ebbb0ac266175d5c666)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:57.499981 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97da03-97fd-463f-8399-45f291f32caa admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:57.501633 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 199/401] 10.222.0.62 () {56 vars in 1201 bytes} [Tue Nov 23 19:15:57 2021] GET /identity/v3/groups/5a59719437d94ebbb0ac266175d5c666 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:57.508007 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae28305-f901-4ed8-b6ef-887140782749 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:57.518440 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae28305-f901-4ed8-b6ef-887140782749 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:57.525153 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae25df-3354-43b1-9d39-f73db31d6ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:57.525852 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae25df-3354-43b1-9d39-f73db31d6ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:57.526137 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae25df-3354-43b1-9d39-f73db31d6ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:57.526413 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae25df-3354-43b1-9d39-f73db31d6ae0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:57.527276 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae25df-3354-43b1-9d39-f73db31d6ae0 admin admin] RBAC: Adding query filter params (group.id=5a59719437d94ebbb0ac266175d5c666, role.id=bc8a8682d8f748788fb70d235f9978dc, scope.project.id=d57902468b3746628ca506df9bca7068) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:57.527588 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae25df-3354-43b1-9d39-f73db31d6ae0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:57.530010 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae25df-3354-43b1-9d39-f73db31d6ae0 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:57.542210 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 203/402] 10.222.0.62 () {56 vars in 1397 bytes} [Tue Nov 23 19:15:57 2021] GET /identity/v3/role_assignments?group.id=5a59719437d94ebbb0ac266175d5c666&scope.project.id=d57902468b3746628ca506df9bca7068&role.id=bc8a8682d8f748788fb70d235f9978dc => generated 260 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:58.474306 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c5c61-2d10-477a-8da5-19a5dbc59a32 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:58.474829 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c5c61-2d10-477a-8da5-19a5dbc59a32 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:58.474929 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c5c61-2d10-477a-8da5-19a5dbc59a32 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:58.476894 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 200/403] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:58.483723 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126597b-bebd-481e-a2ba-e3bacff3f978 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:58.484370 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126597b-bebd-481e-a2ba-e3bacff3f978 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:58.484370 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126597b-bebd-481e-a2ba-e3bacff3f978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:58.509842 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-0126597b-bebd-481e-a2ba-e3bacff3f978 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:58.511067 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-0126597b-bebd-481e-a2ba-e3bacff3f978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:58.524823 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 204/404] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:58 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:58.560854 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c5c61-2d10-477a-8da5-19a5dbc59a32 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:58.578966 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c5c61-2d10-477a-8da5-19a5dbc59a32 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:58.583403 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcb6f9-33f2-45a8-be4c-c96232a51a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:58.584204 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcb6f9-33f2-45a8-be4c-c96232a51a5e admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:58.584483 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcb6f9-33f2-45a8-be4c-c96232a51a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:58.584753 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcb6f9-33f2-45a8-be4c-c96232a51a5e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:58.600062 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fcb6f9-33f2-45a8-be4c-c96232a51a5e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:58.607913 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-26fcb6f9-33f2-45a8-be4c-c96232a51a5e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 19:15:58.609319 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 201/405] 10.222.0.62 () {56 vars in 1135 bytes} [Tue Nov 23 19:15:58 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:15:58.615270 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126597b-bebd-481e-a2ba-e3bacff3f978 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:58.624361 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126597b-bebd-481e-a2ba-e3bacff3f978 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:58.633366 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84638d-243b-4cdd-ae28-9f427657b250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:58.634087 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84638d-243b-4cdd-ae28-9f427657b250 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:58.634367 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84638d-243b-4cdd-ae28-9f427657b250 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:58.634638 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84638d-243b-4cdd-ae28-9f427657b250 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:58.635399 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84638d-243b-4cdd-ae28-9f427657b250 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:58.635698 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84638d-243b-4cdd-ae28-9f427657b250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:58.637263 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84638d-243b-4cdd-ae28-9f427657b250 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:58.652560 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 205/406] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:15:58 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:58.659336 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcb6f9-33f2-45a8-be4c-c96232a51a5e admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:58.675816 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcb6f9-33f2-45a8-be4c-c96232a51a5e admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:58.677979 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9db6c3-7dda-477e-9987-b6a1ef6194e9 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:58.678268 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9db6c3-7dda-477e-9987-b6a1ef6194e9 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:58.678537 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9db6c3-7dda-477e-9987-b6a1ef6194e9 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:58.680298 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 206/407] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:58.686827 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a0964-8ba6-4690-bef9-ae96d8b1d5d8 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:58.687115 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a0964-8ba6-4690-bef9-ae96d8b1d5d8 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:58.687331 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32893be3-2a98-4df2-af4d-e0e0264498c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:58.687526 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a0964-8ba6-4690-bef9-ae96d8b1d5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:58.687959 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32893be3-2a98-4df2-af4d-e0e0264498c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:58.688240 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32893be3-2a98-4df2-af4d-e0e0264498c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:58.688506 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32893be3-2a98-4df2-af4d-e0e0264498c8 admin admin] PATH_INFO: `/v3/groups/5a59719437d94ebbb0ac266175d5c666` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:58.690091 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32893be3-2a98-4df2-af4d-e0e0264498c8 admin admin] RBAC: Authorizing `identity:get_group(group_id=5a59719437d94ebbb0ac266175d5c666)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:58.691965 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32893be3-2a98-4df2-af4d-e0e0264498c8 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:58.693600 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 202/408] 10.222.0.62 () {56 vars in 1201 bytes} [Tue Nov 23 19:15:58 2021] GET /identity/v3/groups/5a59719437d94ebbb0ac266175d5c666 => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:58.699770 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32893be3-2a98-4df2-af4d-e0e0264498c8 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:58.715939 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-384a0964-8ba6-4690-bef9-ae96d8b1d5d8 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:58.718594 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-384a0964-8ba6-4690-bef9-ae96d8b1d5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:58.721117 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32893be3-2a98-4df2-af4d-e0e0264498c8 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:58.731253 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3bdbf-d5cc-44af-8162-8df1886bb0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:58.732939 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3bdbf-d5cc-44af-8162-8df1886bb0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:58.734759 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3bdbf-d5cc-44af-8162-8df1886bb0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:58.735241 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3bdbf-d5cc-44af-8162-8df1886bb0c2 admin admin] PATH_INFO: `/v3/projects/febc4f33fba1433992fc8e043a47dd5c` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:58.735686 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 207/409] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:58 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 19:15:58.742181 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3bdbf-d5cc-44af-8162-8df1886bb0c2 admin admin] RBAC: Authorizing `identity:get_project(project_id=febc4f33fba1433992fc8e043a47dd5c)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:58.744435 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3bdbf-d5cc-44af-8162-8df1886bb0c2 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:58.746647 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 203/410] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:58 2021] GET /identity/v3/projects/febc4f33fba1433992fc8e043a47dd5c => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:58.752974 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a0964-8ba6-4690-bef9-ae96d8b1d5d8 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:58.762728 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a0964-8ba6-4690-bef9-ae96d8b1d5d8 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:58.773451 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df54ff6-ad09-4333-b2ef-20010b747c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:58.774617 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df54ff6-ad09-4333-b2ef-20010b747c3d admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:58.775098 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df54ff6-ad09-4333-b2ef-20010b747c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:58.775588 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df54ff6-ad09-4333-b2ef-20010b747c3d admin admin] PATH_INFO: `/v3/projects/febc4f33fba1433992fc8e043a47dd5c/groups/5a59719437d94ebbb0ac266175d5c666/roles/bc8a8682d8f748788fb70d235f9978dc` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:58.778086 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df54ff6-ad09-4333-b2ef-20010b747c3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=febc4f33fba1433992fc8e043a47dd5c, group_id=5a59719437d94ebbb0ac266175d5c666, role_id=bc8a8682d8f748788fb70d235f9978dc)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:58.780920 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df54ff6-ad09-4333-b2ef-20010b747c3d admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:58.792999 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3bdbf-d5cc-44af-8162-8df1886bb0c2 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:58.803493 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3bdbf-d5cc-44af-8162-8df1886bb0c2 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:58.816060 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b536f9-f9f5-40b7-8a76-f712f2a80cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:58.816060 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b536f9-f9f5-40b7-8a76-f712f2a80cfd admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:58.816060 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b536f9-f9f5-40b7-8a76-f712f2a80cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:58.816060 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b536f9-f9f5-40b7-8a76-f712f2a80cfd admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:58.830551 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b536f9-f9f5-40b7-8a76-f712f2a80cfd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:58.837709 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-98b536f9-f9f5-40b7-8a76-f712f2a80cfd admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 19:15:58.838920 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 204/411] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:58 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:15:58.845697 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b536f9-f9f5-40b7-8a76-f712f2a80cfd admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:58.855916 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b536f9-f9f5-40b7-8a76-f712f2a80cfd admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:58.864742 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36901e1c-527a-4550-ae75-b1dd873fb040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:58.865545 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36901e1c-527a-4550-ae75-b1dd873fb040 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:58.865826 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36901e1c-527a-4550-ae75-b1dd873fb040 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:58.866151 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36901e1c-527a-4550-ae75-b1dd873fb040 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:58.866974 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36901e1c-527a-4550-ae75-b1dd873fb040 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:58.867275 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36901e1c-527a-4550-ae75-b1dd873fb040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:58.868937 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36901e1c-527a-4550-ae75-b1dd873fb040 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:58.879136 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 205/412] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Nov 23 19:15:58 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:58.890702 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 208/413] 10.222.0.62 () {58 vars in 1463 bytes} [Tue Nov 23 19:15:58 2021] PUT /identity/v3/projects/febc4f33fba1433992fc8e043a47dd5c/groups/5a59719437d94ebbb0ac266175d5c666/roles/bc8a8682d8f748788fb70d235f9978dc => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:15:58.891704 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36901e1c-527a-4550-ae75-b1dd873fb040 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:58.905675 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36901e1c-527a-4550-ae75-b1dd873fb040 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:58.972728 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19e402-b926-4d64-bb3f-f0d359adf36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:58.973706 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19e402-b926-4d64-bb3f-f0d359adf36f admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:58.973985 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19e402-b926-4d64-bb3f-f0d359adf36f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:58.974255 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19e402-b926-4d64-bb3f-f0d359adf36f admin admin] PATH_INFO: `/v3/groups/5a59719437d94ebbb0ac266175d5c666` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:58.975627 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19e402-b926-4d64-bb3f-f0d359adf36f admin admin] RBAC: Authorizing `identity:get_group(group_id=5a59719437d94ebbb0ac266175d5c666)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:58.977698 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19e402-b926-4d64-bb3f-f0d359adf36f admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:58.979660 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 206/414] 10.222.0.62 () {56 vars in 1201 bytes} [Tue Nov 23 19:15:58 2021] GET /identity/v3/groups/5a59719437d94ebbb0ac266175d5c666 => generated 226 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:58.990805 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df54ff6-ad09-4333-b2ef-20010b747c3d admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:59.008469 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df54ff6-ad09-4333-b2ef-20010b747c3d admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:59.024120 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1108c1-0a51-4f2a-90a7-3ab50b5a7f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:59.025774 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1108c1-0a51-4f2a-90a7-3ab50b5a7f1a admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:59.026297 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1108c1-0a51-4f2a-90a7-3ab50b5a7f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:59.026813 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1108c1-0a51-4f2a-90a7-3ab50b5a7f1a admin admin] PATH_INFO: `/v3/projects/d57902468b3746628ca506df9bca7068` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:59.030774 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1108c1-0a51-4f2a-90a7-3ab50b5a7f1a admin admin] RBAC: Authorizing `identity:get_project(project_id=d57902468b3746628ca506df9bca7068)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:59.034107 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1108c1-0a51-4f2a-90a7-3ab50b5a7f1a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:59.042031 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 209/415] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:58 2021] GET /identity/v3/projects/d57902468b3746628ca506df9bca7068 => generated 302 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:15:59.048488 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19e402-b926-4d64-bb3f-f0d359adf36f admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:59.062681 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19e402-b926-4d64-bb3f-f0d359adf36f admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:59.070116 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c54e9f-126d-4991-97ce-5ab10ffeb316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:59.071308 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c54e9f-126d-4991-97ce-5ab10ffeb316 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:59.071642 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c54e9f-126d-4991-97ce-5ab10ffeb316 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:59.071921 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c54e9f-126d-4991-97ce-5ab10ffeb316 admin admin] PATH_INFO: `/v3/projects/d57902468b3746628ca506df9bca7068/groups/5a59719437d94ebbb0ac266175d5c666/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:59.073975 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c54e9f-126d-4991-97ce-5ab10ffeb316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d57902468b3746628ca506df9bca7068, group_id=5a59719437d94ebbb0ac266175d5c666, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:59.076937 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c54e9f-126d-4991-97ce-5ab10ffeb316 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:59.174555 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 207/416] 10.222.0.62 () {58 vars in 1463 bytes} [Tue Nov 23 19:15:59 2021] PUT /identity/v3/projects/d57902468b3746628ca506df9bca7068/groups/5a59719437d94ebbb0ac266175d5c666/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:15:59.329230 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d9e64-e03b-4525-9821-3617200a97cd None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:59.329622 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d9e64-e03b-4525-9821-3617200a97cd None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:59.329802 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d9e64-e03b-4525-9821-3617200a97cd None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:59.331844 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 210/417] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:15:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:15:59.337921 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342643e-9714-4a25-b376-2e42e71f432e None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:59.338209 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342643e-9714-4a25-b376-2e42e71f432e None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:59.338476 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342643e-9714-4a25-b376-2e42e71f432e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:59.359763 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-9342643e-9714-4a25-b376-2e42e71f432e None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:15:59.360974 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-9342643e-9714-4a25-b376-2e42e71f432e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:15:59.430448 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 208/418] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:15:59 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:15:59.455490 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d9e64-e03b-4525-9821-3617200a97cd None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:59.474080 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d9e64-e03b-4525-9821-3617200a97cd None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:59.479830 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749d800-535a-4cfa-b7d2-4f2f8fdbebb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:59.480622 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749d800-535a-4cfa-b7d2-4f2f8fdbebb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:59.480906 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749d800-535a-4cfa-b7d2-4f2f8fdbebb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:59.481180 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749d800-535a-4cfa-b7d2-4f2f8fdbebb0 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:59.493467 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749d800-535a-4cfa-b7d2-4f2f8fdbebb0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:15:59.503314 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-4749d800-535a-4cfa-b7d2-4f2f8fdbebb0 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 19:15:59.504952 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 211/419] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:15:59 2021] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:15:59.510958 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342643e-9714-4a25-b376-2e42e71f432e None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:59.525701 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342643e-9714-4a25-b376-2e42e71f432e None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:59.531940 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de48f52-2438-40e7-b27c-c8a826073c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:59.532601 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de48f52-2438-40e7-b27c-c8a826073c91 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:59.532878 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de48f52-2438-40e7-b27c-c8a826073c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:59.533152 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de48f52-2438-40e7-b27c-c8a826073c91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:59.533933 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de48f52-2438-40e7-b27c-c8a826073c91 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:15:59.534235 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de48f52-2438-40e7-b27c-c8a826073c91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:59.535806 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de48f52-2438-40e7-b27c-c8a826073c91 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:59.547326 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 209/420] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Nov 23 19:15:59 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:59.553094 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749d800-535a-4cfa-b7d2-4f2f8fdbebb0 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:59.564124 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749d800-535a-4cfa-b7d2-4f2f8fdbebb0 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:59.573588 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978bfad-6a28-4912-8308-cd5106ad2731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:59.574442 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978bfad-6a28-4912-8308-cd5106ad2731 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:59.574767 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978bfad-6a28-4912-8308-cd5106ad2731 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:59.575036 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978bfad-6a28-4912-8308-cd5106ad2731 admin admin] PATH_INFO: `/v3/groups/5a59719437d94ebbb0ac266175d5c666` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:59.576867 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978bfad-6a28-4912-8308-cd5106ad2731 admin admin] RBAC: Authorizing `identity:get_group(group_id=5a59719437d94ebbb0ac266175d5c666)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:59.578934 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978bfad-6a28-4912-8308-cd5106ad2731 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:59.580950 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 212/421] 10.222.0.62 () {56 vars in 1201 bytes} [Tue Nov 23 19:15:59 2021] GET /identity/v3/groups/5a59719437d94ebbb0ac266175d5c666 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:59.586575 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de48f52-2438-40e7-b27c-c8a826073c91 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:59.601010 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de48f52-2438-40e7-b27c-c8a826073c91 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:59.610144 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed42c0-8b45-4816-b681-64ff76e29a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:59.610996 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed42c0-8b45-4816-b681-64ff76e29a7f admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:59.611327 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed42c0-8b45-4816-b681-64ff76e29a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:59.611600 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed42c0-8b45-4816-b681-64ff76e29a7f admin admin] PATH_INFO: `/v3/projects/febc4f33fba1433992fc8e043a47dd5c` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:59.612874 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed42c0-8b45-4816-b681-64ff76e29a7f admin admin] RBAC: Authorizing `identity:get_project(project_id=febc4f33fba1433992fc8e043a47dd5c)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:59.615017 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed42c0-8b45-4816-b681-64ff76e29a7f admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:59.616814 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 210/422] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:15:59 2021] GET /identity/v3/projects/febc4f33fba1433992fc8e043a47dd5c => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:15:59.623196 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978bfad-6a28-4912-8308-cd5106ad2731 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:15:59.639194 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978bfad-6a28-4912-8308-cd5106ad2731 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:15:59.649374 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772a05b-bb5d-45e9-b17b-983368b09abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:15:59.650270 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772a05b-bb5d-45e9-b17b-983368b09abb admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:15:59.650550 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772a05b-bb5d-45e9-b17b-983368b09abb admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:15:59.650825 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772a05b-bb5d-45e9-b17b-983368b09abb admin admin] PATH_INFO: `/v3/projects/febc4f33fba1433992fc8e043a47dd5c/groups/5a59719437d94ebbb0ac266175d5c666/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:15:59.652790 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d772a05b-bb5d-45e9-b17b-983368b09abb admin admin] RBAC: Authorizing `identity:create_grant(project_id=febc4f33fba1433992fc8e043a47dd5c, group_id=5a59719437d94ebbb0ac266175d5c666, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:15:59.656013 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d772a05b-bb5d-45e9-b17b-983368b09abb admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:15:59.773173 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 213/423] 10.222.0.62 () {58 vars in 1463 bytes} [Tue Nov 23 19:15:59 2021] PUT /identity/v3/projects/febc4f33fba1433992fc8e043a47dd5c/groups/5a59719437d94ebbb0ac266175d5c666/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:16:00.400580 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947caf5-0620-442a-8656-f449582fafeb None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:00.401025 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947caf5-0620-442a-8656-f449582fafeb None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:00.401196 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947caf5-0620-442a-8656-f449582fafeb None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:00.402913 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 211/424] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:00.410241 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773c479-73c2-43b5-85e8-281b41211f7a None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:00.410540 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773c479-73c2-43b5-85e8-281b41211f7a None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:00.410786 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773c479-73c2-43b5-85e8-281b41211f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:00.435855 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-e773c479-73c2-43b5-85e8-281b41211f7a None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:00.437081 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-e773c479-73c2-43b5-85e8-281b41211f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:00.503998 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 214/425] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:16:00.540583 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947caf5-0620-442a-8656-f449582fafeb None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:00.555640 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947caf5-0620-442a-8656-f449582fafeb None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:00.562894 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c2a32-5eee-4093-a198-4aca175f082a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:00.563693 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c2a32-5eee-4093-a198-4aca175f082a admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:00.563970 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c2a32-5eee-4093-a198-4aca175f082a admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:00.564241 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c2a32-5eee-4093-a198-4aca175f082a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:00.581856 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c2a32-5eee-4093-a198-4aca175f082a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:00.589032 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-941c2a32-5eee-4093-a198-4aca175f082a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 19:16:00.590575 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 212/426] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:16:00 2021] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:00.597529 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773c479-73c2-43b5-85e8-281b41211f7a None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:00.606588 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773c479-73c2-43b5-85e8-281b41211f7a None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:00.612391 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd64d10-0bf5-43db-8ef3-c90df91b8d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:00.613065 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd64d10-0bf5-43db-8ef3-c90df91b8d41 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:00.613349 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd64d10-0bf5-43db-8ef3-c90df91b8d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:00.613661 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd64d10-0bf5-43db-8ef3-c90df91b8d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:00.614429 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd64d10-0bf5-43db-8ef3-c90df91b8d41 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:00.614738 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd64d10-0bf5-43db-8ef3-c90df91b8d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:00.616333 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd64d10-0bf5-43db-8ef3-c90df91b8d41 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:00.625574 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a035c54-b782-4a97-b5dc-8ae361cd025a None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:00.625855 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a035c54-b782-4a97-b5dc-8ae361cd025a None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:00.626118 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a035c54-b782-4a97-b5dc-8ae361cd025a None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:00.627884 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 213/427] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 19:16:00.629186 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 215/428] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:16:00 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:00.634714 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5f5ee-d229-412b-8c3d-ad4dfcc66482 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:00.634996 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5f5ee-d229-412b-8c3d-ad4dfcc66482 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:00.635268 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5f5ee-d229-412b-8c3d-ad4dfcc66482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:00.635450 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd64d10-0bf5-43db-8ef3-c90df91b8d41 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:00.650378 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd64d10-0bf5-43db-8ef3-c90df91b8d41 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:00.656276 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-b4c5f5ee-d229-412b-8c3d-ad4dfcc66482 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:00.657709 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-b4c5f5ee-d229-412b-8c3d-ad4dfcc66482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:00.658030 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd9b36-af19-42f9-bbfb-f4a900f125b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:00.658891 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd9b36-af19-42f9-bbfb-f4a900f125b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:00.659169 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd9b36-af19-42f9-bbfb-f4a900f125b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:00.659445 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd9b36-af19-42f9-bbfb-f4a900f125b5 admin admin] PATH_INFO: `/v3/groups/8f66b39f2d1a476cbd33600fa3b12bc0` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:00.660747 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd9b36-af19-42f9-bbfb-f4a900f125b5 admin admin] RBAC: Authorizing `identity:get_group(group_id=8f66b39f2d1a476cbd33600fa3b12bc0)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:00.662839 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd9b36-af19-42f9-bbfb-f4a900f125b5 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:00.665091 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 216/429] 10.222.0.62 () {56 vars in 1201 bytes} [Tue Nov 23 19:16:00 2021] GET /identity/v3/groups/8f66b39f2d1a476cbd33600fa3b12bc0 => generated 229 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:00.667465 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 214/430] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:16:00.671993 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd9b36-af19-42f9-bbfb-f4a900f125b5 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:00.687622 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd9b36-af19-42f9-bbfb-f4a900f125b5 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:00.692862 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5f5ee-d229-412b-8c3d-ad4dfcc66482 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:00.697808 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40e418-38da-4098-8c45-e48c514246ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:00.698680 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40e418-38da-4098-8c45-e48c514246ea admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:00.698961 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40e418-38da-4098-8c45-e48c514246ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:00.699237 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40e418-38da-4098-8c45-e48c514246ea admin admin] PATH_INFO: `/v3/projects/bbbece3b7f8c49dc96e2d01b1a42f43c` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:00.700601 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc40e418-38da-4098-8c45-e48c514246ea admin admin] RBAC: Authorizing `identity:get_project(project_id=bbbece3b7f8c49dc96e2d01b1a42f43c)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:00.702318 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc40e418-38da-4098-8c45-e48c514246ea admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:00.704159 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 217/431] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:16:00 2021] GET /identity/v3/projects/bbbece3b7f8c49dc96e2d01b1a42f43c => generated 344 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:00.710449 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40e418-38da-4098-8c45-e48c514246ea admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:00.712931 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5f5ee-d229-412b-8c3d-ad4dfcc66482 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:00.725016 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf7180-2e57-44cb-913e-15aa00aa4833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:00.725852 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf7180-2e57-44cb-913e-15aa00aa4833 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:00.726132 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf7180-2e57-44cb-913e-15aa00aa4833 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:00.726404 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf7180-2e57-44cb-913e-15aa00aa4833 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:00.728897 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40e418-38da-4098-8c45-e48c514246ea admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:00.739481 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2a932-a287-49b5-b678-219e8bdfcbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:00.740388 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2a932-a287-49b5-b678-219e8bdfcbed admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:00.740675 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2a932-a287-49b5-b678-219e8bdfcbed admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:00.740949 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2a932-a287-49b5-b678-219e8bdfcbed admin admin] PATH_INFO: `/v3/projects/bbbece3b7f8c49dc96e2d01b1a42f43c/groups/8f66b39f2d1a476cbd33600fa3b12bc0/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:00.744632 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2a932-a287-49b5-b678-219e8bdfcbed admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbbece3b7f8c49dc96e2d01b1a42f43c, group_id=8f66b39f2d1a476cbd33600fa3b12bc0, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:00.747939 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2a932-a287-49b5-b678-219e8bdfcbed admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:00.755028 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf7180-2e57-44cb-913e-15aa00aa4833 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:00.765029 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-dadf7180-2e57-44cb-913e-15aa00aa4833 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 19:16:00.766638 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 215/432] 10.222.0.62 () {56 vars in 1135 bytes} [Tue Nov 23 19:16:00 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:00.774578 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf7180-2e57-44cb-913e-15aa00aa4833 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:00.790446 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf7180-2e57-44cb-913e-15aa00aa4833 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:00.790446 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff52b20-c027-4076-a23b-cb17f6916d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:00.790897 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff52b20-c027-4076-a23b-cb17f6916d9c admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:00.790897 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff52b20-c027-4076-a23b-cb17f6916d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:00.791170 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff52b20-c027-4076-a23b-cb17f6916d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:00.791864 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff52b20-c027-4076-a23b-cb17f6916d9c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:00.792225 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff52b20-c027-4076-a23b-cb17f6916d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:00.793879 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff52b20-c027-4076-a23b-cb17f6916d9c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:00.807298 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 216/433] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:00 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:00.812972 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff52b20-c027-4076-a23b-cb17f6916d9c admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:00.823499 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff52b20-c027-4076-a23b-cb17f6916d9c admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:00.828561 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fc814-f842-40af-92a4-5274f491a469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:00.829587 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fc814-f842-40af-92a4-5274f491a469 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:00.829870 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fc814-f842-40af-92a4-5274f491a469 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:00.830144 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fc814-f842-40af-92a4-5274f491a469 admin admin] PATH_INFO: `/v3/groups/5a59719437d94ebbb0ac266175d5c666` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:00.831498 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7fc814-f842-40af-92a4-5274f491a469 admin admin] RBAC: Authorizing `identity:get_group(group_id=5a59719437d94ebbb0ac266175d5c666)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:00.833505 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7fc814-f842-40af-92a4-5274f491a469 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:00.835597 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 217/434] 10.222.0.62 () {56 vars in 1201 bytes} [Tue Nov 23 19:16:00 2021] GET /identity/v3/groups/5a59719437d94ebbb0ac266175d5c666 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:00.840784 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fc814-f842-40af-92a4-5274f491a469 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:00.849217 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 218/435] 10.222.0.62 () {58 vars in 1463 bytes} [Tue Nov 23 19:16:00 2021] PUT /identity/v3/projects/bbbece3b7f8c49dc96e2d01b1a42f43c/groups/8f66b39f2d1a476cbd33600fa3b12bc0/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:16:00.864447 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fc814-f842-40af-92a4-5274f491a469 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:00.936550 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3262db8-1129-464e-a830-251cad74cb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:00.937428 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3262db8-1129-464e-a830-251cad74cb7e admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:00.937720 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3262db8-1129-464e-a830-251cad74cb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:00.937999 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3262db8-1129-464e-a830-251cad74cb7e admin admin] PATH_INFO: `/v3/projects/d57902468b3746628ca506df9bca7068` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:00.939317 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3262db8-1129-464e-a830-251cad74cb7e admin admin] RBAC: Authorizing `identity:get_project(project_id=d57902468b3746628ca506df9bca7068)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:00.941623 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3262db8-1129-464e-a830-251cad74cb7e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:00.943890 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 218/436] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:16:00 2021] GET /identity/v3/projects/d57902468b3746628ca506df9bca7068 => generated 302 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:00.950181 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2a932-a287-49b5-b678-219e8bdfcbed admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:00.962705 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2a932-a287-49b5-b678-219e8bdfcbed admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:00.968452 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f3bb7-a2e2-4732-8a02-d0f3fe688337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:00.969443 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f3bb7-a2e2-4732-8a02-d0f3fe688337 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:00.969720 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f3bb7-a2e2-4732-8a02-d0f3fe688337 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:00.970047 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f3bb7-a2e2-4732-8a02-d0f3fe688337 admin admin] PATH_INFO: `/v3/projects/d57902468b3746628ca506df9bca7068/groups/5a59719437d94ebbb0ac266175d5c666/roles/bc8a8682d8f748788fb70d235f9978dc` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:00.973701 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f3bb7-a2e2-4732-8a02-d0f3fe688337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d57902468b3746628ca506df9bca7068, group_id=5a59719437d94ebbb0ac266175d5c666, role_id=bc8a8682d8f748788fb70d235f9978dc)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:00.976512 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f3bb7-a2e2-4732-8a02-d0f3fe688337 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:01.083706 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 219/437] 10.222.0.62 () {58 vars in 1463 bytes} [Tue Nov 23 19:16:00 2021] PUT /identity/v3/projects/d57902468b3746628ca506df9bca7068/groups/5a59719437d94ebbb0ac266175d5c666/roles/bc8a8682d8f748788fb70d235f9978dc => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:16:01.988952 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e40d12-c3c9-4ce3-a3ed-88c70c25cb4b None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:01.998230 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e40d12-c3c9-4ce3-a3ed-88c70c25cb4b None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:01.998230 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e40d12-c3c9-4ce3-a3ed-88c70c25cb4b None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:01.998230 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 219/438] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:01.998461 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4dbb79-63bc-4c7f-9975-93037b02ea95 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:01.999237 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4dbb79-63bc-4c7f-9975-93037b02ea95 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:01.999773 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4dbb79-63bc-4c7f-9975-93037b02ea95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:02.024638 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-6b4dbb79-63bc-4c7f-9975-93037b02ea95 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:02.026181 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-6b4dbb79-63bc-4c7f-9975-93037b02ea95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:02.094190 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 220/439] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:01 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:16:02.139599 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e40d12-c3c9-4ce3-a3ed-88c70c25cb4b None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:02.154624 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e40d12-c3c9-4ce3-a3ed-88c70c25cb4b None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:02.165875 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba39aa-e306-4293-a723-cd16be99eb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:02.167027 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba39aa-e306-4293-a723-cd16be99eb97 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:02.167532 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba39aa-e306-4293-a723-cd16be99eb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:02.168070 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba39aa-e306-4293-a723-cd16be99eb97 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:02.183588 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba39aa-e306-4293-a723-cd16be99eb97 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:02.191625 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-65ba39aa-e306-4293-a723-cd16be99eb97 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 19:16:02.193160 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 220/440] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:16:02 2021] GET /identity/v3/roles/member => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:02.199972 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4dbb79-63bc-4c7f-9975-93037b02ea95 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:02.212119 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4dbb79-63bc-4c7f-9975-93037b02ea95 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:02.221384 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c12a8-c9e8-4513-b9e3-1ad91ec7a057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:02.222439 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c12a8-c9e8-4513-b9e3-1ad91ec7a057 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:02.222947 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c12a8-c9e8-4513-b9e3-1ad91ec7a057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:02.223421 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c12a8-c9e8-4513-b9e3-1ad91ec7a057 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:02.224394 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c12a8-c9e8-4513-b9e3-1ad91ec7a057 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:02.224929 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c12a8-c9e8-4513-b9e3-1ad91ec7a057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:02.226761 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c12a8-c9e8-4513-b9e3-1ad91ec7a057 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:02.237862 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 221/441] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Nov 23 19:16:02 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:02.243729 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba39aa-e306-4293-a723-cd16be99eb97 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:02.254695 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba39aa-e306-4293-a723-cd16be99eb97 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:02.259683 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a16b1d-0fb6-491e-b17d-44cf06454705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:02.260620 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a16b1d-0fb6-491e-b17d-44cf06454705 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:02.261104 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a16b1d-0fb6-491e-b17d-44cf06454705 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:02.261643 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a16b1d-0fb6-491e-b17d-44cf06454705 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:02.271184 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a16b1d-0fb6-491e-b17d-44cf06454705 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:02.277216 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a16b1d-0fb6-491e-b17d-44cf06454705 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:02.283741 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 221/442] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:16:02 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:16:02.289592 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c12a8-c9e8-4513-b9e3-1ad91ec7a057 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:02.301974 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c12a8-c9e8-4513-b9e3-1ad91ec7a057 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:02.311171 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763c3b2-109d-4fe7-a6a7-6e6d3d517200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:02.312428 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763c3b2-109d-4fe7-a6a7-6e6d3d517200 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:02.312915 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763c3b2-109d-4fe7-a6a7-6e6d3d517200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:02.313436 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763c3b2-109d-4fe7-a6a7-6e6d3d517200 admin admin] PATH_INFO: `/v3/projects/d57902468b3746628ca506df9bca7068` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:02.314876 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763c3b2-109d-4fe7-a6a7-6e6d3d517200 admin admin] RBAC: Authorizing `identity:get_project(project_id=d57902468b3746628ca506df9bca7068)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:02.317202 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763c3b2-109d-4fe7-a6a7-6e6d3d517200 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:02.319196 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 222/443] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:16:02 2021] GET /identity/v3/projects/d57902468b3746628ca506df9bca7068 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:02.325670 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a16b1d-0fb6-491e-b17d-44cf06454705 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:02.335302 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a16b1d-0fb6-491e-b17d-44cf06454705 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:02.342795 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97f2b2-8bf0-4c49-981e-cd33e6a76ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:02.343983 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97f2b2-8bf0-4c49-981e-cd33e6a76ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:02.344531 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97f2b2-8bf0-4c49-981e-cd33e6a76ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:02.345005 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97f2b2-8bf0-4c49-981e-cd33e6a76ec1 admin admin] PATH_INFO: `/v3/groups/5a59719437d94ebbb0ac266175d5c666` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:02.346594 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97f2b2-8bf0-4c49-981e-cd33e6a76ec1 admin admin] RBAC: Authorizing `identity:get_group(group_id=5a59719437d94ebbb0ac266175d5c666)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:02.348745 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97f2b2-8bf0-4c49-981e-cd33e6a76ec1 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:02.351071 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 222/444] 10.222.0.62 () {56 vars in 1201 bytes} [Tue Nov 23 19:16:02 2021] GET /identity/v3/groups/5a59719437d94ebbb0ac266175d5c666 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:02.357839 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763c3b2-109d-4fe7-a6a7-6e6d3d517200 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:02.369993 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763c3b2-109d-4fe7-a6a7-6e6d3d517200 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:02.375829 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a7c9c-5455-43a5-9ea2-44a787bd6bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:02.376783 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a7c9c-5455-43a5-9ea2-44a787bd6bfa admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:02.377287 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a7c9c-5455-43a5-9ea2-44a787bd6bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:02.377885 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a7c9c-5455-43a5-9ea2-44a787bd6bfa admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:02.379047 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a7c9c-5455-43a5-9ea2-44a787bd6bfa admin admin] RBAC: Adding query filter params (group.id=5a59719437d94ebbb0ac266175d5c666, role.id=f8b0ca7636ad450b94f68df7bc4497aa, scope.project.id=d57902468b3746628ca506df9bca7068) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:02.379676 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a7c9c-5455-43a5-9ea2-44a787bd6bfa admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:02.381831 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a7c9c-5455-43a5-9ea2-44a787bd6bfa admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:02.392792 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 223/445] 10.222.0.62 () {56 vars in 1397 bytes} [Tue Nov 23 19:16:02 2021] GET /identity/v3/role_assignments?group.id=5a59719437d94ebbb0ac266175d5c666&scope.project.id=d57902468b3746628ca506df9bca7068&role.id=f8b0ca7636ad450b94f68df7bc4497aa => generated 611 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:02.471231 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f98c8-8746-4bcb-956d-c8669b3110a5 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:02.471869 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f98c8-8746-4bcb-956d-c8669b3110a5 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:02.472346 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f98c8-8746-4bcb-956d-c8669b3110a5 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:02.474763 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 223/446] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:02 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:02.480762 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace6224-4388-4a80-890a-a6d9ff909772 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:02.481317 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace6224-4388-4a80-890a-a6d9ff909772 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:02.482529 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace6224-4388-4a80-890a-a6d9ff909772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:02.504347 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-eace6224-4388-4a80-890a-a6d9ff909772 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:02.505975 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-eace6224-4388-4a80-890a-a6d9ff909772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:02.517180 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 224/447] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:16:02.552016 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f98c8-8746-4bcb-956d-c8669b3110a5 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:02.565473 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f98c8-8746-4bcb-956d-c8669b3110a5 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:02.570801 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595f35d-c6b9-44aa-8a54-19f74ddf8e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:02.571838 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595f35d-c6b9-44aa-8a54-19f74ddf8e50 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:02.572361 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595f35d-c6b9-44aa-8a54-19f74ddf8e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:02.572833 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595f35d-c6b9-44aa-8a54-19f74ddf8e50 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:02.586016 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d595f35d-c6b9-44aa-8a54-19f74ddf8e50 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:02.594465 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-d595f35d-c6b9-44aa-8a54-19f74ddf8e50 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 19:16:02.595929 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 224/448] 10.222.0.62 () {56 vars in 1135 bytes} [Tue Nov 23 19:16:02 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:02.603125 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace6224-4388-4a80-890a-a6d9ff909772 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:02.613306 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace6224-4388-4a80-890a-a6d9ff909772 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:02.621275 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c6f1f-a5b1-4e76-909e-ea30d12e35e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:02.622459 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c6f1f-a5b1-4e76-909e-ea30d12e35e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:02.622912 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c6f1f-a5b1-4e76-909e-ea30d12e35e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:02.629653 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c6f1f-a5b1-4e76-909e-ea30d12e35e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:02.629653 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c6f1f-a5b1-4e76-909e-ea30d12e35e6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:02.629653 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c6f1f-a5b1-4e76-909e-ea30d12e35e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:02.631136 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c6f1f-a5b1-4e76-909e-ea30d12e35e6 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:02.643869 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 225/449] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:02 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:02.650268 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595f35d-c6b9-44aa-8a54-19f74ddf8e50 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:02.666969 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595f35d-c6b9-44aa-8a54-19f74ddf8e50 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:02.677848 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e525c33-1fff-4579-80eb-b9b5e81893f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:02.678503 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e525c33-1fff-4579-80eb-b9b5e81893f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:02.678786 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e525c33-1fff-4579-80eb-b9b5e81893f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:02.679060 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e525c33-1fff-4579-80eb-b9b5e81893f9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:02.698478 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e525c33-1fff-4579-80eb-b9b5e81893f9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:02.700294 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e525c33-1fff-4579-80eb-b9b5e81893f9 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:02.715538 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 225/450] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:16:02 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:16:02.721861 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c6f1f-a5b1-4e76-909e-ea30d12e35e6 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:02.737770 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c6f1f-a5b1-4e76-909e-ea30d12e35e6 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:02.744379 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f457ec-5cf3-4eac-abc3-33fb30b777ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:02.745647 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f457ec-5cf3-4eac-abc3-33fb30b777ff admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:02.746132 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f457ec-5cf3-4eac-abc3-33fb30b777ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:02.746604 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f457ec-5cf3-4eac-abc3-33fb30b777ff admin admin] PATH_INFO: `/v3/projects/febc4f33fba1433992fc8e043a47dd5c` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:02.749087 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f457ec-5cf3-4eac-abc3-33fb30b777ff admin admin] RBAC: Authorizing `identity:get_project(project_id=febc4f33fba1433992fc8e043a47dd5c)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:02.751741 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f457ec-5cf3-4eac-abc3-33fb30b777ff admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:02.756859 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 226/451] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:16:02 2021] GET /identity/v3/projects/febc4f33fba1433992fc8e043a47dd5c => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:02.762461 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e525c33-1fff-4579-80eb-b9b5e81893f9 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:02.774391 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e525c33-1fff-4579-80eb-b9b5e81893f9 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:02.783587 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f55714-e3a7-4439-aee4-73b61ecb2602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:02.784635 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f55714-e3a7-4439-aee4-73b61ecb2602 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:02.784919 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f55714-e3a7-4439-aee4-73b61ecb2602 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:02.785193 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f55714-e3a7-4439-aee4-73b61ecb2602 admin admin] PATH_INFO: `/v3/groups/5a59719437d94ebbb0ac266175d5c666` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:02.786447 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f55714-e3a7-4439-aee4-73b61ecb2602 admin admin] RBAC: Authorizing `identity:get_group(group_id=5a59719437d94ebbb0ac266175d5c666)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:02.788328 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f55714-e3a7-4439-aee4-73b61ecb2602 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:02.790252 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 226/452] 10.222.0.62 () {56 vars in 1201 bytes} [Tue Nov 23 19:16:02 2021] GET /identity/v3/groups/5a59719437d94ebbb0ac266175d5c666 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:02.797891 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f457ec-5cf3-4eac-abc3-33fb30b777ff admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:02.809226 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f457ec-5cf3-4eac-abc3-33fb30b777ff admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:02.817559 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd81fd4-7cd3-4d2d-800a-195f48f0f602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:02.818537 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd81fd4-7cd3-4d2d-800a-195f48f0f602 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:02.819042 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd81fd4-7cd3-4d2d-800a-195f48f0f602 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:02.819532 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd81fd4-7cd3-4d2d-800a-195f48f0f602 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:02.820869 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd81fd4-7cd3-4d2d-800a-195f48f0f602 admin admin] RBAC: Adding query filter params (group.id=5a59719437d94ebbb0ac266175d5c666, role.id=bc8a8682d8f748788fb70d235f9978dc, scope.project.id=febc4f33fba1433992fc8e043a47dd5c) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:02.821429 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd81fd4-7cd3-4d2d-800a-195f48f0f602 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:02.823607 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd81fd4-7cd3-4d2d-800a-195f48f0f602 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:02.830811 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 227/453] 10.222.0.62 () {56 vars in 1397 bytes} [Tue Nov 23 19:16:02 2021] GET /identity/v3/role_assignments?group.id=5a59719437d94ebbb0ac266175d5c666&scope.project.id=febc4f33fba1433992fc8e043a47dd5c&role.id=bc8a8682d8f748788fb70d235f9978dc => generated 611 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:03.111612 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384e3e2-c7ac-43a1-9c45-f5250a36f2a1 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:03.112146 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384e3e2-c7ac-43a1-9c45-f5250a36f2a1 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:03.112146 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384e3e2-c7ac-43a1-9c45-f5250a36f2a1 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:03.114279 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 227/454] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:03.120334 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10373634-536e-47b0-8d8f-b8a65feebe50 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:03.120777 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10373634-536e-47b0-8d8f-b8a65feebe50 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:03.120952 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10373634-536e-47b0-8d8f-b8a65feebe50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:03.144853 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-10373634-536e-47b0-8d8f-b8a65feebe50 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:03.146070 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-10373634-536e-47b0-8d8f-b8a65feebe50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:03.157562 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 228/455] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:16:03.182210 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384e3e2-c7ac-43a1-9c45-f5250a36f2a1 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:03.198438 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384e3e2-c7ac-43a1-9c45-f5250a36f2a1 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:03.204039 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a17f29-9d8f-4294-bb80-0ea46058b8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:03.204889 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a17f29-9d8f-4294-bb80-0ea46058b8b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:03.205175 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a17f29-9d8f-4294-bb80-0ea46058b8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:03.205544 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a17f29-9d8f-4294-bb80-0ea46058b8b7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:03.220067 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a17f29-9d8f-4294-bb80-0ea46058b8b7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:03.227043 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-38a17f29-9d8f-4294-bb80-0ea46058b8b7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 23 19:16:03.228534 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 228/456] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:16:03 2021] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:03.234884 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10373634-536e-47b0-8d8f-b8a65feebe50 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:03.245768 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10373634-536e-47b0-8d8f-b8a65feebe50 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:03.251628 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0d0da-77ef-45f0-88ef-2de47147b07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:03.252572 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0d0da-77ef-45f0-88ef-2de47147b07a admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:03.253059 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0d0da-77ef-45f0-88ef-2de47147b07a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:03.253558 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0d0da-77ef-45f0-88ef-2de47147b07a admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:03.254521 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0d0da-77ef-45f0-88ef-2de47147b07a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:03.255053 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0d0da-77ef-45f0-88ef-2de47147b07a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:03.256898 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0d0da-77ef-45f0-88ef-2de47147b07a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:03.272451 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 229/457] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Nov 23 19:16:03 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:03.273998 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a17f29-9d8f-4294-bb80-0ea46058b8b7 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:03.285605 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a17f29-9d8f-4294-bb80-0ea46058b8b7 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:03.290224 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b379c6-6f3f-4b31-a1bb-7f8c7342b7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:03.290863 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b379c6-6f3f-4b31-a1bb-7f8c7342b7d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:03.291143 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b379c6-6f3f-4b31-a1bb-7f8c7342b7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:03.291426 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b379c6-6f3f-4b31-a1bb-7f8c7342b7d8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:03.300378 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b379c6-6f3f-4b31-a1bb-7f8c7342b7d8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:03.302161 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b379c6-6f3f-4b31-a1bb-7f8c7342b7d8 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:03.312614 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 229/458] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:16:03 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:16:03.319343 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0d0da-77ef-45f0-88ef-2de47147b07a admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:03.330801 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0d0da-77ef-45f0-88ef-2de47147b07a admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:03.335354 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030409bb-bcd4-497f-a224-ba224c8a8ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:03.336253 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030409bb-bcd4-497f-a224-ba224c8a8ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:03.336587 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030409bb-bcd4-497f-a224-ba224c8a8ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:03.336868 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030409bb-bcd4-497f-a224-ba224c8a8ed0 admin admin] PATH_INFO: `/v3/projects/febc4f33fba1433992fc8e043a47dd5c` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:03.338100 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030409bb-bcd4-497f-a224-ba224c8a8ed0 admin admin] RBAC: Authorizing `identity:get_project(project_id=febc4f33fba1433992fc8e043a47dd5c)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:03.340177 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030409bb-bcd4-497f-a224-ba224c8a8ed0 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:03.342333 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 230/459] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:16:03 2021] GET /identity/v3/projects/febc4f33fba1433992fc8e043a47dd5c => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:03.348665 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b379c6-6f3f-4b31-a1bb-7f8c7342b7d8 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:03.361423 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b379c6-6f3f-4b31-a1bb-7f8c7342b7d8 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:03.365656 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b60df-2133-459e-ba4b-d8d3e9f07276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:03.366514 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b60df-2133-459e-ba4b-d8d3e9f07276 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:03.366797 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b60df-2133-459e-ba4b-d8d3e9f07276 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:03.367074 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b60df-2133-459e-ba4b-d8d3e9f07276 admin admin] PATH_INFO: `/v3/groups/5a59719437d94ebbb0ac266175d5c666` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:03.368331 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b60df-2133-459e-ba4b-d8d3e9f07276 admin admin] RBAC: Authorizing `identity:get_group(group_id=5a59719437d94ebbb0ac266175d5c666)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:03.370368 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b60df-2133-459e-ba4b-d8d3e9f07276 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:03.373165 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 230/460] 10.222.0.62 () {56 vars in 1201 bytes} [Tue Nov 23 19:16:03 2021] GET /identity/v3/groups/5a59719437d94ebbb0ac266175d5c666 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:03.380026 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030409bb-bcd4-497f-a224-ba224c8a8ed0 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:03.392249 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030409bb-bcd4-497f-a224-ba224c8a8ed0 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:03.397209 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65eb69-3a0b-4a38-af11-7c379942677d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:03.398151 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65eb69-3a0b-4a38-af11-7c379942677d admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:03.398616 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65eb69-3a0b-4a38-af11-7c379942677d admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:03.399121 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65eb69-3a0b-4a38-af11-7c379942677d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:03.400193 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65eb69-3a0b-4a38-af11-7c379942677d admin admin] RBAC: Adding query filter params (group.id=5a59719437d94ebbb0ac266175d5c666, role.id=f8b0ca7636ad450b94f68df7bc4497aa, scope.project.id=febc4f33fba1433992fc8e043a47dd5c) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:03.400648 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65eb69-3a0b-4a38-af11-7c379942677d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:03.402790 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65eb69-3a0b-4a38-af11-7c379942677d admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:03.410924 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 231/461] 10.222.0.62 () {56 vars in 1397 bytes} [Tue Nov 23 19:16:03 2021] GET /identity/v3/role_assignments?group.id=5a59719437d94ebbb0ac266175d5c666&scope.project.id=febc4f33fba1433992fc8e043a47dd5c&role.id=f8b0ca7636ad450b94f68df7bc4497aa => generated 611 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:03.788741 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc6fad-6a33-4abb-ac17-008372e0abd5 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:03.789025 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc6fad-6a33-4abb-ac17-008372e0abd5 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:03.789302 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc6fad-6a33-4abb-ac17-008372e0abd5 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:03.791111 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 231/462] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:03.797806 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d76f61-69ad-4533-9950-c2efd43f6a50 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:03.798101 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d76f61-69ad-4533-9950-c2efd43f6a50 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:03.798384 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d76f61-69ad-4533-9950-c2efd43f6a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:03.817297 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-f7d76f61-69ad-4533-9950-c2efd43f6a50 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:03.818718 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-f7d76f61-69ad-4533-9950-c2efd43f6a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:03.827169 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 232/463] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:16:03.851397 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc6fad-6a33-4abb-ac17-008372e0abd5 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:03.858023 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba163c6-6d5c-450e-b27d-b653390d5e75 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:03.858370 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba163c6-6d5c-450e-b27d-b653390d5e75 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:03.858764 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba163c6-6d5c-450e-b27d-b653390d5e75 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:03.860424 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 233/464] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:03 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:03.865175 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc6fad-6a33-4abb-ac17-008372e0abd5 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:03.866198 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839813d-09f3-4f85-a273-9a92fef2b881 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:03.866488 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839813d-09f3-4f85-a273-9a92fef2b881 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:03.866806 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839813d-09f3-4f85-a273-9a92fef2b881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:03.869626 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef8a66-f0c1-45d0-9a33-5aaa04ad7cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:03.870403 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef8a66-f0c1-45d0-9a33-5aaa04ad7cfb admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:03.870681 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef8a66-f0c1-45d0-9a33-5aaa04ad7cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:03.870968 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef8a66-f0c1-45d0-9a33-5aaa04ad7cfb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:03.882312 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef8a66-f0c1-45d0-9a33-5aaa04ad7cfb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:03.884450 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-0839813d-09f3-4f85-a273-9a92fef2b881 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:03.885672 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-0839813d-09f3-4f85-a273-9a92fef2b881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:03.889333 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-bbef8a66-f0c1-45d0-9a33-5aaa04ad7cfb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 19:16:03.890858 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 232/465] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:16:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:03.896891 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef8a66-f0c1-45d0-9a33-5aaa04ad7cfb admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:03.901855 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 234/466] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 19:16:03.907378 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef8a66-f0c1-45d0-9a33-5aaa04ad7cfb admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:03.911920 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafdded-b7fc-40b5-8bc6-c232766de195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:03.912572 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafdded-b7fc-40b5-8bc6-c232766de195 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:03.912859 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafdded-b7fc-40b5-8bc6-c232766de195 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:03.913137 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafdded-b7fc-40b5-8bc6-c232766de195 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:03.913945 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fafdded-b7fc-40b5-8bc6-c232766de195 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:03.914255 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fafdded-b7fc-40b5-8bc6-c232766de195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:03.915849 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fafdded-b7fc-40b5-8bc6-c232766de195 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:03.919360 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839813d-09f3-4f85-a273-9a92fef2b881 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:03.926371 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 233/467] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:16:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:03.930152 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839813d-09f3-4f85-a273-9a92fef2b881 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:03.933700 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafdded-b7fc-40b5-8bc6-c232766de195 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:03.935382 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611b276-66a4-4691-a1f2-d2e537412b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:03.936336 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611b276-66a4-4691-a1f2-d2e537412b3e admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:03.937546 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611b276-66a4-4691-a1f2-d2e537412b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:03.937851 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611b276-66a4-4691-a1f2-d2e537412b3e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:03.944258 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafdded-b7fc-40b5-8bc6-c232766de195 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:03.952038 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611b276-66a4-4691-a1f2-d2e537412b3e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:03.952283 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7df4b-8a02-4d5c-8383-70aedae7df27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:03.952922 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7df4b-8a02-4d5c-8383-70aedae7df27 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:03.953197 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7df4b-8a02-4d5c-8383-70aedae7df27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:03.953504 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7df4b-8a02-4d5c-8383-70aedae7df27 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:03.959406 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-8611b276-66a4-4691-a1f2-d2e537412b3e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 19:16:03.960886 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 235/468] 10.222.0.62 () {56 vars in 1135 bytes} [Tue Nov 23 19:16:03 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:03.961948 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7df4b-8a02-4d5c-8383-70aedae7df27 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:03.963695 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7df4b-8a02-4d5c-8383-70aedae7df27 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:03.966995 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611b276-66a4-4691-a1f2-d2e537412b3e admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:03.973943 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 234/469] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:16:03 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:16:03.976631 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611b276-66a4-4691-a1f2-d2e537412b3e admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:03.980453 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7df4b-8a02-4d5c-8383-70aedae7df27 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:03.981092 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61a4b3-00f0-4e1a-a90e-4c3c5d7745c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:03.981808 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61a4b3-00f0-4e1a-a90e-4c3c5d7745c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:03.982089 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61a4b3-00f0-4e1a-a90e-4c3c5d7745c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:03.982492 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61a4b3-00f0-4e1a-a90e-4c3c5d7745c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:03.993367 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa61a4b3-00f0-4e1a-a90e-4c3c5d7745c1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:03.993367 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa61a4b3-00f0-4e1a-a90e-4c3c5d7745c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:03.993367 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa61a4b3-00f0-4e1a-a90e-4c3c5d7745c1 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:03.993617 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7df4b-8a02-4d5c-8383-70aedae7df27 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:03.993863 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd358a43-1dc3-4c6b-9208-c9864029f3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:03.994926 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 236/470] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:03 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:03.995036 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd358a43-1dc3-4c6b-9208-c9864029f3fb admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:03.995036 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd358a43-1dc3-4c6b-9208-c9864029f3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:03.995491 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd358a43-1dc3-4c6b-9208-c9864029f3fb admin admin] PATH_INFO: `/v3/projects/bbbece3b7f8c49dc96e2d01b1a42f43c` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:03.996719 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd358a43-1dc3-4c6b-9208-c9864029f3fb admin admin] RBAC: Authorizing `identity:get_project(project_id=bbbece3b7f8c49dc96e2d01b1a42f43c)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:03.999056 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd358a43-1dc3-4c6b-9208-c9864029f3fb admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:04.000706 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61a4b3-00f0-4e1a-a90e-4c3c5d7745c1 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:04.001238 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 235/471] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:16:03 2021] GET /identity/v3/projects/bbbece3b7f8c49dc96e2d01b1a42f43c => generated 344 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:04.006961 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd358a43-1dc3-4c6b-9208-c9864029f3fb admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:04.010551 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61a4b3-00f0-4e1a-a90e-4c3c5d7745c1 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:04.016896 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecbec8-48b2-4ffd-8482-b9160f747cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:04.017603 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecbec8-48b2-4ffd-8482-b9160f747cfd admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:04.017883 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecbec8-48b2-4ffd-8482-b9160f747cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:04.018187 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecbec8-48b2-4ffd-8482-b9160f747cfd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:04.018721 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd358a43-1dc3-4c6b-9208-c9864029f3fb admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:04.023132 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c5d1b-bba7-49fb-a857-46b45678fc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:04.023962 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c5d1b-bba7-49fb-a857-46b45678fc1e admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:04.024296 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c5d1b-bba7-49fb-a857-46b45678fc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:04.024575 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c5d1b-bba7-49fb-a857-46b45678fc1e admin admin] PATH_INFO: `/v3/groups/8f66b39f2d1a476cbd33600fa3b12bc0` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:04.026983 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c5d1b-bba7-49fb-a857-46b45678fc1e admin admin] RBAC: Authorizing `identity:get_group(group_id=8f66b39f2d1a476cbd33600fa3b12bc0)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:04.027901 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ecbec8-48b2-4ffd-8482-b9160f747cfd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:04.029385 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c5d1b-bba7-49fb-a857-46b45678fc1e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:04.030523 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ecbec8-48b2-4ffd-8482-b9160f747cfd admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:04.031027 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 236/472] 10.222.0.62 () {56 vars in 1201 bytes} [Tue Nov 23 19:16:04 2021] GET /identity/v3/groups/8f66b39f2d1a476cbd33600fa3b12bc0 => generated 229 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:04.037333 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c5d1b-bba7-49fb-a857-46b45678fc1e admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:04.040634 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 237/473] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:16:03 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 23 19:16:04.047324 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c5d1b-bba7-49fb-a857-46b45678fc1e admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:04.047608 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecbec8-48b2-4ffd-8482-b9160f747cfd admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:04.051638 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4761fb-6477-4eaa-a500-c65b036daf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:04.052353 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4761fb-6477-4eaa-a500-c65b036daf41 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:04.052640 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4761fb-6477-4eaa-a500-c65b036daf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:04.053440 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4761fb-6477-4eaa-a500-c65b036daf41 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:04.053780 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4761fb-6477-4eaa-a500-c65b036daf41 admin admin] RBAC: Adding query filter params (group.id=8f66b39f2d1a476cbd33600fa3b12bc0, role.id=6d9a8878ffeb49fea19d854657c6b767, scope.project.id=bbbece3b7f8c49dc96e2d01b1a42f43c) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:04.054093 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4761fb-6477-4eaa-a500-c65b036daf41 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:04.056093 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4761fb-6477-4eaa-a500-c65b036daf41 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:04.056684 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecbec8-48b2-4ffd-8482-b9160f747cfd admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:04.063409 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 237/474] 10.222.0.62 () {56 vars in 1397 bytes} [Tue Nov 23 19:16:04 2021] GET /identity/v3/role_assignments?group.id=8f66b39f2d1a476cbd33600fa3b12bc0&scope.project.id=bbbece3b7f8c49dc96e2d01b1a42f43c&role.id=6d9a8878ffeb49fea19d854657c6b767 => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:04.064347 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3127a07-8a1b-4c4a-b905-6567436dc423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:04.065208 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3127a07-8a1b-4c4a-b905-6567436dc423 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:04.065519 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3127a07-8a1b-4c4a-b905-6567436dc423 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:04.065798 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3127a07-8a1b-4c4a-b905-6567436dc423 admin admin] PATH_INFO: `/v3/projects/d57902468b3746628ca506df9bca7068` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:04.067021 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3127a07-8a1b-4c4a-b905-6567436dc423 admin admin] RBAC: Authorizing `identity:get_project(project_id=d57902468b3746628ca506df9bca7068)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:04.069057 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3127a07-8a1b-4c4a-b905-6567436dc423 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:04.071293 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 238/475] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:16:04 2021] GET /identity/v3/projects/d57902468b3746628ca506df9bca7068 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:04.078040 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4761fb-6477-4eaa-a500-c65b036daf41 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:04.088301 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4761fb-6477-4eaa-a500-c65b036daf41 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:04.093557 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ad034-e51e-4bc9-901c-4d808e43f35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:04.094447 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ad034-e51e-4bc9-901c-4d808e43f35b admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:04.094729 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ad034-e51e-4bc9-901c-4d808e43f35b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:04.095006 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ad034-e51e-4bc9-901c-4d808e43f35b admin admin] PATH_INFO: `/v3/groups/5a59719437d94ebbb0ac266175d5c666` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:04.096430 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ad034-e51e-4bc9-901c-4d808e43f35b admin admin] RBAC: Authorizing `identity:get_group(group_id=5a59719437d94ebbb0ac266175d5c666)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:04.098391 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ad034-e51e-4bc9-901c-4d808e43f35b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:04.100282 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 238/476] 10.222.0.62 () {56 vars in 1201 bytes} [Tue Nov 23 19:16:04 2021] GET /identity/v3/groups/5a59719437d94ebbb0ac266175d5c666 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:04.106896 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3127a07-8a1b-4c4a-b905-6567436dc423 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:04.117143 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3127a07-8a1b-4c4a-b905-6567436dc423 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:04.121711 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c985d85-128a-4d9f-9708-418c443cff55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:04.122457 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c985d85-128a-4d9f-9708-418c443cff55 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:04.122746 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c985d85-128a-4d9f-9708-418c443cff55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:04.123024 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c985d85-128a-4d9f-9708-418c443cff55 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:04.123893 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c985d85-128a-4d9f-9708-418c443cff55 admin admin] RBAC: Adding query filter params (group.id=5a59719437d94ebbb0ac266175d5c666, role.id=bc8a8682d8f748788fb70d235f9978dc, scope.project.id=d57902468b3746628ca506df9bca7068) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:04.124204 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c985d85-128a-4d9f-9708-418c443cff55 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:04.126095 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c985d85-128a-4d9f-9708-418c443cff55 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:04.132960 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 239/477] 10.222.0.62 () {56 vars in 1397 bytes} [Tue Nov 23 19:16:04 2021] GET /identity/v3/role_assignments?group.id=5a59719437d94ebbb0ac266175d5c666&scope.project.id=d57902468b3746628ca506df9bca7068&role.id=bc8a8682d8f748788fb70d235f9978dc => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:07.255758 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741e9cc-b96e-4d3f-b1fc-c17ece3e989a None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:07.256277 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741e9cc-b96e-4d3f-b1fc-c17ece3e989a None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:07.256351 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741e9cc-b96e-4d3f-b1fc-c17ece3e989a None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:07.258446 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 239/478] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:07.263713 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91b437-1d30-438b-bab5-31c7bfbdbeb2 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:07.264327 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91b437-1d30-438b-bab5-31c7bfbdbeb2 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:07.264327 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91b437-1d30-438b-bab5-31c7bfbdbeb2 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:07.267194 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 240/479] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:07 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:07.267750 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceffbbd-1ce2-4e84-a137-29d33426487d None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:07.268040 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceffbbd-1ce2-4e84-a137-29d33426487d None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:07.268315 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceffbbd-1ce2-4e84-a137-29d33426487d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:07.271474 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ab555-f0eb-4a6a-bc8b-fe3e70fd8c7d None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:07.271809 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ab555-f0eb-4a6a-bc8b-fe3e70fd8c7d None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:07.272088 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ab555-f0eb-4a6a-bc8b-fe3e70fd8c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:07.289219 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-eceffbbd-1ce2-4e84-a137-29d33426487d None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:07.290461 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-eceffbbd-1ce2-4e84-a137-29d33426487d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:07.298098 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-1f0ab555-f0eb-4a6a-bc8b-fe3e70fd8c7d None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:07.298549 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 240/480] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:16:07.299527 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-1f0ab555-f0eb-4a6a-bc8b-fe3e70fd8c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:07.299645 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2daae5-ae3d-4f7d-9d4f-8d4fe2245236 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:07.299918 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2daae5-ae3d-4f7d-9d4f-8d4fe2245236 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:07.300191 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2daae5-ae3d-4f7d-9d4f-8d4fe2245236 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:07.302001 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 241/481] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:07.307782 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646d966-3a48-4161-89d1-3511a05487bd None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:07.308069 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646d966-3a48-4161-89d1-3511a05487bd None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:07.308345 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646d966-3a48-4161-89d1-3511a05487bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:07.323874 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 241/482] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 19:16:07.326736 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ab555-f0eb-4a6a-bc8b-fe3e70fd8c7d None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:07.327784 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-d646d966-3a48-4161-89d1-3511a05487bd None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:07.328963 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-d646d966-3a48-4161-89d1-3511a05487bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:07.336517 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ab555-f0eb-4a6a-bc8b-fe3e70fd8c7d None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:07.336856 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 242/483] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:16:07.350933 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263205f-0899-4900-9539-bd3ee03902bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:07.351728 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263205f-0899-4900-9539-bd3ee03902bf admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:07.352015 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263205f-0899-4900-9539-bd3ee03902bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:07.352291 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263205f-0899-4900-9539-bd3ee03902bf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:07.359072 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646d966-3a48-4161-89d1-3511a05487bd None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:07.368408 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263205f-0899-4900-9539-bd3ee03902bf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:07.370273 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263205f-0899-4900-9539-bd3ee03902bf admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:07.372467 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646d966-3a48-4161-89d1-3511a05487bd None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:07.378165 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1cbbdd-0439-49ee-9793-dff6efa03c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:07.378958 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1cbbdd-0439-49ee-9793-dff6efa03c22 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:07.379240 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1cbbdd-0439-49ee-9793-dff6efa03c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:07.379513 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1cbbdd-0439-49ee-9793-dff6efa03c22 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:07.390649 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1cbbdd-0439-49ee-9793-dff6efa03c22 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:07.392475 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1cbbdd-0439-49ee-9793-dff6efa03c22 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:07.394309 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-6263205f-0899-4900-9539-bd3ee03902bf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:07.396341 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 242/484] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:07.397388 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263205f-0899-4900-9539-bd3ee03902bf admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:07.408361 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263205f-0899-4900-9539-bd3ee03902bf admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:07.410378 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-bb1cbbdd-0439-49ee-9793-dff6efa03c22 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:07.413319 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1021f931-c288-4ed5-b990-6de289191f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:07.414385 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021f931-c288-4ed5-b990-6de289191f50 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:07.414883 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021f931-c288-4ed5-b990-6de289191f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:07.415352 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021f931-c288-4ed5-b990-6de289191f50 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:07.416821 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 243/485] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:07.417669 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1cbbdd-0439-49ee-9793-dff6efa03c22 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:07.428193 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1021f931-c288-4ed5-b990-6de289191f50 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:07.428383 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1cbbdd-0439-49ee-9793-dff6efa03c22 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:07.430672 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1021f931-c288-4ed5-b990-6de289191f50 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:07.432833 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ff1f1-7c2a-46ab-a090-4daa793bcfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:07.433516 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ff1f1-7c2a-46ab-a090-4daa793bcfaa admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:07.433802 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ff1f1-7c2a-46ab-a090-4daa793bcfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:07.434076 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ff1f1-7c2a-46ab-a090-4daa793bcfaa admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:07.434817 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ff1f1-7c2a-46ab-a090-4daa793bcfaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:07.435699 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ff1f1-7c2a-46ab-a090-4daa793bcfaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:07.437451 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ff1f1-7c2a-46ab-a090-4daa793bcfaa admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:07.449853 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 244/486] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:07.450871 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ff1f1-7c2a-46ab-a090-4daa793bcfaa admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:07.454160 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-1021f931-c288-4ed5-b990-6de289191f50 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:07.455594 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 243/487] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:07.461441 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1021f931-c288-4ed5-b990-6de289191f50 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:07.465682 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ff1f1-7c2a-46ab-a090-4daa793bcfaa admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:07.470656 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d37ade-35a0-45b6-b7cd-7695a4ee29bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:07.471303 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d37ade-35a0-45b6-b7cd-7695a4ee29bb admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:07.471589 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d37ade-35a0-45b6-b7cd-7695a4ee29bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:07.471706 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1021f931-c288-4ed5-b990-6de289191f50 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:07.471881 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d37ade-35a0-45b6-b7cd-7695a4ee29bb admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:07.472599 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d37ade-35a0-45b6-b7cd-7695a4ee29bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:07.472905 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d37ade-35a0-45b6-b7cd-7695a4ee29bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:07.474688 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d37ade-35a0-45b6-b7cd-7695a4ee29bb admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:07.477881 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43f371-4e68-4528-8e45-a1f28e24c86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:07.478752 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43f371-4e68-4528-8e45-a1f28e24c86e admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:07.479332 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43f371-4e68-4528-8e45-a1f28e24c86e admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:07.479837 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43f371-4e68-4528-8e45-a1f28e24c86e admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:07.480747 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43f371-4e68-4528-8e45-a1f28e24c86e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:07.484551 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43f371-4e68-4528-8e45-a1f28e24c86e admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:07.487297 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 245/488] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:07.492938 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d37ade-35a0-45b6-b7cd-7695a4ee29bb admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:07.503193 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d37ade-35a0-45b6-b7cd-7695a4ee29bb admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:07.507594 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98262b-8ebf-4d72-8d82-2647680cf07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:07.508243 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98262b-8ebf-4d72-8d82-2647680cf07a admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:07.508546 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98262b-8ebf-4d72-8d82-2647680cf07a admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:07.508803 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98262b-8ebf-4d72-8d82-2647680cf07a admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:07.509569 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98262b-8ebf-4d72-8d82-2647680cf07a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:07.509881 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98262b-8ebf-4d72-8d82-2647680cf07a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:07.511461 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98262b-8ebf-4d72-8d82-2647680cf07a admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:07.523128 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 246/489] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:07.528088 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98262b-8ebf-4d72-8d82-2647680cf07a admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:07.537714 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98262b-8ebf-4d72-8d82-2647680cf07a admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:07.542028 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b840c0f-8154-4fb7-bcf4-e91c296cabf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:07.542656 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b840c0f-8154-4fb7-bcf4-e91c296cabf2 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:07.542939 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b840c0f-8154-4fb7-bcf4-e91c296cabf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:07.543215 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b840c0f-8154-4fb7-bcf4-e91c296cabf2 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:07.543962 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b840c0f-8154-4fb7-bcf4-e91c296cabf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:07.546470 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b840c0f-8154-4fb7-bcf4-e91c296cabf2 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:07.578036 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 244/490] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Nov 23 19:16:07 2021] POST /identity/v3/users => generated 246 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:16:07.579103 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43f371-4e68-4528-8e45-a1f28e24c86e admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:07.589751 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43f371-4e68-4528-8e45-a1f28e24c86e admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:07.595818 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3debc255-71f4-4a5a-bfa7-11e10cfb1ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:07.596963 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debc255-71f4-4a5a-bfa7-11e10cfb1ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:07.597560 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debc255-71f4-4a5a-bfa7-11e10cfb1ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:07.598111 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debc255-71f4-4a5a-bfa7-11e10cfb1ce5 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:07.599195 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3debc255-71f4-4a5a-bfa7-11e10cfb1ce5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:07.601594 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3debc255-71f4-4a5a-bfa7-11e10cfb1ce5 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:07.637458 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 247/491] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Nov 23 19:16:07 2021] POST /identity/v3/users => generated 248 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:16:07.713849 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 245/492] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Nov 23 19:16:07 2021] POST /identity/v3/users => generated 248 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:16:07.849986 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a3f32-e8d6-4294-b09c-b3175e400743 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:07.850679 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a3f32-e8d6-4294-b09c-b3175e400743 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:07.851165 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a3f32-e8d6-4294-b09c-b3175e400743 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:07.853792 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 248/493] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:07 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:07.860375 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0200fd7-f9df-4999-8d49-500c35bb42d7 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:07.861029 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0200fd7-f9df-4999-8d49-500c35bb42d7 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:07.861556 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0200fd7-f9df-4999-8d49-500c35bb42d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:07.884500 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-d0200fd7-f9df-4999-8d49-500c35bb42d7 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:07.886101 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-d0200fd7-f9df-4999-8d49-500c35bb42d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:07.896916 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 246/494] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:16:07.922707 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a3f32-e8d6-4294-b09c-b3175e400743 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:07.938893 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a3f32-e8d6-4294-b09c-b3175e400743 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:07.944694 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783216e-f9f8-40eb-9563-612b425fdee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:07.945553 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783216e-f9f8-40eb-9563-612b425fdee2 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:07.946095 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783216e-f9f8-40eb-9563-612b425fdee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:07.946369 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783216e-f9f8-40eb-9563-612b425fdee2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:07.959659 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783216e-f9f8-40eb-9563-612b425fdee2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:07.961496 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783216e-f9f8-40eb-9563-612b425fdee2 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:07.980615 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-1783216e-f9f8-40eb-9563-612b425fdee2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:07.982459 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 249/495] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:07.993598 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0200fd7-f9df-4999-8d49-500c35bb42d7 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:08.000976 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0200fd7-f9df-4999-8d49-500c35bb42d7 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:08.008406 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dcdc27-11a2-44ec-8e84-53c4293da317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:08.009196 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dcdc27-11a2-44ec-8e84-53c4293da317 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:08.009604 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dcdc27-11a2-44ec-8e84-53c4293da317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:08.009952 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dcdc27-11a2-44ec-8e84-53c4293da317 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:08.010919 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dcdc27-11a2-44ec-8e84-53c4293da317 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:08.011546 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dcdc27-11a2-44ec-8e84-53c4293da317 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:08.012632 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING py.warnings [None req-c3dcdc27-11a2-44ec-8e84-53c4293da317 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:16:08.012632 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: warnings.warn(msg) Nov 23 19:16:08.012632 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: Nov 23 19:16:08.014814 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dcdc27-11a2-44ec-8e84-53c4293da317 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:08.036321 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 247/496] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:08.042328 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783216e-f9f8-40eb-9563-612b425fdee2 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:08.053837 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783216e-f9f8-40eb-9563-612b425fdee2 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:08.058900 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66baab-74e3-45a4-a1bf-16200c50c852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:08.059503 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66baab-74e3-45a4-a1bf-16200c50c852 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:08.059826 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66baab-74e3-45a4-a1bf-16200c50c852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:08.061545 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66baab-74e3-45a4-a1bf-16200c50c852 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:08.062242 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66baab-74e3-45a4-a1bf-16200c50c852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:08.064454 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66baab-74e3-45a4-a1bf-16200c50c852 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:08.270896 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 250/497] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Nov 23 19:16:08 2021] POST /identity/v3/users => generated 249 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:16:08.512603 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a3598-a368-4261-8690-20917da0b79b None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:08.513756 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a3598-a368-4261-8690-20917da0b79b None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:08.514211 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a3598-a368-4261-8690-20917da0b79b None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:08.516469 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 248/498] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:08.522762 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ca05d-11d1-4a5f-86dc-32616b54c1de None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:08.523055 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ca05d-11d1-4a5f-86dc-32616b54c1de None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:08.523333 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ca05d-11d1-4a5f-86dc-32616b54c1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:08.543094 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-356ca05d-11d1-4a5f-86dc-32616b54c1de None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:08.544295 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-356ca05d-11d1-4a5f-86dc-32616b54c1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:08.557538 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 251/499] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:08 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 19:16:08.578990 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a3598-a368-4261-8690-20917da0b79b None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:08.596666 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a3598-a368-4261-8690-20917da0b79b None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:08.604561 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d654a3-6c47-407f-a728-a8319e6af113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:08.605231 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d654a3-6c47-407f-a728-a8319e6af113 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:08.605542 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d654a3-6c47-407f-a728-a8319e6af113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:08.605820 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d654a3-6c47-407f-a728-a8319e6af113 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:08.606598 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d654a3-6c47-407f-a728-a8319e6af113 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:08.609657 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d654a3-6c47-407f-a728-a8319e6af113 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:08.671333 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.sql.core [None req-a2d654a3-6c47-407f-a728-a8319e6af113 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 23 19:16:08.671333 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Nov 23 19:16:08.671333 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [parameters: {'id': '11f6b753ef9c448a86a9438e2394175d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Nov 23 19:16:08.671333 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79232) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 23 19:16:08.686985 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-a2d654a3-6c47-407f-a728-a8319e6af113 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Nov 23 19:16:08.693534 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 249/500] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:16:08 2021] POST /identity/v3/roles => generated 144 bytes in 110 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:08.695435 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ca05d-11d1-4a5f-86dc-32616b54c1de None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:08.707575 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ca05d-11d1-4a5f-86dc-32616b54c1de None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:08.714915 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179dd44-d686-4c98-9654-4edb1beb45cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:08.715735 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179dd44-d686-4c98-9654-4edb1beb45cd admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:08.716013 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179dd44-d686-4c98-9654-4edb1beb45cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:08.717291 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179dd44-d686-4c98-9654-4edb1beb45cd admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:08.730443 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179dd44-d686-4c98-9654-4edb1beb45cd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:08.739314 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-0179dd44-d686-4c98-9654-4edb1beb45cd admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 23 19:16:08.740615 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 252/501] 10.222.0.62 () {56 vars in 1135 bytes} [Tue Nov 23 19:16:08 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:08.747127 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d654a3-6c47-407f-a728-a8319e6af113 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:08.760070 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d654a3-6c47-407f-a728-a8319e6af113 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:08.765795 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cd124-5ce5-4c5f-a0a7-33e6b12e24f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:08.766453 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cd124-5ce5-4c5f-a0a7-33e6b12e24f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:08.766737 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cd124-5ce5-4c5f-a0a7-33e6b12e24f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:08.767014 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cd124-5ce5-4c5f-a0a7-33e6b12e24f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:08.767992 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cd124-5ce5-4c5f-a0a7-33e6b12e24f9 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:08.768305 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cd124-5ce5-4c5f-a0a7-33e6b12e24f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:08.769972 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cd124-5ce5-4c5f-a0a7-33e6b12e24f9 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:08.781293 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 250/502] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:08 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:10.299396 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a590a-116a-40e9-865b-6d405cdf6530 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:10.299918 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a590a-116a-40e9-865b-6d405cdf6530 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:10.299918 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a590a-116a-40e9-865b-6d405cdf6530 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:10.302389 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 253/503] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:10.311816 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37325e7-a127-474e-b2ee-d7e80422542a None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:10.312334 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37325e7-a127-474e-b2ee-d7e80422542a None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:10.312436 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37325e7-a127-474e-b2ee-d7e80422542a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:10.336500 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-a37325e7-a127-474e-b2ee-d7e80422542a None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:10.337745 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-a37325e7-a127-474e-b2ee-d7e80422542a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:10.348265 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 251/504] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:16:10.397162 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a590a-116a-40e9-865b-6d405cdf6530 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:10.413607 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a590a-116a-40e9-865b-6d405cdf6530 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:10.421980 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c835a-d9dd-4cf5-a859-0967dab9f47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:10.422767 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c835a-d9dd-4cf5-a859-0967dab9f47b admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:10.423099 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c835a-d9dd-4cf5-a859-0967dab9f47b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:10.423375 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c835a-d9dd-4cf5-a859-0967dab9f47b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:10.434393 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5c835a-d9dd-4cf5-a859-0967dab9f47b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:10.441355 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-dd5c835a-d9dd-4cf5-a859-0967dab9f47b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 19:16:10.442876 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 254/505] 10.222.0.62 () {56 vars in 1123 bytes} [Tue Nov 23 19:16:10 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:10.448847 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37325e7-a127-474e-b2ee-d7e80422542a None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:10.462438 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37325e7-a127-474e-b2ee-d7e80422542a None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:10.472298 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271dde2-b85f-4f87-846f-6ba911ae9738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:10.472965 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271dde2-b85f-4f87-846f-6ba911ae9738 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:10.473249 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271dde2-b85f-4f87-846f-6ba911ae9738 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:10.473550 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271dde2-b85f-4f87-846f-6ba911ae9738 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:10.474319 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271dde2-b85f-4f87-846f-6ba911ae9738 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:10.474628 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271dde2-b85f-4f87-846f-6ba911ae9738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:10.476211 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271dde2-b85f-4f87-846f-6ba911ae9738 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:10.488697 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdc9d3-ffb1-4c18-945e-6e87bdb3e25f None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:10.489281 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdc9d3-ffb1-4c18-945e-6e87bdb3e25f None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:10.489565 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 252/506] 10.222.0.62 () {56 vars in 1124 bytes} [Tue Nov 23 19:16:10 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:10.490027 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdc9d3-ffb1-4c18-945e-6e87bdb3e25f None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:10.492231 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 255/507] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:10.495024 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271dde2-b85f-4f87-846f-6ba911ae9738 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:10.498965 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295dbf4c-2449-4928-b34e-059a9b14d7a7 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:10.498965 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295dbf4c-2449-4928-b34e-059a9b14d7a7 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:10.499310 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295dbf4c-2449-4928-b34e-059a9b14d7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:10.505720 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271dde2-b85f-4f87-846f-6ba911ae9738 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:10.513914 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3d450-7911-414b-ac92-1287ee7161b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:10.514875 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3d450-7911-414b-ac92-1287ee7161b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:10.515159 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3d450-7911-414b-ac92-1287ee7161b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:10.515431 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3d450-7911-414b-ac92-1287ee7161b7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:10.533109 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-295dbf4c-2449-4928-b34e-059a9b14d7a7 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:10.534328 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-295dbf4c-2449-4928-b34e-059a9b14d7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:10.536223 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e3d450-7911-414b-ac92-1287ee7161b7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:10.538201 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e3d450-7911-414b-ac92-1287ee7161b7 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:10.542314 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 256/508] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:16:10.543747 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497ede0-7a5f-4374-80c1-4e9ee7e2ab11 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:10.544128 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497ede0-7a5f-4374-80c1-4e9ee7e2ab11 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:10.545256 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497ede0-7a5f-4374-80c1-4e9ee7e2ab11 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:10.547180 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 257/509] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:10.552784 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28e1d9-e039-4516-823b-769d91ebf0d9 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:10.553116 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28e1d9-e039-4516-823b-769d91ebf0d9 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:10.553509 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28e1d9-e039-4516-823b-769d91ebf0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:10.555801 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-c8e3d450-7911-414b-ac92-1287ee7161b7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:10.557233 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 253/510] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:10.566021 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3d450-7911-414b-ac92-1287ee7161b7 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:10.576365 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-7e28e1d9-e039-4516-823b-769d91ebf0d9 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:10.577565 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-7e28e1d9-e039-4516-823b-769d91ebf0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:10.580099 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3d450-7911-414b-ac92-1287ee7161b7 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:10.587570 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7632b-6da8-4ea4-b163-d29145557a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:10.587732 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 258/511] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 19:16:10.588224 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7632b-6da8-4ea4-b163-d29145557a98 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:10.588447 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28e1d9-e039-4516-823b-769d91ebf0d9 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:10.588547 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7632b-6da8-4ea4-b163-d29145557a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:10.588772 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7632b-6da8-4ea4-b163-d29145557a98 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:10.589654 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7632b-6da8-4ea4-b163-d29145557a98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:10.589964 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7632b-6da8-4ea4-b163-d29145557a98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:10.592140 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7632b-6da8-4ea4-b163-d29145557a98 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:10.605847 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 254/512] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:10.608788 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28e1d9-e039-4516-823b-769d91ebf0d9 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:10.617553 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7632b-6da8-4ea4-b163-d29145557a98 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:10.618016 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c35421-bff2-486f-8125-cf46fd614347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:10.618824 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c35421-bff2-486f-8125-cf46fd614347 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:10.619101 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c35421-bff2-486f-8125-cf46fd614347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:10.619372 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c35421-bff2-486f-8125-cf46fd614347 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:10.633394 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7632b-6da8-4ea4-b163-d29145557a98 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:10.634001 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c35421-bff2-486f-8125-cf46fd614347 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:10.637882 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5084c-01da-46e4-8f73-a6bf3cbabaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:10.639120 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5084c-01da-46e4-8f73-a6bf3cbabaa8 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:10.639376 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5084c-01da-46e4-8f73-a6bf3cbabaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:10.639705 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5084c-01da-46e4-8f73-a6bf3cbabaa8 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:10.641199 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-12c35421-bff2-486f-8125-cf46fd614347 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 19:16:10.643366 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 259/513] 10.222.0.62 () {56 vars in 1123 bytes} [Tue Nov 23 19:16:10 2021] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:10.643989 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c35421-bff2-486f-8125-cf46fd614347 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:10.650497 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5084c-01da-46e4-8f73-a6bf3cbabaa8 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:10.652557 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5084c-01da-46e4-8f73-a6bf3cbabaa8 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:10.660278 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c35421-bff2-486f-8125-cf46fd614347 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:10.664896 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37046fdf-1f25-4eee-8049-536ec242e357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:10.665708 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37046fdf-1f25-4eee-8049-536ec242e357 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:10.665990 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37046fdf-1f25-4eee-8049-536ec242e357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:10.666316 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37046fdf-1f25-4eee-8049-536ec242e357 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:10.667937 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-5fc5084c-01da-46e4-8f73-a6bf3cbabaa8 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 23 19:16:10.669117 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 255/514] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:16:10 2021] GET /identity/v3/users/glance => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:10.670256 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5084c-01da-46e4-8f73-a6bf3cbabaa8 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:10.685528 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37046fdf-1f25-4eee-8049-536ec242e357 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:10.688187 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5084c-01da-46e4-8f73-a6bf3cbabaa8 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:10.692906 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f425a7-4ebe-41b5-a56b-f824c5d8de28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:10.693312 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-37046fdf-1f25-4eee-8049-536ec242e357 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 19:16:10.693643 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f425a7-4ebe-41b5-a56b-f824c5d8de28 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:10.693940 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f425a7-4ebe-41b5-a56b-f824c5d8de28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:10.694219 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f425a7-4ebe-41b5-a56b-f824c5d8de28 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:10.694550 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 260/515] 10.222.0.62 () {56 vars in 1123 bytes} [Tue Nov 23 19:16:10 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:10.695048 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f425a7-4ebe-41b5-a56b-f824c5d8de28 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:10.695313 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37046fdf-1f25-4eee-8049-536ec242e357 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:10.695482 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f425a7-4ebe-41b5-a56b-f824c5d8de28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:10.698055 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f425a7-4ebe-41b5-a56b-f824c5d8de28 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:10.713520 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 256/516] 10.222.0.62 () {56 vars in 1124 bytes} [Tue Nov 23 19:16:10 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:10.713810 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37046fdf-1f25-4eee-8049-536ec242e357 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:10.714348 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f425a7-4ebe-41b5-a56b-f824c5d8de28 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:10.725208 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe080b3-599f-4934-815e-8b7062403b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:10.725690 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f425a7-4ebe-41b5-a56b-f824c5d8de28 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:10.725952 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe080b3-599f-4934-815e-8b7062403b67 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:10.726241 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe080b3-599f-4934-815e-8b7062403b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:10.726515 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe080b3-599f-4934-815e-8b7062403b67 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:10.727553 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe080b3-599f-4934-815e-8b7062403b67 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:10.727863 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe080b3-599f-4934-815e-8b7062403b67 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:10.728937 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING py.warnings [None req-afe080b3-599f-4934-815e-8b7062403b67 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:16:10.728937 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: warnings.warn(msg) Nov 23 19:16:10.728937 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: Nov 23 19:16:10.730060 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2dac44-c744-4167-be3a-893461c3c6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:10.730264 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe080b3-599f-4934-815e-8b7062403b67 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:10.730703 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dac44-c744-4167-be3a-893461c3c6aa admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:10.730982 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dac44-c744-4167-be3a-893461c3c6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:10.731252 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dac44-c744-4167-be3a-893461c3c6aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:10.732103 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2dac44-c744-4167-be3a-893461c3c6aa admin admin] RBAC: Adding query filter params (name=service) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:10.735587 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2dac44-c744-4167-be3a-893461c3c6aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:10.735587 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2dac44-c744-4167-be3a-893461c3c6aa admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:10.742789 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 257/517] 10.222.0.62 () {56 vars in 1124 bytes} [Tue Nov 23 19:16:10 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:10.743727 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2dac44-c744-4167-be3a-893461c3c6aa admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:10.758890 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2dac44-c744-4167-be3a-893461c3c6aa admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:10.765148 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b70749-163e-404b-8789-7592b278c4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:10.765998 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b70749-163e-404b-8789-7592b278c4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:10.766285 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b70749-163e-404b-8789-7592b278c4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:10.766561 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b70749-163e-404b-8789-7592b278c4c0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:10.779357 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 261/518] 10.222.0.62 () {56 vars in 1158 bytes} [Tue Nov 23 19:16:10 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:10.780081 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b70749-163e-404b-8789-7592b278c4c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:10.782035 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b70749-163e-404b-8789-7592b278c4c0 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:10.789356 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe080b3-599f-4934-815e-8b7062403b67 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:10.797575 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe080b3-599f-4934-815e-8b7062403b67 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:10.801263 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8522f83-4dd8-4c77-b3ec-7fea138d86ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:10.805528 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-20b70749-163e-404b-8789-7592b278c4c0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:10.805662 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8522f83-4dd8-4c77-b3ec-7fea138d86ca admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:10.805662 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8522f83-4dd8-4c77-b3ec-7fea138d86ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:10.805662 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8522f83-4dd8-4c77-b3ec-7fea138d86ca admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:10.807973 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 258/519] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:10.809241 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b70749-163e-404b-8789-7592b278c4c0 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:10.817806 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8522f83-4dd8-4c77-b3ec-7fea138d86ca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:10.820026 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8522f83-4dd8-4c77-b3ec-7fea138d86ca admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:10.820244 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b70749-163e-404b-8789-7592b278c4c0 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:10.825606 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02e95d-9ea2-42e1-87e3-dd7ddcd7800d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:10.826458 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02e95d-9ea2-42e1-87e3-dd7ddcd7800d admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:10.826746 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02e95d-9ea2-42e1-87e3-dd7ddcd7800d admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:10.827023 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02e95d-9ea2-42e1-87e3-dd7ddcd7800d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:10.836387 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02e95d-9ea2-42e1-87e3-dd7ddcd7800d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:10.838147 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02e95d-9ea2-42e1-87e3-dd7ddcd7800d admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:10.840419 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-e8522f83-4dd8-4c77-b3ec-7fea138d86ca admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:10.842689 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 262/520] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:10.843767 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8522f83-4dd8-4c77-b3ec-7fea138d86ca admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:10.857207 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 259/521] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:16:10 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:16:10.861507 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02e95d-9ea2-42e1-87e3-dd7ddcd7800d admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:10.861641 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8522f83-4dd8-4c77-b3ec-7fea138d86ca admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:10.869442 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883b927-5221-4377-bf44-552693796f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:10.869597 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02e95d-9ea2-42e1-87e3-dd7ddcd7800d admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:10.870631 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883b927-5221-4377-bf44-552693796f6e admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:10.871262 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883b927-5221-4377-bf44-552693796f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:10.871831 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883b927-5221-4377-bf44-552693796f6e admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:10.873048 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d883b927-5221-4377-bf44-552693796f6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:10.873615 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d883b927-5221-4377-bf44-552693796f6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:10.874366 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d06e58-1e4d-43ed-8a37-722b8cc102a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:10.875084 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d06e58-1e4d-43ed-8a37-722b8cc102a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:10.875439 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d06e58-1e4d-43ed-8a37-722b8cc102a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:10.875787 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d06e58-1e4d-43ed-8a37-722b8cc102a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:10.876582 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d06e58-1e4d-43ed-8a37-722b8cc102a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:10.876777 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d883b927-5221-4377-bf44-552693796f6e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:10.877038 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d06e58-1e4d-43ed-8a37-722b8cc102a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:10.878713 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d06e58-1e4d-43ed-8a37-722b8cc102a3 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:10.893920 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 260/522] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:10.894365 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 263/523] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:10.898304 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d06e58-1e4d-43ed-8a37-722b8cc102a3 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:10.899765 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883b927-5221-4377-bf44-552693796f6e admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:10.912188 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883b927-5221-4377-bf44-552693796f6e admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:10.914784 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d06e58-1e4d-43ed-8a37-722b8cc102a3 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:10.917663 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e2270-db66-4c4f-9542-1221682bbc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:10.918818 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e2270-db66-4c4f-9542-1221682bbc1a admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:10.919380 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e2270-db66-4c4f-9542-1221682bbc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:10.919751 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f68f3-8ab6-4c33-b1e7-5bcf4ade847c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:10.920353 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e2270-db66-4c4f-9542-1221682bbc1a admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:10.920721 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f68f3-8ab6-4c33-b1e7-5bcf4ade847c admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:10.921075 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f68f3-8ab6-4c33-b1e7-5bcf4ade847c admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:10.921482 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f68f3-8ab6-4c33-b1e7-5bcf4ade847c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:10.931490 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e2270-db66-4c4f-9542-1221682bbc1a admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:10.933312 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f68f3-8ab6-4c33-b1e7-5bcf4ade847c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:10.934230 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e2270-db66-4c4f-9542-1221682bbc1a admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:10.935504 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f68f3-8ab6-4c33-b1e7-5bcf4ade847c admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:10.950544 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-486e2270-db66-4c4f-9542-1221682bbc1a admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 23 19:16:10.952775 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 264/524] 10.222.0.62 () {56 vars in 1114 bytes} [Tue Nov 23 19:16:10 2021] GET /identity/v3/users/nova => generated 82 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:10.953719 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e2270-db66-4c4f-9542-1221682bbc1a admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:10.959659 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-6f2f68f3-8ab6-4c33-b1e7-5bcf4ade847c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:10.960958 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 261/525] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:10.962165 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f68f3-8ab6-4c33-b1e7-5bcf4ade847c admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:10.972921 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e2270-db66-4c4f-9542-1221682bbc1a admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:10.977539 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f68f3-8ab6-4c33-b1e7-5bcf4ade847c admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:10.979075 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc3014-5f43-448d-b65d-ebe45d497e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:10.980180 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc3014-5f43-448d-b65d-ebe45d497e13 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:10.980719 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc3014-5f43-448d-b65d-ebe45d497e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:10.981193 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc3014-5f43-448d-b65d-ebe45d497e13 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:10.984087 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7213e5b-6c05-4af3-9386-879c8b37869f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:10.984919 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7213e5b-6c05-4af3-9386-879c8b37869f admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:10.985201 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7213e5b-6c05-4af3-9386-879c8b37869f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:10.990245 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7213e5b-6c05-4af3-9386-879c8b37869f admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:10.990245 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7213e5b-6c05-4af3-9386-879c8b37869f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:10.990245 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7213e5b-6c05-4af3-9386-879c8b37869f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:10.990245 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING py.warnings [None req-c7213e5b-6c05-4af3-9386-879c8b37869f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:16:10.990245 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: warnings.warn(msg) Nov 23 19:16:10.990245 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: Nov 23 19:16:10.990245 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7213e5b-6c05-4af3-9386-879c8b37869f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:10.992243 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc3014-5f43-448d-b65d-ebe45d497e13 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:10.994469 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc3014-5f43-448d-b65d-ebe45d497e13 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:11.009788 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-65bc3014-5f43-448d-b65d-ebe45d497e13 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 23 19:16:11.011228 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 265/526] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:16:10 2021] GET /identity/v3/users/cinder => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:11.012499 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc3014-5f43-448d-b65d-ebe45d497e13 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:11.023481 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc3014-5f43-448d-b65d-ebe45d497e13 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:11.028593 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe214ad8-8eae-4d5b-9fc9-47eed2aa04c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:11.029658 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 262/527] 10.222.0.62 () {56 vars in 1154 bytes} [Tue Nov 23 19:16:10 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:11.035116 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7213e5b-6c05-4af3-9386-879c8b37869f admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:11.035581 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe214ad8-8eae-4d5b-9fc9-47eed2aa04c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:11.036060 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe214ad8-8eae-4d5b-9fc9-47eed2aa04c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:11.036561 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe214ad8-8eae-4d5b-9fc9-47eed2aa04c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:11.037558 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe214ad8-8eae-4d5b-9fc9-47eed2aa04c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:11.038093 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe214ad8-8eae-4d5b-9fc9-47eed2aa04c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:11.039956 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe214ad8-8eae-4d5b-9fc9-47eed2aa04c8 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:11.040061 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7213e5b-6c05-4af3-9386-879c8b37869f admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:11.044411 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebc4ea-ee1e-49cb-b2ca-0bfecaf3231f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:11.045345 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebc4ea-ee1e-49cb-b2ca-0bfecaf3231f admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:11.045654 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebc4ea-ee1e-49cb-b2ca-0bfecaf3231f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:11.045932 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebc4ea-ee1e-49cb-b2ca-0bfecaf3231f admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:11.046777 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebc4ea-ee1e-49cb-b2ca-0bfecaf3231f admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:11.047089 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebc4ea-ee1e-49cb-b2ca-0bfecaf3231f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:11.048902 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebc4ea-ee1e-49cb-b2ca-0bfecaf3231f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:11.064983 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 266/528] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:11.064983 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe214ad8-8eae-4d5b-9fc9-47eed2aa04c8 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:11.066614 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 263/529] 10.222.0.62 () {56 vars in 1158 bytes} [Tue Nov 23 19:16:11 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:11.067434 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebc4ea-ee1e-49cb-b2ca-0bfecaf3231f admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:11.073348 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe214ad8-8eae-4d5b-9fc9-47eed2aa04c8 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:11.078018 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebc4ea-ee1e-49cb-b2ca-0bfecaf3231f admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:11.079922 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc1d84-a93f-4997-8b54-5c1441dd9ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:11.080812 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc1d84-a93f-4997-8b54-5c1441dd9ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:11.081315 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc1d84-a93f-4997-8b54-5c1441dd9ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:11.081797 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc1d84-a93f-4997-8b54-5c1441dd9ec1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:11.082603 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388481d6-447b-4133-89fb-084f0c091eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:11.083437 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388481d6-447b-4133-89fb-084f0c091eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:11.083818 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388481d6-447b-4133-89fb-084f0c091eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:11.084094 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388481d6-447b-4133-89fb-084f0c091eb0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:11.091000 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388481d6-447b-4133-89fb-084f0c091eb0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:11.092717 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc1d84-a93f-4997-8b54-5c1441dd9ec1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:11.093572 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388481d6-447b-4133-89fb-084f0c091eb0 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:11.094943 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc1d84-a93f-4997-8b54-5c1441dd9ec1 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:11.104468 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 267/530] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:16:11 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:16:11.110297 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-388481d6-447b-4133-89fb-084f0c091eb0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:16:11.110297 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 264/531] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:11.110520 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc1d84-a93f-4997-8b54-5c1441dd9ec1 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:11.116452 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388481d6-447b-4133-89fb-084f0c091eb0 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:11.125164 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc1d84-a93f-4997-8b54-5c1441dd9ec1 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:11.127632 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388481d6-447b-4133-89fb-084f0c091eb0 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:11.130490 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a1ead-43a2-4249-a0e4-79e33ce1bcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:11.131432 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a1ead-43a2-4249-a0e4-79e33ce1bcfc admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:11.131916 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a1ead-43a2-4249-a0e4-79e33ce1bcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:11.132371 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0eaaa1-fe40-4a45-a5a2-8186d4613723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:11.132698 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a1ead-43a2-4249-a0e4-79e33ce1bcfc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:11.133144 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0eaaa1-fe40-4a45-a5a2-8186d4613723 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:11.133447 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0eaaa1-fe40-4a45-a5a2-8186d4613723 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:11.133742 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0eaaa1-fe40-4a45-a5a2-8186d4613723 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:11.142506 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a1ead-43a2-4249-a0e4-79e33ce1bcfc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:11.144232 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0eaaa1-fe40-4a45-a5a2-8186d4613723 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:11.144874 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a1ead-43a2-4249-a0e4-79e33ce1bcfc admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:11.146056 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0eaaa1-fe40-4a45-a5a2-8186d4613723 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:11.154890 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 268/532] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:16:11 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:16:11.155959 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a1ead-43a2-4249-a0e4-79e33ce1bcfc admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:11.163104 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-fe0eaaa1-fe40-4a45-a5a2-8186d4613723 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:11.164578 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 265/533] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:11.165463 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0eaaa1-fe40-4a45-a5a2-8186d4613723 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:11.171259 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a1ead-43a2-4249-a0e4-79e33ce1bcfc admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:11.176863 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0eaaa1-fe40-4a45-a5a2-8186d4613723 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:11.178974 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6eec7-2ef4-42b2-9219-e3526b5f19d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:11.180276 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6eec7-2ef4-42b2-9219-e3526b5f19d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:11.180874 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6eec7-2ef4-42b2-9219-e3526b5f19d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:11.181531 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6eec7-2ef4-42b2-9219-e3526b5f19d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:11.181646 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec29a0-d767-4e5a-81cf-43fb4f498115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:11.182337 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec29a0-d767-4e5a-81cf-43fb4f498115 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:11.182613 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec29a0-d767-4e5a-81cf-43fb4f498115 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:11.182784 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6eec7-2ef4-42b2-9219-e3526b5f19d4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:11.182888 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec29a0-d767-4e5a-81cf-43fb4f498115 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:11.183265 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6eec7-2ef4-42b2-9219-e3526b5f19d4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:11.184514 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING py.warnings [None req-bcb6eec7-2ef4-42b2-9219-e3526b5f19d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:16:11.184514 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: warnings.warn(msg) Nov 23 19:16:11.184514 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: Nov 23 19:16:11.186890 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6eec7-2ef4-42b2-9219-e3526b5f19d4 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:11.195646 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec29a0-d767-4e5a-81cf-43fb4f498115 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:11.197811 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec29a0-d767-4e5a-81cf-43fb4f498115 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:11.209041 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 269/534] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:16:11 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:11.210094 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6eec7-2ef4-42b2-9219-e3526b5f19d4 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:11.224264 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6eec7-2ef4-42b2-9219-e3526b5f19d4 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:11.226084 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-1cec29a0-d767-4e5a-81cf-43fb4f498115 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:11.227565 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 266/535] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:11.228518 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec29a0-d767-4e5a-81cf-43fb4f498115 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:11.229477 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba8b5b-9e96-423b-a753-6013eb75ac3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:11.230231 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba8b5b-9e96-423b-a753-6013eb75ac3a admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:11.230634 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba8b5b-9e96-423b-a753-6013eb75ac3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:11.231010 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba8b5b-9e96-423b-a753-6013eb75ac3a admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:11.231899 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba8b5b-9e96-423b-a753-6013eb75ac3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:11.232328 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba8b5b-9e96-423b-a753-6013eb75ac3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:11.234047 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba8b5b-9e96-423b-a753-6013eb75ac3a admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:11.239303 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec29a0-d767-4e5a-81cf-43fb4f498115 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:11.243972 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53653b6b-228a-4d0c-944e-ffa216cb191d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:11.244655 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53653b6b-228a-4d0c-944e-ffa216cb191d admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:11.244967 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53653b6b-228a-4d0c-944e-ffa216cb191d admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:11.245250 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53653b6b-228a-4d0c-944e-ffa216cb191d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:11.246111 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53653b6b-228a-4d0c-944e-ffa216cb191d admin admin] RBAC: Adding query filter params (role.id=e68dc60061bd41dc894e1be26b4d5027, scope.project.id=2955b3037801465c9eec5d78fe2e3ae9, user.id=544443ed44ef41bcaa86af52926bfd14) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:11.246463 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53653b6b-228a-4d0c-944e-ffa216cb191d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:11.246609 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 270/536] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:11.247410 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba8b5b-9e96-423b-a753-6013eb75ac3a admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:11.249308 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53653b6b-228a-4d0c-944e-ffa216cb191d admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:11.255658 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 267/537] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:16:11 2021] GET /identity/v3/role_assignments?user.id=544443ed44ef41bcaa86af52926bfd14&scope.project.id=2955b3037801465c9eec5d78fe2e3ae9&role.id=e68dc60061bd41dc894e1be26b4d5027 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:11.256432 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53653b6b-228a-4d0c-944e-ffa216cb191d admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:11.262925 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba8b5b-9e96-423b-a753-6013eb75ac3a admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:11.268392 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbc59f-f344-409a-a092-ea1240e2983d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:11.269146 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbc59f-f344-409a-a092-ea1240e2983d admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:11.269523 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbc59f-f344-409a-a092-ea1240e2983d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:11.269870 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbc59f-f344-409a-a092-ea1240e2983d admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:11.270684 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fbc59f-f344-409a-a092-ea1240e2983d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:11.271060 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fbc59f-f344-409a-a092-ea1240e2983d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:11.272744 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fbc59f-f344-409a-a092-ea1240e2983d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:11.275306 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53653b6b-228a-4d0c-944e-ffa216cb191d admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:11.286525 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 271/538] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:11.294305 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f913c-71b5-4129-8e7c-b0c10d208bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:11.295295 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbc59f-f344-409a-a092-ea1240e2983d admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:11.295531 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f913c-71b5-4129-8e7c-b0c10d208bce admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:11.295531 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f913c-71b5-4129-8e7c-b0c10d208bce admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:11.295743 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f913c-71b5-4129-8e7c-b0c10d208bce admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:11.303215 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f913c-71b5-4129-8e7c-b0c10d208bce admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:11.305139 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f913c-71b5-4129-8e7c-b0c10d208bce admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:11.305297 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbc59f-f344-409a-a092-ea1240e2983d admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:11.313260 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d79ef-6156-4839-83ef-2d04a2d11773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:11.314294 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d79ef-6156-4839-83ef-2d04a2d11773 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:11.314572 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d79ef-6156-4839-83ef-2d04a2d11773 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:11.314842 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d79ef-6156-4839-83ef-2d04a2d11773 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:11.322870 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d79ef-6156-4839-83ef-2d04a2d11773 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:11.325011 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d79ef-6156-4839-83ef-2d04a2d11773 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:11.334867 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-5f5f913c-71b5-4129-8e7c-b0c10d208bce admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:16:11.336384 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 268/539] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:11.340388 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-dd8d79ef-6156-4839-83ef-2d04a2d11773 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:16:11.342856 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f913c-71b5-4129-8e7c-b0c10d208bce admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:11.347727 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 272/540] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:11.349115 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d79ef-6156-4839-83ef-2d04a2d11773 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:11.358172 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f913c-71b5-4129-8e7c-b0c10d208bce admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:11.360016 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d79ef-6156-4839-83ef-2d04a2d11773 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:11.371531 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1b828-7931-4e04-a1bc-3837b90efd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:11.373582 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1b828-7931-4e04-a1bc-3837b90efd6d admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:11.374337 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1b828-7931-4e04-a1bc-3837b90efd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:11.374337 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1b828-7931-4e04-a1bc-3837b90efd6d admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:11.375110 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f0b88-0417-4008-950c-a2b8cae51b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:11.376255 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1b828-7931-4e04-a1bc-3837b90efd6d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:11.376563 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1b828-7931-4e04-a1bc-3837b90efd6d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:11.377440 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f0b88-0417-4008-950c-a2b8cae51b77 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:11.377719 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f0b88-0417-4008-950c-a2b8cae51b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:11.377986 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f0b88-0417-4008-950c-a2b8cae51b77 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:11.380123 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1b828-7931-4e04-a1bc-3837b90efd6d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:11.382437 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f0b88-0417-4008-950c-a2b8cae51b77 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:11.382873 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f0b88-0417-4008-950c-a2b8cae51b77 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:11.384494 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING py.warnings [None req-245f0b88-0417-4008-950c-a2b8cae51b77 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:16:11.384494 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: warnings.warn(msg) Nov 23 19:16:11.384494 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: Nov 23 19:16:11.385899 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f0b88-0417-4008-950c-a2b8cae51b77 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:11.395651 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 273/541] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:16:11 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:11.396967 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6067c-9265-467a-bbed-0ade059bce72 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:11.397328 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6067c-9265-467a-bbed-0ade059bce72 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:11.397705 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6067c-9265-467a-bbed-0ade059bce72 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:11.399648 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 274/542] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:11.406998 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0eb29-a008-49f1-b967-afcfde8ff2d7 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:11.407544 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0eb29-a008-49f1-b967-afcfde8ff2d7 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:11.407975 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0eb29-a008-49f1-b967-afcfde8ff2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:11.418680 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 269/543] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:16:11 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:11.418680 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f0b88-0417-4008-950c-a2b8cae51b77 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:11.428523 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f0b88-0417-4008-950c-a2b8cae51b77 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:11.433560 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9431518-4a13-41a2-983d-552a85227f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:11.434218 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9431518-4a13-41a2-983d-552a85227f4a admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:11.434401 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-0eb0eb29-a008-49f1-b967-afcfde8ff2d7 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:11.434547 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9431518-4a13-41a2-983d-552a85227f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:11.434824 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9431518-4a13-41a2-983d-552a85227f4a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:11.435893 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9431518-4a13-41a2-983d-552a85227f4a admin admin] RBAC: Adding query filter params (role.id=e68dc60061bd41dc894e1be26b4d5027, scope.project.id=2955b3037801465c9eec5d78fe2e3ae9, user.id=9845615593004371a592e46701b5ece6) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:11.436112 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9431518-4a13-41a2-983d-552a85227f4a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:11.436842 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-0eb0eb29-a008-49f1-b967-afcfde8ff2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:11.438102 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9431518-4a13-41a2-983d-552a85227f4a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:11.453438 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 270/544] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:16:11 2021] GET /identity/v3/role_assignments?user.id=9845615593004371a592e46701b5ece6&scope.project.id=2955b3037801465c9eec5d78fe2e3ae9&role.id=e68dc60061bd41dc894e1be26b4d5027 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:11.453438 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9431518-4a13-41a2-983d-552a85227f4a admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:11.454575 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 275/545] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:16:11.457481 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9431518-4a13-41a2-983d-552a85227f4a admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:11.461958 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980abc5-8580-412a-906e-00d364e51b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:11.462613 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980abc5-8580-412a-906e-00d364e51b2a admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:11.462885 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980abc5-8580-412a-906e-00d364e51b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:11.463156 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980abc5-8580-412a-906e-00d364e51b2a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:11.463998 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980abc5-8580-412a-906e-00d364e51b2a admin admin] RBAC: Adding query filter params (role.id=e68dc60061bd41dc894e1be26b4d5027, scope.project.id=2955b3037801465c9eec5d78fe2e3ae9, user.id=6d91fe7f996b48b0bc28e1eadc4f8869) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:11.464308 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980abc5-8580-412a-906e-00d364e51b2a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:11.466203 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980abc5-8580-412a-906e-00d364e51b2a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:11.473263 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 271/546] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:16:11 2021] GET /identity/v3/role_assignments?user.id=6d91fe7f996b48b0bc28e1eadc4f8869&scope.project.id=2955b3037801465c9eec5d78fe2e3ae9&role.id=e68dc60061bd41dc894e1be26b4d5027 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:11.499448 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0eb29-a008-49f1-b967-afcfde8ff2d7 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:11.515381 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0eb29-a008-49f1-b967-afcfde8ff2d7 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:11.523741 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f99ef7-1ff3-4fdd-bd4f-116c1850a665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:11.524939 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f99ef7-1ff3-4fdd-bd4f-116c1850a665 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:11.525487 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f99ef7-1ff3-4fdd-bd4f-116c1850a665 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:11.525989 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f99ef7-1ff3-4fdd-bd4f-116c1850a665 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:11.550445 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f99ef7-1ff3-4fdd-bd4f-116c1850a665 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:11.557724 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-79f99ef7-1ff3-4fdd-bd4f-116c1850a665 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 19:16:11.559342 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 276/547] 10.222.0.62 () {56 vars in 1123 bytes} [Tue Nov 23 19:16:11 2021] GET /identity/v3/roles/service => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:11.570607 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980abc5-8580-412a-906e-00d364e51b2a admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:11.584144 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980abc5-8580-412a-906e-00d364e51b2a admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:11.589076 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19c62c-ecf4-4c12-8f2b-320442fdeeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:11.590749 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19c62c-ecf4-4c12-8f2b-320442fdeeee admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:11.591029 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19c62c-ecf4-4c12-8f2b-320442fdeeee admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:11.591860 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19c62c-ecf4-4c12-8f2b-320442fdeeee admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:11.592652 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19c62c-ecf4-4c12-8f2b-320442fdeeee admin admin] RBAC: Adding query filter params (name=service) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:11.592956 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19c62c-ecf4-4c12-8f2b-320442fdeeee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:11.594585 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19c62c-ecf4-4c12-8f2b-320442fdeeee admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:11.604210 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 272/548] 10.222.0.62 () {56 vars in 1124 bytes} [Tue Nov 23 19:16:11 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:11.611400 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f99ef7-1ff3-4fdd-bd4f-116c1850a665 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:11.628013 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f99ef7-1ff3-4fdd-bd4f-116c1850a665 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:11.635119 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1bfa78-baa6-4fe9-b217-49ab005c987b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:11.636082 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1bfa78-baa6-4fe9-b217-49ab005c987b admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:11.636483 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1bfa78-baa6-4fe9-b217-49ab005c987b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:11.636846 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1bfa78-baa6-4fe9-b217-49ab005c987b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:11.658380 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1bfa78-baa6-4fe9-b217-49ab005c987b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:11.660440 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1bfa78-baa6-4fe9-b217-49ab005c987b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:11.682418 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-8c1bfa78-baa6-4fe9-b217-49ab005c987b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:11.684304 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 277/549] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:11.690912 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19c62c-ecf4-4c12-8f2b-320442fdeeee admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:11.708369 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19c62c-ecf4-4c12-8f2b-320442fdeeee admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:11.713262 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773dbbf8-c800-4744-a50a-09432c7b60cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:11.713980 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dbbf8-c800-4744-a50a-09432c7b60cf admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:11.714261 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dbbf8-c800-4744-a50a-09432c7b60cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:11.714530 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dbbf8-c800-4744-a50a-09432c7b60cf admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:11.715280 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773dbbf8-c800-4744-a50a-09432c7b60cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:11.715583 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773dbbf8-c800-4744-a50a-09432c7b60cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:11.717260 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773dbbf8-c800-4744-a50a-09432c7b60cf admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:11.743617 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 273/550] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:11.750965 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1bfa78-baa6-4fe9-b217-49ab005c987b admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:11.766998 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1bfa78-baa6-4fe9-b217-49ab005c987b admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:11.772783 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7e0d1-37b7-4487-8e0d-dc2e1a81cb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:11.773769 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7e0d1-37b7-4487-8e0d-dc2e1a81cb71 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:11.774159 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7e0d1-37b7-4487-8e0d-dc2e1a81cb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:11.774523 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7e0d1-37b7-4487-8e0d-dc2e1a81cb71 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:11.784994 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7e0d1-37b7-4487-8e0d-dc2e1a81cb71 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:11.787247 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7e0d1-37b7-4487-8e0d-dc2e1a81cb71 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:11.803911 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-7ac7e0d1-37b7-4487-8e0d-dc2e1a81cb71 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 23 19:16:11.805292 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 278/551] 10.222.0.62 () {56 vars in 1123 bytes} [Tue Nov 23 19:16:11 2021] GET /identity/v3/users/neutron => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:11.812737 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773dbbf8-c800-4744-a50a-09432c7b60cf admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:11.827924 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773dbbf8-c800-4744-a50a-09432c7b60cf admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:11.832319 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a88412-2c3f-467c-a357-db7defc7bd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:11.832979 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a88412-2c3f-467c-a357-db7defc7bd3a admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:11.833259 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a88412-2c3f-467c-a357-db7defc7bd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:11.837682 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a88412-2c3f-467c-a357-db7defc7bd3a admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:11.838507 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a88412-2c3f-467c-a357-db7defc7bd3a admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:11.838819 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a88412-2c3f-467c-a357-db7defc7bd3a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:11.840628 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a88412-2c3f-467c-a357-db7defc7bd3a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:11.867121 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 274/552] 10.222.0.62 () {56 vars in 1160 bytes} [Tue Nov 23 19:16:11 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:11.873198 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7e0d1-37b7-4487-8e0d-dc2e1a81cb71 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:11.890993 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7e0d1-37b7-4487-8e0d-dc2e1a81cb71 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:11.899370 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76933761-52c1-4294-b89e-1e43d93cac4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:11.900254 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76933761-52c1-4294-b89e-1e43d93cac4c admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:11.900753 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76933761-52c1-4294-b89e-1e43d93cac4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:11.901214 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76933761-52c1-4294-b89e-1e43d93cac4c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:11.913433 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76933761-52c1-4294-b89e-1e43d93cac4c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:11.915442 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76933761-52c1-4294-b89e-1e43d93cac4c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:11.929520 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 279/553] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:16:11 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:16:11.935788 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a88412-2c3f-467c-a357-db7defc7bd3a admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:11.953764 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a88412-2c3f-467c-a357-db7defc7bd3a admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:11.958293 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393209b9-cc60-4e06-8639-5d21e37ab72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:11.959086 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393209b9-cc60-4e06-8639-5d21e37ab72f admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:11.959368 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393209b9-cc60-4e06-8639-5d21e37ab72f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:11.959641 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393209b9-cc60-4e06-8639-5d21e37ab72f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:11.974676 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393209b9-cc60-4e06-8639-5d21e37ab72f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:11.975466 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419349a9-06ab-4c80-9a42-571e08885d1f None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:11.975751 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419349a9-06ab-4c80-9a42-571e08885d1f None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:11.976023 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419349a9-06ab-4c80-9a42-571e08885d1f None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:11.976615 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393209b9-cc60-4e06-8639-5d21e37ab72f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:11.977936 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 280/554] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:11.984380 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226c8ef-48f9-4b73-b6ca-118bdf070bd4 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:11.984670 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226c8ef-48f9-4b73-b6ca-118bdf070bd4 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:11.984946 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226c8ef-48f9-4b73-b6ca-118bdf070bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:12.001707 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-393209b9-cc60-4e06-8639-5d21e37ab72f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:12.004340 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 275/555] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:12.010742 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393209b9-cc60-4e06-8639-5d21e37ab72f admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:12.021441 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393209b9-cc60-4e06-8639-5d21e37ab72f admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:12.022412 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-1226c8ef-48f9-4b73-b6ca-118bdf070bd4 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:12.023613 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-1226c8ef-48f9-4b73-b6ca-118bdf070bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:12.026894 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d51582-74d4-404e-8596-8b84050cecac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:12.027847 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d51582-74d4-404e-8596-8b84050cecac admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:12.028333 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d51582-74d4-404e-8596-8b84050cecac admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:12.029536 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d51582-74d4-404e-8596-8b84050cecac admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:12.030899 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d51582-74d4-404e-8596-8b84050cecac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:12.031458 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d51582-74d4-404e-8596-8b84050cecac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:12.033345 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d51582-74d4-404e-8596-8b84050cecac admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:12.053457 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 281/556] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 19:16:12.054163 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 276/557] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:12.058348 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226c8ef-48f9-4b73-b6ca-118bdf070bd4 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:12.079649 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226c8ef-48f9-4b73-b6ca-118bdf070bd4 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:12.081270 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d51582-74d4-404e-8596-8b84050cecac admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:12.093271 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d51582-74d4-404e-8596-8b84050cecac admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:12.094014 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfcd6ff-f06b-44f1-8b8a-5ebd8ef68ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:12.094801 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfcd6ff-f06b-44f1-8b8a-5ebd8ef68ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:12.095081 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfcd6ff-f06b-44f1-8b8a-5ebd8ef68ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:12.095350 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfcd6ff-f06b-44f1-8b8a-5ebd8ef68ec1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:12.099338 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e405158-3abe-4e3f-b45c-b2cc7218acde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:12.100427 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e405158-3abe-4e3f-b45c-b2cc7218acde admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:12.101015 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e405158-3abe-4e3f-b45c-b2cc7218acde admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:12.101545 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e405158-3abe-4e3f-b45c-b2cc7218acde admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:12.110859 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfcd6ff-f06b-44f1-8b8a-5ebd8ef68ec1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:12.112841 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfcd6ff-f06b-44f1-8b8a-5ebd8ef68ec1 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:12.114399 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e405158-3abe-4e3f-b45c-b2cc7218acde admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:12.116600 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e405158-3abe-4e3f-b45c-b2cc7218acde admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:12.135631 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-3e405158-3abe-4e3f-b45c-b2cc7218acde admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:12.136719 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-2dfcd6ff-f06b-44f1-8b8a-5ebd8ef68ec1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:16:12.137649 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 277/558] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:12.141476 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 282/559] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:12 2021] GET /identity/v3/projects/service => generated 88 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:12.144024 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e405158-3abe-4e3f-b45c-b2cc7218acde admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:12.154584 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e405158-3abe-4e3f-b45c-b2cc7218acde admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:12.157113 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfcd6ff-f06b-44f1-8b8a-5ebd8ef68ec1 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:12.160154 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43e983-c4ad-4e62-8640-ca93a7b49d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:12.161038 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43e983-c4ad-4e62-8640-ca93a7b49d9a admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:12.161643 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43e983-c4ad-4e62-8640-ca93a7b49d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:12.162118 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43e983-c4ad-4e62-8640-ca93a7b49d9a admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:12.163156 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43e983-c4ad-4e62-8640-ca93a7b49d9a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:12.163698 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43e983-c4ad-4e62-8640-ca93a7b49d9a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:12.165899 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43e983-c4ad-4e62-8640-ca93a7b49d9a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:12.179894 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 278/560] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:16:12 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:12.183367 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfcd6ff-f06b-44f1-8b8a-5ebd8ef68ec1 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:12.187517 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43e983-c4ad-4e62-8640-ca93a7b49d9a admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:12.194185 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa64f1-b52e-4f3e-9a30-c220b268b8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:12.194695 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa64f1-b52e-4f3e-9a30-c220b268b8ab admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:12.194980 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa64f1-b52e-4f3e-9a30-c220b268b8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:12.195268 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa64f1-b52e-4f3e-9a30-c220b268b8ab admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:12.196257 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa64f1-b52e-4f3e-9a30-c220b268b8ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:12.196566 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa64f1-b52e-4f3e-9a30-c220b268b8ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:12.198212 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa64f1-b52e-4f3e-9a30-c220b268b8ab admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:12.202012 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43e983-c4ad-4e62-8640-ca93a7b49d9a admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:12.207487 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f0e8d-f16c-40b2-8d6a-7f7dba26fd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:12.208469 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f0e8d-f16c-40b2-8d6a-7f7dba26fd53 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:12.208951 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f0e8d-f16c-40b2-8d6a-7f7dba26fd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:12.209460 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f0e8d-f16c-40b2-8d6a-7f7dba26fd53 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:12.210552 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f0e8d-f16c-40b2-8d6a-7f7dba26fd53 admin admin] RBAC: Adding query filter params (role.id=e68dc60061bd41dc894e1be26b4d5027, scope.project.id=2955b3037801465c9eec5d78fe2e3ae9, user.id=f1ef2ac0a788451eb50fa80f559f808f) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:12.211551 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f0e8d-f16c-40b2-8d6a-7f7dba26fd53 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:12.213673 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f0e8d-f16c-40b2-8d6a-7f7dba26fd53 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:12.220737 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 283/561] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:12.229928 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 279/562] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:16:12 2021] GET /identity/v3/role_assignments?user.id=f1ef2ac0a788451eb50fa80f559f808f&scope.project.id=2955b3037801465c9eec5d78fe2e3ae9&role.id=e68dc60061bd41dc894e1be26b4d5027 => generated 259 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:12.236162 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa64f1-b52e-4f3e-9a30-c220b268b8ab admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:12.257875 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa64f1-b52e-4f3e-9a30-c220b268b8ab admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:12.272282 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48370a-63f5-442d-b4d0-b7a2c9ec33fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:12.272974 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48370a-63f5-442d-b4d0-b7a2c9ec33fc admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:12.273263 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48370a-63f5-442d-b4d0-b7a2c9ec33fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:12.273564 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48370a-63f5-442d-b4d0-b7a2c9ec33fc admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:12.274305 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48370a-63f5-442d-b4d0-b7a2c9ec33fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:12.276245 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48370a-63f5-442d-b4d0-b7a2c9ec33fc admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:12.385903 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 284/563] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Nov 23 19:16:12 2021] POST /identity/v3/users => generated 247 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:16:14.021735 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632f068-74da-4504-8223-295587994349 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:14.022249 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632f068-74da-4504-8223-295587994349 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:14.022322 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632f068-74da-4504-8223-295587994349 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:14.024271 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 280/564] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:14.030786 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f49fc-f250-4ae2-9b5f-4e88580a1a56 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:14.031254 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f49fc-f250-4ae2-9b5f-4e88580a1a56 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:14.031330 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f49fc-f250-4ae2-9b5f-4e88580a1a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:14.058470 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-446f49fc-f250-4ae2-9b5f-4e88580a1a56 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:14.059571 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-446f49fc-f250-4ae2-9b5f-4e88580a1a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:14.070237 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 285/565] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:16:14.112447 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632f068-74da-4504-8223-295587994349 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:14.127486 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc85d1-82e6-4827-8c5b-02e1c71a1391 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:14.127830 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc85d1-82e6-4827-8c5b-02e1c71a1391 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:14.128046 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc85d1-82e6-4827-8c5b-02e1c71a1391 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:14.128917 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632f068-74da-4504-8223-295587994349 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:14.130066 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 286/566] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:14.133564 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925a867-06a6-448c-98db-904523d100d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:14.134341 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925a867-06a6-448c-98db-904523d100d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:14.134621 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925a867-06a6-448c-98db-904523d100d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:14.134895 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925a867-06a6-448c-98db-904523d100d8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:14.141529 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04165dbf-826f-4c60-be20-f4d9c17d0dfb None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:14.141814 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04165dbf-826f-4c60-be20-f4d9c17d0dfb None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:14.142083 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04165dbf-826f-4c60-be20-f4d9c17d0dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:14.146743 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6925a867-06a6-448c-98db-904523d100d8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:14.153695 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-6925a867-06a6-448c-98db-904523d100d8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 19:16:14.155566 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 281/567] 10.222.0.62 () {56 vars in 1123 bytes} [Tue Nov 23 19:16:14 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:14.165877 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925a867-06a6-448c-98db-904523d100d8 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:14.171278 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-04165dbf-826f-4c60-be20-f4d9c17d0dfb None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:14.172446 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-04165dbf-826f-4c60-be20-f4d9c17d0dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:14.179506 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925a867-06a6-448c-98db-904523d100d8 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:14.185956 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 287/568] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Nov 23 19:16:14.191545 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285cd9f-d940-4582-9fcb-6517b50ec153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:14.192230 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285cd9f-d940-4582-9fcb-6517b50ec153 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:14.192510 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285cd9f-d940-4582-9fcb-6517b50ec153 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:14.192785 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285cd9f-d940-4582-9fcb-6517b50ec153 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:14.193590 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285cd9f-d940-4582-9fcb-6517b50ec153 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:14.193898 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285cd9f-d940-4582-9fcb-6517b50ec153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:14.195529 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285cd9f-d940-4582-9fcb-6517b50ec153 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:14.210155 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 282/569] 10.222.0.62 () {56 vars in 1124 bytes} [Tue Nov 23 19:16:14 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:14.216553 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04165dbf-826f-4c60-be20-f4d9c17d0dfb None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:14.230906 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04165dbf-826f-4c60-be20-f4d9c17d0dfb None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:14.238114 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273f5d4-d371-4dae-b5aa-5d4ceb798746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:14.238938 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273f5d4-d371-4dae-b5aa-5d4ceb798746 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:14.239225 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273f5d4-d371-4dae-b5aa-5d4ceb798746 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:14.239500 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273f5d4-d371-4dae-b5aa-5d4ceb798746 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:14.255602 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285cd9f-d940-4582-9fcb-6517b50ec153 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:14.262244 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273f5d4-d371-4dae-b5aa-5d4ceb798746 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:14.264194 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273f5d4-d371-4dae-b5aa-5d4ceb798746 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:14.267966 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285cd9f-d940-4582-9fcb-6517b50ec153 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:14.277668 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917fac9f-ba37-4e2c-8af5-f4bc0ae3932f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:14.278467 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fac9f-ba37-4e2c-8af5-f4bc0ae3932f admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:14.278746 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fac9f-ba37-4e2c-8af5-f4bc0ae3932f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:14.279570 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fac9f-ba37-4e2c-8af5-f4bc0ae3932f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:14.296938 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-2273f5d4-d371-4dae-b5aa-5d4ceb798746 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:14.303553 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917fac9f-ba37-4e2c-8af5-f4bc0ae3932f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:14.310807 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-917fac9f-ba37-4e2c-8af5-f4bc0ae3932f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 19:16:14.311732 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 283/570] 10.222.0.62 () {56 vars in 1123 bytes} [Tue Nov 23 19:16:14 2021] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:14.317724 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 288/571] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:14.318620 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917fac9f-ba37-4e2c-8af5-f4bc0ae3932f admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:14.329026 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273f5d4-d371-4dae-b5aa-5d4ceb798746 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:14.339046 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273f5d4-d371-4dae-b5aa-5d4ceb798746 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:14.344325 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917fac9f-ba37-4e2c-8af5-f4bc0ae3932f admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:14.349709 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bef9c-a95e-4c08-8554-8dfe16507de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:14.350366 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bef9c-a95e-4c08-8554-8dfe16507de2 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:14.350641 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bef9c-a95e-4c08-8554-8dfe16507de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:14.350910 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bef9c-a95e-4c08-8554-8dfe16507de2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:14.351671 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37bef9c-a95e-4c08-8554-8dfe16507de2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:14.351968 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37bef9c-a95e-4c08-8554-8dfe16507de2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:14.353577 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37bef9c-a95e-4c08-8554-8dfe16507de2 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:14.358641 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e063cc-f232-4ba8-bca2-dc5c964f147d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:14.359308 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e063cc-f232-4ba8-bca2-dc5c964f147d admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:14.359585 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e063cc-f232-4ba8-bca2-dc5c964f147d admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:14.359855 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e063cc-f232-4ba8-bca2-dc5c964f147d admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:14.360600 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e063cc-f232-4ba8-bca2-dc5c964f147d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:14.360904 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e063cc-f232-4ba8-bca2-dc5c964f147d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:14.362537 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e063cc-f232-4ba8-bca2-dc5c964f147d admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:14.371233 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 289/572] 10.222.0.62 () {56 vars in 1124 bytes} [Tue Nov 23 19:16:14 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:14.378359 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bef9c-a95e-4c08-8554-8dfe16507de2 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:14.387847 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bef9c-a95e-4c08-8554-8dfe16507de2 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:14.391709 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 284/573] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:14.397512 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e063cc-f232-4ba8-bca2-dc5c964f147d admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:14.397981 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb4f32-2cce-45db-9413-83905ba5f7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:14.398784 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb4f32-2cce-45db-9413-83905ba5f7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:14.399056 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb4f32-2cce-45db-9413-83905ba5f7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:14.399329 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb4f32-2cce-45db-9413-83905ba5f7e4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:14.409893 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e063cc-f232-4ba8-bca2-dc5c964f147d admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:14.412544 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb4f32-2cce-45db-9413-83905ba5f7e4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:14.414542 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbec4d1-7e08-49b1-b94b-4cbca2c1af82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:14.414830 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb4f32-2cce-45db-9413-83905ba5f7e4 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:14.415331 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbec4d1-7e08-49b1-b94b-4cbca2c1af82 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:14.415614 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbec4d1-7e08-49b1-b94b-4cbca2c1af82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:14.415896 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbec4d1-7e08-49b1-b94b-4cbca2c1af82 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:14.425581 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbec4d1-7e08-49b1-b94b-4cbca2c1af82 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:14.427899 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbec4d1-7e08-49b1-b94b-4cbca2c1af82 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:14.435216 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-0edb4f32-2cce-45db-9413-83905ba5f7e4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:14.436777 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 290/574] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:14.442799 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a7ff3-236b-4164-bb9d-2b980b51daa3 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:14.442912 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-3dbec4d1-7e08-49b1-b94b-4cbca2c1af82 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 23 19:16:14.443366 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a7ff3-236b-4164-bb9d-2b980b51daa3 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:14.443493 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 285/575] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:16:14 2021] GET /identity/v3/users/glance => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:14.443904 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a7ff3-236b-4164-bb9d-2b980b51daa3 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:14.444228 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbec4d1-7e08-49b1-b94b-4cbca2c1af82 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:14.446473 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 291/576] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:14 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:14.452600 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a7ff3-236b-4164-bb9d-2b980b51daa3 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:14.458718 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbec4d1-7e08-49b1-b94b-4cbca2c1af82 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:14.464252 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50e8d9-6b5c-40b0-a171-e566eba28a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:14.464903 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50e8d9-6b5c-40b0-a171-e566eba28a77 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:14.465185 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50e8d9-6b5c-40b0-a171-e566eba28a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:14.465506 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50e8d9-6b5c-40b0-a171-e566eba28a77 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:14.466241 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50e8d9-6b5c-40b0-a171-e566eba28a77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:14.467149 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50e8d9-6b5c-40b0-a171-e566eba28a77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:14.467822 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a7ff3-236b-4164-bb9d-2b980b51daa3 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:14.468870 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50e8d9-6b5c-40b0-a171-e566eba28a77 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:14.473607 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7b95a-a9f8-40fe-8e0d-1cc209d52184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:14.474563 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7b95a-a9f8-40fe-8e0d-1cc209d52184 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:14.475036 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7b95a-a9f8-40fe-8e0d-1cc209d52184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:14.476011 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7b95a-a9f8-40fe-8e0d-1cc209d52184 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:14.477000 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb7b95a-a9f8-40fe-8e0d-1cc209d52184 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:14.477892 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb7b95a-a9f8-40fe-8e0d-1cc209d52184 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:14.480183 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb7b95a-a9f8-40fe-8e0d-1cc209d52184 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:14.480524 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 286/577] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:14.481836 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff4f57-48d6-4e32-b254-739fc535f18c None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:14.482798 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff4f57-48d6-4e32-b254-739fc535f18c None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:14.483284 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff4f57-48d6-4e32-b254-739fc535f18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:14.501961 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 292/578] 10.222.0.62 () {56 vars in 1158 bytes} [Tue Nov 23 19:16:14 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:14.505457 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-7cff4f57-48d6-4e32-b254-739fc535f18c None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:14.505457 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-7cff4f57-48d6-4e32-b254-739fc535f18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:14.506586 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7b95a-a9f8-40fe-8e0d-1cc209d52184 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:14.513498 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 287/579] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:16:14.514293 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff4f57-48d6-4e32-b254-739fc535f18c None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:14.525396 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7b95a-a9f8-40fe-8e0d-1cc209d52184 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:14.534763 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c26aae-5b76-4278-bd99-941ca57698cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:14.535804 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c26aae-5b76-4278-bd99-941ca57698cd admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:14.536646 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c26aae-5b76-4278-bd99-941ca57698cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:14.536929 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff4f57-48d6-4e32-b254-739fc535f18c None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:14.537341 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c26aae-5b76-4278-bd99-941ca57698cd admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:14.547418 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c26aae-5b76-4278-bd99-941ca57698cd admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:14.548245 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3ff17-0d13-4e77-a851-8db8d9db6c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:14.549051 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3ff17-0d13-4e77-a851-8db8d9db6c3a admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:14.549339 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3ff17-0d13-4e77-a851-8db8d9db6c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:14.549655 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3ff17-0d13-4e77-a851-8db8d9db6c3a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:14.550379 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c26aae-5b76-4278-bd99-941ca57698cd admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:14.561691 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3ff17-0d13-4e77-a851-8db8d9db6c3a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:14.563429 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3ff17-0d13-4e77-a851-8db8d9db6c3a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:14.567826 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-86c26aae-5b76-4278-bd99-941ca57698cd admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 23 19:16:14.569541 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 293/580] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:16:14 2021] GET /identity/v3/users/cinder => generated 84 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:14.570438 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c26aae-5b76-4278-bd99-941ca57698cd admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:14.581567 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c26aae-5b76-4278-bd99-941ca57698cd admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:14.583317 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-bdf3ff17-0d13-4e77-a851-8db8d9db6c3a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:14.585248 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 288/581] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:14.586247 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3ff17-0d13-4e77-a851-8db8d9db6c3a admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:14.587179 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231437a-aa11-4541-a93e-e46fe8f1e7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:14.588166 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231437a-aa11-4541-a93e-e46fe8f1e7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:14.588582 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231437a-aa11-4541-a93e-e46fe8f1e7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:14.589048 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231437a-aa11-4541-a93e-e46fe8f1e7d4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:14.599276 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3ff17-0d13-4e77-a851-8db8d9db6c3a admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:14.605735 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231437a-aa11-4541-a93e-e46fe8f1e7d4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:14.610813 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ba7c0-c4f7-4899-bc10-bb9c2f9bed6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:14.611741 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ba7c0-c4f7-4899-bc10-bb9c2f9bed6e admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:14.612170 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ba7c0-c4f7-4899-bc10-bb9c2f9bed6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:14.612669 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ba7c0-c4f7-4899-bc10-bb9c2f9bed6e admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:14.613284 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-e231437a-aa11-4541-a93e-e46fe8f1e7d4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 19:16:14.613833 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ba7c0-c4f7-4899-bc10-bb9c2f9bed6e admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:14.614318 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ba7c0-c4f7-4899-bc10-bb9c2f9bed6e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:14.614774 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 294/582] 10.222.0.62 () {56 vars in 1123 bytes} [Tue Nov 23 19:16:14 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:14.615547 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231437a-aa11-4541-a93e-e46fe8f1e7d4 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:14.616860 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ba7c0-c4f7-4899-bc10-bb9c2f9bed6e admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:14.630997 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231437a-aa11-4541-a93e-e46fe8f1e7d4 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:14.635974 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c4e90-4bc3-46d6-8151-721f7057445b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:14.636675 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c4e90-4bc3-46d6-8151-721f7057445b admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:14.636885 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c4e90-4bc3-46d6-8151-721f7057445b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:14.637160 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c4e90-4bc3-46d6-8151-721f7057445b admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:14.637916 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c4e90-4bc3-46d6-8151-721f7057445b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:14.638776 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c4e90-4bc3-46d6-8151-721f7057445b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:14.640075 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 289/583] 10.222.0.62 () {56 vars in 1158 bytes} [Tue Nov 23 19:16:14 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:14.640838 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c4e90-4bc3-46d6-8151-721f7057445b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:14.641192 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ba7c0-c4f7-4899-bc10-bb9c2f9bed6e admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:14.653946 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ba7c0-c4f7-4899-bc10-bb9c2f9bed6e admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:14.659049 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5f250-1268-4ee4-b0b2-73ad1ed403d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:14.659740 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5f250-1268-4ee4-b0b2-73ad1ed403d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:14.660021 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5f250-1268-4ee4-b0b2-73ad1ed403d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:14.660294 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5f250-1268-4ee4-b0b2-73ad1ed403d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:14.660755 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 295/584] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:14.661140 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5f250-1268-4ee4-b0b2-73ad1ed403d5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:14.661471 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5f250-1268-4ee4-b0b2-73ad1ed403d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:14.661963 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c4e90-4bc3-46d6-8151-721f7057445b admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:14.663135 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5f250-1268-4ee4-b0b2-73ad1ed403d5 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:14.673007 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 290/585] 10.222.0.62 () {56 vars in 1124 bytes} [Tue Nov 23 19:16:14 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:14.673754 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5f250-1268-4ee4-b0b2-73ad1ed403d5 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:14.682635 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c4e90-4bc3-46d6-8151-721f7057445b admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:14.683079 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5f250-1268-4ee4-b0b2-73ad1ed403d5 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:14.687663 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2583257-7610-403d-88b6-0c535bc80ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:14.688013 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a2f43-d1ad-4e6a-8a95-e2e55879b606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:14.688579 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2583257-7610-403d-88b6-0c535bc80ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:14.688764 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a2f43-d1ad-4e6a-8a95-e2e55879b606 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:14.688995 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2583257-7610-403d-88b6-0c535bc80ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:14.689175 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a2f43-d1ad-4e6a-8a95-e2e55879b606 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:14.689386 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2583257-7610-403d-88b6-0c535bc80ab5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:14.689520 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a2f43-d1ad-4e6a-8a95-e2e55879b606 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:14.696930 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a2f43-d1ad-4e6a-8a95-e2e55879b606 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:14.698948 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a2f43-d1ad-4e6a-8a95-e2e55879b606 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:14.700279 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2583257-7610-403d-88b6-0c535bc80ab5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:14.703080 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2583257-7610-403d-88b6-0c535bc80ab5 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:14.713988 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-f37a2f43-d1ad-4e6a-8a95-e2e55879b606 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:16:14.715234 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 291/586] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:14.721765 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a2f43-d1ad-4e6a-8a95-e2e55879b606 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:14.723568 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-d2583257-7610-403d-88b6-0c535bc80ab5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:14.725210 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 296/587] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:14.726225 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2583257-7610-403d-88b6-0c535bc80ab5 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:14.732748 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a2f43-d1ad-4e6a-8a95-e2e55879b606 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:14.737439 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634cccf7-e14b-4134-a53c-a9388c78565b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:14.738248 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634cccf7-e14b-4134-a53c-a9388c78565b admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:14.738526 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634cccf7-e14b-4134-a53c-a9388c78565b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:14.738793 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634cccf7-e14b-4134-a53c-a9388c78565b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:14.739550 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2583257-7610-403d-88b6-0c535bc80ab5 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:14.745313 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84fcfa-1736-4c74-8f67-e83d7624c39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:14.746831 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84fcfa-1736-4c74-8f67-e83d7624c39b admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:14.747227 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84fcfa-1736-4c74-8f67-e83d7624c39b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:14.747648 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84fcfa-1736-4c74-8f67-e83d7624c39b admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:14.749108 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee84fcfa-1736-4c74-8f67-e83d7624c39b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:14.749860 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee84fcfa-1736-4c74-8f67-e83d7624c39b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:14.750493 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634cccf7-e14b-4134-a53c-a9388c78565b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:14.752076 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee84fcfa-1736-4c74-8f67-e83d7624c39b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:14.752642 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634cccf7-e14b-4134-a53c-a9388c78565b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:14.767659 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 297/588] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:16:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:14.768551 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84fcfa-1736-4c74-8f67-e83d7624c39b admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:14.776362 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-634cccf7-e14b-4134-a53c-a9388c78565b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:14.777612 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 292/589] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:14.778719 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634cccf7-e14b-4134-a53c-a9388c78565b admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:14.791964 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84fcfa-1736-4c74-8f67-e83d7624c39b admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:14.796145 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634cccf7-e14b-4134-a53c-a9388c78565b admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:14.797834 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb988b2-bba9-464c-a8cf-f56d6357dff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:14.798716 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb988b2-bba9-464c-a8cf-f56d6357dff0 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:14.799091 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb988b2-bba9-464c-a8cf-f56d6357dff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:14.799536 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb988b2-bba9-464c-a8cf-f56d6357dff0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:14.800469 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb988b2-bba9-464c-a8cf-f56d6357dff0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:14.800722 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f811e1-e62d-4247-9d78-726ce1806f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:14.800945 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb988b2-bba9-464c-a8cf-f56d6357dff0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:14.801855 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f811e1-e62d-4247-9d78-726ce1806f9a admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:14.802210 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f811e1-e62d-4247-9d78-726ce1806f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:14.802633 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f811e1-e62d-4247-9d78-726ce1806f9a admin admin] PATH_INFO: `/v3/projects/2955b3037801465c9eec5d78fe2e3ae9/users/544443ed44ef41bcaa86af52926bfd14/roles/e68dc60061bd41dc894e1be26b4d5027` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:14.808889 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb988b2-bba9-464c-a8cf-f56d6357dff0 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:14.819691 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f811e1-e62d-4247-9d78-726ce1806f9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2955b3037801465c9eec5d78fe2e3ae9, user_id=544443ed44ef41bcaa86af52926bfd14, role_id=e68dc60061bd41dc894e1be26b4d5027)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:14.822742 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f811e1-e62d-4247-9d78-726ce1806f9a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:14.824086 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 298/590] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:14.824912 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb988b2-bba9-464c-a8cf-f56d6357dff0 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:14.835244 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb988b2-bba9-464c-a8cf-f56d6357dff0 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:14.843576 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13053dc2-3f07-434a-8eda-3fff092760e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:14.843576 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13053dc2-3f07-434a-8eda-3fff092760e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:14.843576 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13053dc2-3f07-434a-8eda-3fff092760e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:14.843576 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13053dc2-3f07-434a-8eda-3fff092760e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:14.843958 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13053dc2-3f07-434a-8eda-3fff092760e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:14.843958 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13053dc2-3f07-434a-8eda-3fff092760e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:14.843958 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13053dc2-3f07-434a-8eda-3fff092760e2 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:14.854868 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 299/591] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:14.855658 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13053dc2-3f07-434a-8eda-3fff092760e2 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:14.869328 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13053dc2-3f07-434a-8eda-3fff092760e2 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:14.874890 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70017c6e-8fa9-46bf-96a9-dc9c90f5fb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:14.875673 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70017c6e-8fa9-46bf-96a9-dc9c90f5fb67 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:14.875958 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70017c6e-8fa9-46bf-96a9-dc9c90f5fb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:14.876234 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70017c6e-8fa9-46bf-96a9-dc9c90f5fb67 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:14.883142 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70017c6e-8fa9-46bf-96a9-dc9c90f5fb67 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:14.885082 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70017c6e-8fa9-46bf-96a9-dc9c90f5fb67 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:14.894311 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 293/592] 10.222.0.62 () {58 vars in 1460 bytes} [Tue Nov 23 19:16:14 2021] PUT /identity/v3/projects/2955b3037801465c9eec5d78fe2e3ae9/users/544443ed44ef41bcaa86af52926bfd14/roles/e68dc60061bd41dc894e1be26b4d5027 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:16:14.899968 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-70017c6e-8fa9-46bf-96a9-dc9c90f5fb67 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:16:14.905375 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f811e1-e62d-4247-9d78-726ce1806f9a admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:14.905544 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 300/593] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:14.907304 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70017c6e-8fa9-46bf-96a9-dc9c90f5fb67 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:14.926781 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70017c6e-8fa9-46bf-96a9-dc9c90f5fb67 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:14.985191 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f811e1-e62d-4247-9d78-726ce1806f9a admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:14.991778 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dea1bd-4a13-4b7b-9e82-ec6ffac6859e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:14.993564 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dea1bd-4a13-4b7b-9e82-ec6ffac6859e admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:14.994298 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dea1bd-4a13-4b7b-9e82-ec6ffac6859e admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:14.994774 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dea1bd-4a13-4b7b-9e82-ec6ffac6859e admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:15.004861 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29794fbc-6629-4606-850e-92ccef317a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:15.005663 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29794fbc-6629-4606-850e-92ccef317a1c admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:15.006013 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29794fbc-6629-4606-850e-92ccef317a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:15.006222 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dea1bd-4a13-4b7b-9e82-ec6ffac6859e admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:15.006366 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29794fbc-6629-4606-850e-92ccef317a1c admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:15.007273 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29794fbc-6629-4606-850e-92ccef317a1c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:15.007697 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29794fbc-6629-4606-850e-92ccef317a1c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:15.009047 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dea1bd-4a13-4b7b-9e82-ec6ffac6859e admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:15.009792 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29794fbc-6629-4606-850e-92ccef317a1c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:15.024854 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 301/594] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:16:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:15.026362 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29fe41-a6ae-4894-be69-1c6f1e235eb8 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:15.026765 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29fe41-a6ae-4894-be69-1c6f1e235eb8 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:15.027032 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-11dea1bd-4a13-4b7b-9e82-ec6ffac6859e admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 23 19:16:15.027485 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29fe41-a6ae-4894-be69-1c6f1e235eb8 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:15.029725 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 294/595] 10.222.0.62 () {56 vars in 1114 bytes} [Tue Nov 23 19:16:14 2021] GET /identity/v3/users/nova => generated 82 bytes in 129 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:15.035153 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 302/596] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:15 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:15.036538 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dea1bd-4a13-4b7b-9e82-ec6ffac6859e admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:15.036646 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e2eca-b3df-424f-893f-bd0269150601 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:15.037217 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e2eca-b3df-424f-893f-bd0269150601 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:15.037217 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e2eca-b3df-424f-893f-bd0269150601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:15.050194 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dea1bd-4a13-4b7b-9e82-ec6ffac6859e admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:15.055755 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962585d-883e-4af6-8127-863c4bdb6b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:15.056807 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962585d-883e-4af6-8127-863c4bdb6b15 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:15.057177 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962585d-883e-4af6-8127-863c4bdb6b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:15.057578 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962585d-883e-4af6-8127-863c4bdb6b15 admin admin] PATH_INFO: `/v3/projects/2955b3037801465c9eec5d78fe2e3ae9/users/9845615593004371a592e46701b5ece6/roles/e68dc60061bd41dc894e1be26b4d5027` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:15.068496 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-b70e2eca-b3df-424f-893f-bd0269150601 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:15.071408 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-b70e2eca-b3df-424f-893f-bd0269150601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:15.077394 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962585d-883e-4af6-8127-863c4bdb6b15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2955b3037801465c9eec5d78fe2e3ae9, user_id=9845615593004371a592e46701b5ece6, role_id=e68dc60061bd41dc894e1be26b4d5027)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:15.080554 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962585d-883e-4af6-8127-863c4bdb6b15 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:15.087065 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 303/597] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:16:15.088044 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e2eca-b3df-424f-893f-bd0269150601 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:15.100737 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e2eca-b3df-424f-893f-bd0269150601 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:15.106186 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ccc4b-fd57-4d5d-afb4-5f0fc3ff8060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:15.107943 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ccc4b-fd57-4d5d-afb4-5f0fc3ff8060 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:15.108445 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ccc4b-fd57-4d5d-afb4-5f0fc3ff8060 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:15.108948 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ccc4b-fd57-4d5d-afb4-5f0fc3ff8060 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:15.110283 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ccc4b-fd57-4d5d-afb4-5f0fc3ff8060 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:15.110909 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ccc4b-fd57-4d5d-afb4-5f0fc3ff8060 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:15.113170 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ccc4b-fd57-4d5d-afb4-5f0fc3ff8060 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:15.146176 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 304/598] 10.222.0.62 () {56 vars in 1154 bytes} [Tue Nov 23 19:16:15 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:15.147026 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ccc4b-fd57-4d5d-afb4-5f0fc3ff8060 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:15.156999 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ccc4b-fd57-4d5d-afb4-5f0fc3ff8060 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:15.161658 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e53bb-7658-4901-9b9a-213bb613d575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:15.162295 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e53bb-7658-4901-9b9a-213bb613d575 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:15.162576 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e53bb-7658-4901-9b9a-213bb613d575 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:15.162845 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e53bb-7658-4901-9b9a-213bb613d575 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:15.176849 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e53bb-7658-4901-9b9a-213bb613d575 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:15.184426 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-2a9e53bb-7658-4901-9b9a-213bb613d575 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 19:16:15.185996 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 295/599] 10.222.0.62 () {58 vars in 1460 bytes} [Tue Nov 23 19:16:15 2021] PUT /identity/v3/projects/2955b3037801465c9eec5d78fe2e3ae9/users/9845615593004371a592e46701b5ece6/roles/e68dc60061bd41dc894e1be26b4d5027 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:16:15.189452 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 305/600] 10.222.0.62 () {56 vars in 1123 bytes} [Tue Nov 23 19:16:15 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:15.190621 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962585d-883e-4af6-8127-863c4bdb6b15 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:15.194361 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e53bb-7658-4901-9b9a-213bb613d575 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:15.204761 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e53bb-7658-4901-9b9a-213bb613d575 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:15.267589 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea1e8c-4e40-46cc-b3fb-90a9b28322d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:15.268582 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea1e8c-4e40-46cc-b3fb-90a9b28322d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:15.269032 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea1e8c-4e40-46cc-b3fb-90a9b28322d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:15.269494 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea1e8c-4e40-46cc-b3fb-90a9b28322d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:15.270428 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962585d-883e-4af6-8127-863c4bdb6b15 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:15.270546 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea1e8c-4e40-46cc-b3fb-90a9b28322d2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:15.270971 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea1e8c-4e40-46cc-b3fb-90a9b28322d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:15.273171 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea1e8c-4e40-46cc-b3fb-90a9b28322d2 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:15.275753 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a589efe-9ab9-43c1-b38c-30c90bf55faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:15.277118 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a589efe-9ab9-43c1-b38c-30c90bf55faa admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:15.277524 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a589efe-9ab9-43c1-b38c-30c90bf55faa admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:15.277892 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a589efe-9ab9-43c1-b38c-30c90bf55faa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:15.284799 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 306/601] 10.222.0.62 () {56 vars in 1124 bytes} [Tue Nov 23 19:16:15 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:15.297168 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a589efe-9ab9-43c1-b38c-30c90bf55faa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:15.299074 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a589efe-9ab9-43c1-b38c-30c90bf55faa admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:15.301552 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea1e8c-4e40-46cc-b3fb-90a9b28322d2 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:15.319965 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea1e8c-4e40-46cc-b3fb-90a9b28322d2 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:15.320302 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-0a589efe-9ab9-43c1-b38c-30c90bf55faa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:15.322082 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 296/602] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 135 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:15.328063 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a589efe-9ab9-43c1-b38c-30c90bf55faa admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:15.338152 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a589efe-9ab9-43c1-b38c-30c90bf55faa admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:15.339741 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0eeef-cb4f-40dd-b649-c07ff1ddf3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:15.340553 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0eeef-cb4f-40dd-b649-c07ff1ddf3fa admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:15.340843 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0eeef-cb4f-40dd-b649-c07ff1ddf3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:15.341121 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0eeef-cb4f-40dd-b649-c07ff1ddf3fa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:15.344034 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f9c94-44f8-4cf4-9a3f-f17123e59eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:15.344877 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f9c94-44f8-4cf4-9a3f-f17123e59eac admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:15.345162 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f9c94-44f8-4cf4-9a3f-f17123e59eac admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:15.345480 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f9c94-44f8-4cf4-9a3f-f17123e59eac admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:15.346234 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f9c94-44f8-4cf4-9a3f-f17123e59eac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:15.346538 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f9c94-44f8-4cf4-9a3f-f17123e59eac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:15.348436 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f9c94-44f8-4cf4-9a3f-f17123e59eac admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:15.362924 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 297/603] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:15.369467 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f9c94-44f8-4cf4-9a3f-f17123e59eac admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:15.374442 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0eeef-cb4f-40dd-b649-c07ff1ddf3fa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:15.376298 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0eeef-cb4f-40dd-b649-c07ff1ddf3fa admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:15.379706 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f9c94-44f8-4cf4-9a3f-f17123e59eac admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:15.384899 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66888f26-19cc-4bdb-b094-4936d02227d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:15.385742 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66888f26-19cc-4bdb-b094-4936d02227d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:15.386021 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66888f26-19cc-4bdb-b094-4936d02227d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:15.386292 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66888f26-19cc-4bdb-b094-4936d02227d9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:15.395868 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66888f26-19cc-4bdb-b094-4936d02227d9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:15.397878 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66888f26-19cc-4bdb-b094-4936d02227d9 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:15.402229 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-42c0eeef-cb4f-40dd-b649-c07ff1ddf3fa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:15.409883 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 307/604] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:15.417338 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-66888f26-19cc-4bdb-b094-4936d02227d9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:16:15.418618 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 298/605] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:15.424365 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0eeef-cb4f-40dd-b649-c07ff1ddf3fa admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:15.424836 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66888f26-19cc-4bdb-b094-4936d02227d9 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:15.435181 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66888f26-19cc-4bdb-b094-4936d02227d9 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:15.440852 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785e523-4fae-46b8-ac98-a826da9f0c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:15.441554 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785e523-4fae-46b8-ac98-a826da9f0c44 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:15.441837 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785e523-4fae-46b8-ac98-a826da9f0c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:15.442108 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785e523-4fae-46b8-ac98-a826da9f0c44 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:15.442911 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785e523-4fae-46b8-ac98-a826da9f0c44 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:15.443216 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785e523-4fae-46b8-ac98-a826da9f0c44 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:15.445158 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785e523-4fae-46b8-ac98-a826da9f0c44 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:15.448212 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0eeef-cb4f-40dd-b649-c07ff1ddf3fa admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:15.466254 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 299/606] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:16:15 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:15.468595 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89053d57-8726-4309-8285-b32e1388eb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:15.469237 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89053d57-8726-4309-8285-b32e1388eb7c admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:15.469564 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89053d57-8726-4309-8285-b32e1388eb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:15.469841 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89053d57-8726-4309-8285-b32e1388eb7c admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:15.470653 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89053d57-8726-4309-8285-b32e1388eb7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:15.471011 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89053d57-8726-4309-8285-b32e1388eb7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:15.472693 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89053d57-8726-4309-8285-b32e1388eb7c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:15.477573 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785e523-4fae-46b8-ac98-a826da9f0c44 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:15.491737 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 308/607] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:15.493307 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785e523-4fae-46b8-ac98-a826da9f0c44 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:15.500529 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89053d57-8726-4309-8285-b32e1388eb7c admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:15.503733 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c024336-8384-40f2-bff3-2447eda1aa77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:15.504793 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c024336-8384-40f2-bff3-2447eda1aa77 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:15.505169 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c024336-8384-40f2-bff3-2447eda1aa77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:15.505603 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c024336-8384-40f2-bff3-2447eda1aa77 admin admin] PATH_INFO: `/v3/projects/2955b3037801465c9eec5d78fe2e3ae9/users/6d91fe7f996b48b0bc28e1eadc4f8869/roles/e68dc60061bd41dc894e1be26b4d5027` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:15.513759 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89053d57-8726-4309-8285-b32e1388eb7c admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:15.520205 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b13c6-98d9-48f9-81ad-90556f4ef576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:15.521376 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b13c6-98d9-48f9-81ad-90556f4ef576 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:15.522134 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b13c6-98d9-48f9-81ad-90556f4ef576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:15.522643 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b13c6-98d9-48f9-81ad-90556f4ef576 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:15.525588 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c024336-8384-40f2-bff3-2447eda1aa77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2955b3037801465c9eec5d78fe2e3ae9, user_id=6d91fe7f996b48b0bc28e1eadc4f8869, role_id=e68dc60061bd41dc894e1be26b4d5027)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:15.528245 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c024336-8384-40f2-bff3-2447eda1aa77 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:15.533287 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b13c6-98d9-48f9-81ad-90556f4ef576 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:15.535715 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b13c6-98d9-48f9-81ad-90556f4ef576 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:15.553813 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-994b13c6-98d9-48f9-81ad-90556f4ef576 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 23 19:16:15.555287 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 309/608] 10.222.0.62 () {56 vars in 1123 bytes} [Tue Nov 23 19:16:15 2021] GET /identity/v3/users/neutron => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:15.561507 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b13c6-98d9-48f9-81ad-90556f4ef576 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:15.571188 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b13c6-98d9-48f9-81ad-90556f4ef576 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:15.576710 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfe32f-b5ec-4bc7-8bba-2e0c6ef2219c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:15.577357 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfe32f-b5ec-4bc7-8bba-2e0c6ef2219c admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:15.577710 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfe32f-b5ec-4bc7-8bba-2e0c6ef2219c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:15.578017 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfe32f-b5ec-4bc7-8bba-2e0c6ef2219c admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:15.579107 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cfe32f-b5ec-4bc7-8bba-2e0c6ef2219c admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:15.579414 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cfe32f-b5ec-4bc7-8bba-2e0c6ef2219c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:15.581336 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cfe32f-b5ec-4bc7-8bba-2e0c6ef2219c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:15.599945 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 310/609] 10.222.0.62 () {56 vars in 1160 bytes} [Tue Nov 23 19:16:15 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:15.605823 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfe32f-b5ec-4bc7-8bba-2e0c6ef2219c admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:15.615841 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfe32f-b5ec-4bc7-8bba-2e0c6ef2219c admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:15.625839 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 300/610] 10.222.0.62 () {58 vars in 1460 bytes} [Tue Nov 23 19:16:15 2021] PUT /identity/v3/projects/2955b3037801465c9eec5d78fe2e3ae9/users/6d91fe7f996b48b0bc28e1eadc4f8869/roles/e68dc60061bd41dc894e1be26b4d5027 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:16:15.627536 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e74c1f-1c3b-4f52-9af5-626d2af45625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:15.628422 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e74c1f-1c3b-4f52-9af5-626d2af45625 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:15.628685 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e74c1f-1c3b-4f52-9af5-626d2af45625 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:15.628955 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e74c1f-1c3b-4f52-9af5-626d2af45625 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:15.641781 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e74c1f-1c3b-4f52-9af5-626d2af45625 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:15.643702 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e74c1f-1c3b-4f52-9af5-626d2af45625 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:15.661664 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7026a1-ccc8-4df4-9f92-39f083b06bfd None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:15.661976 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7026a1-ccc8-4df4-9f92-39f083b06bfd None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:15.662238 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7026a1-ccc8-4df4-9f92-39f083b06bfd None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:15.664217 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 301/611] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 19:16:15.670192 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25430880-8c59-4dd8-b8bf-f5f6220329d0 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:15.670481 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25430880-8c59-4dd8-b8bf-f5f6220329d0 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:15.670755 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25430880-8c59-4dd8-b8bf-f5f6220329d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:15.673964 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-83e74c1f-1c3b-4f52-9af5-626d2af45625 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:15.675646 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 311/612] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:15.688787 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e74c1f-1c3b-4f52-9af5-626d2af45625 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:15.705738 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-25430880-8c59-4dd8-b8bf-f5f6220329d0 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:15.706971 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-25430880-8c59-4dd8-b8bf-f5f6220329d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:15.713794 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e74c1f-1c3b-4f52-9af5-626d2af45625 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:15.820379 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 302/613] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Nov 23 19:16:15.831614 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd341d-6225-4175-8878-6ec5045fbcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:15.832212 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd341d-6225-4175-8878-6ec5045fbcf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:15.832540 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd341d-6225-4175-8878-6ec5045fbcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:15.832820 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd341d-6225-4175-8878-6ec5045fbcf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:15.833651 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd341d-6225-4175-8878-6ec5045fbcf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:15.833959 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd341d-6225-4175-8878-6ec5045fbcf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:15.835602 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd341d-6225-4175-8878-6ec5045fbcf6 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:15.844896 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25430880-8c59-4dd8-b8bf-f5f6220329d0 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:15.855300 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25430880-8c59-4dd8-b8bf-f5f6220329d0 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:15.864046 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 312/614] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:15.866789 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8feed-7b7e-483d-a0bb-31ef6ba9c6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:15.867983 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8feed-7b7e-483d-a0bb-31ef6ba9c6cb admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:15.869135 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd341d-6225-4175-8878-6ec5045fbcf6 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:15.870085 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8feed-7b7e-483d-a0bb-31ef6ba9c6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:15.875398 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8feed-7b7e-483d-a0bb-31ef6ba9c6cb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:15.885633 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd341d-6225-4175-8878-6ec5045fbcf6 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:15.893072 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823a367-13b4-4f37-9db6-a5e6c629f905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:15.893238 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8feed-7b7e-483d-a0bb-31ef6ba9c6cb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:15.893910 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823a367-13b4-4f37-9db6-a5e6c629f905 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:15.894195 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823a367-13b4-4f37-9db6-a5e6c629f905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:15.894466 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823a367-13b4-4f37-9db6-a5e6c629f905 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:15.900261 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-bef8feed-7b7e-483d-a0bb-31ef6ba9c6cb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 19:16:15.901783 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 303/615] 10.222.0.62 () {56 vars in 1123 bytes} [Tue Nov 23 19:16:15 2021] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:15.902247 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823a367-13b4-4f37-9db6-a5e6c629f905 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:15.905106 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823a367-13b4-4f37-9db6-a5e6c629f905 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:15.908800 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8feed-7b7e-483d-a0bb-31ef6ba9c6cb admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:15.919126 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8feed-7b7e-483d-a0bb-31ef6ba9c6cb admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:15.923779 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-7823a367-13b4-4f37-9db6-a5e6c629f905 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:16:15.924711 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb7ca2-dc25-4964-b40c-3caca7a84abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:15.925356 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb7ca2-dc25-4964-b40c-3caca7a84abf admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:15.925648 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 313/616] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:15.926663 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb7ca2-dc25-4964-b40c-3caca7a84abf admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:15.926921 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb7ca2-dc25-4964-b40c-3caca7a84abf admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:15.927694 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb7ca2-dc25-4964-b40c-3caca7a84abf admin admin] RBAC: Adding query filter params (name=service) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:15.928003 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb7ca2-dc25-4964-b40c-3caca7a84abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:15.929619 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb7ca2-dc25-4964-b40c-3caca7a84abf admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:15.933640 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823a367-13b4-4f37-9db6-a5e6c629f905 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:15.939782 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 304/617] 10.222.0.62 () {56 vars in 1124 bytes} [Tue Nov 23 19:16:15 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:15.945455 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb7ca2-dc25-4964-b40c-3caca7a84abf admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:15.949051 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823a367-13b4-4f37-9db6-a5e6c629f905 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:15.954010 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff13605-75fd-4462-869d-e5ee5cd4b10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:15.954586 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff13605-75fd-4462-869d-e5ee5cd4b10c admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:15.954921 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff13605-75fd-4462-869d-e5ee5cd4b10c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:15.955200 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff13605-75fd-4462-869d-e5ee5cd4b10c admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:15.956055 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff13605-75fd-4462-869d-e5ee5cd4b10c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:15.956367 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff13605-75fd-4462-869d-e5ee5cd4b10c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:15.957144 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb7ca2-dc25-4964-b40c-3caca7a84abf admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:15.958346 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff13605-75fd-4462-869d-e5ee5cd4b10c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:15.962491 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded771b-4c0f-4990-aa72-0ffeb688eaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:15.963439 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded771b-4c0f-4990-aa72-0ffeb688eaca admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:15.963865 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded771b-4c0f-4990-aa72-0ffeb688eaca admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:15.964278 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded771b-4c0f-4990-aa72-0ffeb688eaca admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:15.978046 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 314/618] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:16:15 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:15.982746 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded771b-4c0f-4990-aa72-0ffeb688eaca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:15.983353 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff13605-75fd-4462-869d-e5ee5cd4b10c admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:15.985166 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded771b-4c0f-4990-aa72-0ffeb688eaca admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:15.994448 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff13605-75fd-4462-869d-e5ee5cd4b10c admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:16.001114 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f360a-9bf9-4c95-bd30-84d46b8d0023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:16.002096 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f360a-9bf9-4c95-bd30-84d46b8d0023 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:16.002377 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f360a-9bf9-4c95-bd30-84d46b8d0023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:16.002651 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f360a-9bf9-4c95-bd30-84d46b8d0023 admin admin] PATH_INFO: `/v3/projects/2955b3037801465c9eec5d78fe2e3ae9/users/f1ef2ac0a788451eb50fa80f559f808f/roles/e68dc60061bd41dc894e1be26b4d5027` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:16.006542 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-fded771b-4c0f-4990-aa72-0ffeb688eaca admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:16.008181 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 305/619] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:16.013780 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded771b-4c0f-4990-aa72-0ffeb688eaca admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:16.020950 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f360a-9bf9-4c95-bd30-84d46b8d0023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2955b3037801465c9eec5d78fe2e3ae9, user_id=f1ef2ac0a788451eb50fa80f559f808f, role_id=e68dc60061bd41dc894e1be26b4d5027)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:16.023620 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded771b-4c0f-4990-aa72-0ffeb688eaca admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:16.023974 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f360a-9bf9-4c95-bd30-84d46b8d0023 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:16.028696 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f071d77-a984-4cf5-a25a-5696b34d72da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:16.031715 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f071d77-a984-4cf5-a25a-5696b34d72da admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:16.031715 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f071d77-a984-4cf5-a25a-5696b34d72da admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:16.031715 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f071d77-a984-4cf5-a25a-5696b34d72da admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:16.031715 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f071d77-a984-4cf5-a25a-5696b34d72da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:16.031715 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f071d77-a984-4cf5-a25a-5696b34d72da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:16.033382 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f071d77-a984-4cf5-a25a-5696b34d72da admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:16.047065 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 306/620] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:16.052481 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f071d77-a984-4cf5-a25a-5696b34d72da admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:16.062766 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f071d77-a984-4cf5-a25a-5696b34d72da admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:16.067739 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa60169-4dfc-4911-b476-1e0e692814c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:16.068684 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa60169-4dfc-4911-b476-1e0e692814c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:16.069037 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa60169-4dfc-4911-b476-1e0e692814c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:16.069421 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa60169-4dfc-4911-b476-1e0e692814c1 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:16.078250 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa60169-4dfc-4911-b476-1e0e692814c1 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:16.080413 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa60169-4dfc-4911-b476-1e0e692814c1 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:16.095296 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-8aa60169-4dfc-4911-b476-1e0e692814c1 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 23 19:16:16.096786 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 307/621] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:16:16 2021] GET /identity/v3/users/swift => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:16.102635 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa60169-4dfc-4911-b476-1e0e692814c1 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:16.113235 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa60169-4dfc-4911-b476-1e0e692814c1 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:16.117840 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f8b36-f926-4cc2-937d-6157ca249d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:16.118660 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f8b36-f926-4cc2-937d-6157ca249d9a admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:16.119010 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f8b36-f926-4cc2-937d-6157ca249d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:16.119389 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f8b36-f926-4cc2-937d-6157ca249d9a admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:16.120307 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f8b36-f926-4cc2-937d-6157ca249d9a admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:16.120681 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f8b36-f926-4cc2-937d-6157ca249d9a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:16.122684 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f8b36-f926-4cc2-937d-6157ca249d9a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:16.141872 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 308/622] 10.222.0.62 () {56 vars in 1156 bytes} [Tue Nov 23 19:16:16 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:16.147943 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f8b36-f926-4cc2-937d-6157ca249d9a admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:16.158546 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f8b36-f926-4cc2-937d-6157ca249d9a admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:16.162254 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 315/623] 10.222.0.62 () {58 vars in 1460 bytes} [Tue Nov 23 19:16:15 2021] PUT /identity/v3/projects/2955b3037801465c9eec5d78fe2e3ae9/users/f1ef2ac0a788451eb50fa80f559f808f/roles/e68dc60061bd41dc894e1be26b4d5027 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:16:16.232422 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92801ee-3fd4-4219-8bb7-fd3d50cf3d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:16.233026 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92801ee-3fd4-4219-8bb7-fd3d50cf3d48 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:16.233253 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92801ee-3fd4-4219-8bb7-fd3d50cf3d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:16.233619 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92801ee-3fd4-4219-8bb7-fd3d50cf3d48 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:16.245454 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92801ee-3fd4-4219-8bb7-fd3d50cf3d48 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:16.247319 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92801ee-3fd4-4219-8bb7-fd3d50cf3d48 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:16.260202 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 309/624] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:16:16 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 23 19:16:16.267391 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f360a-9bf9-4c95-bd30-84d46b8d0023 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:16.284481 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f360a-9bf9-4c95-bd30-84d46b8d0023 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:16.294575 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233dcdfb-51c4-4e16-aa44-94c85a73b3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:16.295744 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dcdfb-51c4-4e16-aa44-94c85a73b3bf admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:16.296119 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dcdfb-51c4-4e16-aa44-94c85a73b3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:16.296492 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dcdfb-51c4-4e16-aa44-94c85a73b3bf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:16.313079 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233dcdfb-51c4-4e16-aa44-94c85a73b3bf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:16.315206 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233dcdfb-51c4-4e16-aa44-94c85a73b3bf admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:16.340812 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-233dcdfb-51c4-4e16-aa44-94c85a73b3bf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:16.343151 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 316/625] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:16.349138 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92801ee-3fd4-4219-8bb7-fd3d50cf3d48 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:16.358458 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92801ee-3fd4-4219-8bb7-fd3d50cf3d48 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:16.365734 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3535e-f487-4865-a941-aa2475835b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:16.366412 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3535e-f487-4865-a941-aa2475835b5c admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:16.366695 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3535e-f487-4865-a941-aa2475835b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:16.366972 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3535e-f487-4865-a941-aa2475835b5c admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:16.367719 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3535e-f487-4865-a941-aa2475835b5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:16.368029 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3535e-f487-4865-a941-aa2475835b5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:16.369658 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3535e-f487-4865-a941-aa2475835b5c admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:16.384544 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 310/626] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:16.391243 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233dcdfb-51c4-4e16-aa44-94c85a73b3bf admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:16.401260 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233dcdfb-51c4-4e16-aa44-94c85a73b3bf admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:16.409604 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634d445-0031-45ac-ba2f-24ae11b4f6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:16.410403 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634d445-0031-45ac-ba2f-24ae11b4f6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:16.410720 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634d445-0031-45ac-ba2f-24ae11b4f6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:16.411054 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634d445-0031-45ac-ba2f-24ae11b4f6a8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:16.419520 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634d445-0031-45ac-ba2f-24ae11b4f6a8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:16.422260 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634d445-0031-45ac-ba2f-24ae11b4f6a8 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:16.436135 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-e634d445-0031-45ac-ba2f-24ae11b4f6a8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:16:16.437727 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 317/627] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:16 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:16.443918 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3535e-f487-4865-a941-aa2475835b5c admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:16.456188 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3535e-f487-4865-a941-aa2475835b5c admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:16.460921 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918a083-ef68-4a8e-8371-63424e55d05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:16.461674 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918a083-ef68-4a8e-8371-63424e55d05b admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:16.462071 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918a083-ef68-4a8e-8371-63424e55d05b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:16.462408 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918a083-ef68-4a8e-8371-63424e55d05b admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:16.463331 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7918a083-ef68-4a8e-8371-63424e55d05b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:16.463707 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7918a083-ef68-4a8e-8371-63424e55d05b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:16.465675 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7918a083-ef68-4a8e-8371-63424e55d05b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:16.479873 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 311/628] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:16:16 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:16.487341 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634d445-0031-45ac-ba2f-24ae11b4f6a8 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:16.499769 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634d445-0031-45ac-ba2f-24ae11b4f6a8 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:16.504699 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96dd9d-a897-4868-8cee-7c5977e622af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:16.505632 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96dd9d-a897-4868-8cee-7c5977e622af admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:16.506103 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96dd9d-a897-4868-8cee-7c5977e622af admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:16.506595 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96dd9d-a897-4868-8cee-7c5977e622af admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:16.507629 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96dd9d-a897-4868-8cee-7c5977e622af admin admin] RBAC: Adding query filter params (role.id=e68dc60061bd41dc894e1be26b4d5027, scope.project.id=2955b3037801465c9eec5d78fe2e3ae9, user.id=87b6ed93587a4c87ad5002fc80b985c9) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:16.508168 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96dd9d-a897-4868-8cee-7c5977e622af admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:16.510237 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96dd9d-a897-4868-8cee-7c5977e622af admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:16.518516 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 318/629] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:16:16 2021] GET /identity/v3/role_assignments?user.id=87b6ed93587a4c87ad5002fc80b985c9&scope.project.id=2955b3037801465c9eec5d78fe2e3ae9&role.id=e68dc60061bd41dc894e1be26b4d5027 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:18.041185 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d5909-4ed3-4b9f-9a17-965a38c3690a None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.041762 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d5909-4ed3-4b9f-9a17-965a38c3690a None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.041762 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d5909-4ed3-4b9f-9a17-965a38c3690a None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.043734 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 312/630] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:18.050417 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6178e-93ca-4d67-a4b0-e7d15117d067 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.050829 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6178e-93ca-4d67-a4b0-e7d15117d067 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.051029 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6178e-93ca-4d67-a4b0-e7d15117d067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.071994 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-1cb6178e-93ca-4d67-a4b0-e7d15117d067 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:18.073095 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-1cb6178e-93ca-4d67-a4b0-e7d15117d067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:18.087819 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 319/631] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:18 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 19:16:18.124416 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d5909-4ed3-4b9f-9a17-965a38c3690a None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:18.139130 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d5909-4ed3-4b9f-9a17-965a38c3690a None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:18.143939 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c799d-a92a-4374-bda7-3a06ccb2e0f3 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.144221 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c799d-a92a-4374-bda7-3a06ccb2e0f3 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.144491 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c799d-a92a-4374-bda7-3a06ccb2e0f3 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.146562 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 320/632] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 19:16:18.152096 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b69426-f329-4c0c-a5a8-d3b9f92f36e1 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.152601 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91579dbb-d008-46cc-8f45-5ad0392bba71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:18.152828 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b69426-f329-4c0c-a5a8-d3b9f92f36e1 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.153297 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b69426-f329-4c0c-a5a8-d3b9f92f36e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.153397 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91579dbb-d008-46cc-8f45-5ad0392bba71 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.153673 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91579dbb-d008-46cc-8f45-5ad0392bba71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.154621 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91579dbb-d008-46cc-8f45-5ad0392bba71 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.177375 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91579dbb-d008-46cc-8f45-5ad0392bba71 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:18.187184 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-91579dbb-d008-46cc-8f45-5ad0392bba71 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 19:16:18.187898 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-c7b69426-f329-4c0c-a5a8-d3b9f92f36e1 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:18.188404 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 313/633] 10.222.0.62 () {56 vars in 1123 bytes} [Tue Nov 23 19:16:18 2021] GET /identity/v3/roles/service => generated 85 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:18.189704 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-c7b69426-f329-4c0c-a5a8-d3b9f92f36e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:18.195380 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91579dbb-d008-46cc-8f45-5ad0392bba71 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:18.198502 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 321/634] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:18 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 19:16:18.208869 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91579dbb-d008-46cc-8f45-5ad0392bba71 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:18.223729 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552e39b-f570-4779-9302-213d4902d9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:18.224413 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552e39b-f570-4779-9302-213d4902d9d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.224693 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552e39b-f570-4779-9302-213d4902d9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.224965 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552e39b-f570-4779-9302-213d4902d9d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.225483 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b69426-f329-4c0c-a5a8-d3b9f92f36e1 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:18.225777 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c552e39b-f570-4779-9302-213d4902d9d8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:18.226086 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c552e39b-f570-4779-9302-213d4902d9d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:18.227701 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c552e39b-f570-4779-9302-213d4902d9d8 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:18.236561 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b69426-f329-4c0c-a5a8-d3b9f92f36e1 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:18.242859 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ec708-c88b-416e-b91c-2b3b93a2ada7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:18.244076 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ec708-c88b-416e-b91c-2b3b93a2ada7 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.244564 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ec708-c88b-416e-b91c-2b3b93a2ada7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.245039 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ec708-c88b-416e-b91c-2b3b93a2ada7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.247963 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 314/635] 10.222.0.62 () {56 vars in 1124 bytes} [Tue Nov 23 19:16:18 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:18.254227 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552e39b-f570-4779-9302-213d4902d9d8 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:18.258082 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ec708-c88b-416e-b91c-2b3b93a2ada7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:18.265883 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-f94ec708-c88b-416e-b91c-2b3b93a2ada7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 19:16:18.272430 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552e39b-f570-4779-9302-213d4902d9d8 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:18.272707 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 322/636] 10.222.0.62 () {56 vars in 1123 bytes} [Tue Nov 23 19:16:18 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:18.274108 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ec708-c88b-416e-b91c-2b3b93a2ada7 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:18.284848 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ec708-c88b-416e-b91c-2b3b93a2ada7 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:18.286045 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b95b1-c51a-44be-b704-b9a257ca6031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:18.286817 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b95b1-c51a-44be-b704-b9a257ca6031 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.287094 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b95b1-c51a-44be-b704-b9a257ca6031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.287392 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b95b1-c51a-44be-b704-b9a257ca6031 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.290425 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31801b-b64a-40f7-ac4d-35d2eb6f4e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:18.291300 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31801b-b64a-40f7-ac4d-35d2eb6f4e82 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.291806 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31801b-b64a-40f7-ac4d-35d2eb6f4e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.292281 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31801b-b64a-40f7-ac4d-35d2eb6f4e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.293235 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31801b-b64a-40f7-ac4d-35d2eb6f4e82 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:18.293778 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31801b-b64a-40f7-ac4d-35d2eb6f4e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:18.296110 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31801b-b64a-40f7-ac4d-35d2eb6f4e82 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:18.310382 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b95b1-c51a-44be-b704-b9a257ca6031 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:18.310743 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 323/637] 10.222.0.62 () {56 vars in 1124 bytes} [Tue Nov 23 19:16:18 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:18.312369 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b95b1-c51a-44be-b704-b9a257ca6031 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:18.312981 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31801b-b64a-40f7-ac4d-35d2eb6f4e82 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:18.323393 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31801b-b64a-40f7-ac4d-35d2eb6f4e82 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:18.336917 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-e22b95b1-c51a-44be-b704-b9a257ca6031 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:18.339278 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd7a55-3d70-4a79-b2dd-01dec6218aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:18.340315 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd7a55-3d70-4a79-b2dd-01dec6218aab admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.340806 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd7a55-3d70-4a79-b2dd-01dec6218aab admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.341294 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd7a55-3d70-4a79-b2dd-01dec6218aab admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.350938 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 315/638] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:18.356453 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd7a55-3d70-4a79-b2dd-01dec6218aab admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:18.356754 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b95b1-c51a-44be-b704-b9a257ca6031 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:18.359676 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd7a55-3d70-4a79-b2dd-01dec6218aab admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:18.377770 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-3bfd7a55-3d70-4a79-b2dd-01dec6218aab admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:18.383645 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b95b1-c51a-44be-b704-b9a257ca6031 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:18.384058 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 324/639] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:18.386067 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd7a55-3d70-4a79-b2dd-01dec6218aab admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:18.391422 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57417a92-adf0-4426-949d-a42072db5b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:18.392087 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57417a92-adf0-4426-949d-a42072db5b97 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.392366 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57417a92-adf0-4426-949d-a42072db5b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.392639 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57417a92-adf0-4426-949d-a42072db5b97 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.393381 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57417a92-adf0-4426-949d-a42072db5b97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:18.393710 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57417a92-adf0-4426-949d-a42072db5b97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:18.395295 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57417a92-adf0-4426-949d-a42072db5b97 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:18.398809 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd7a55-3d70-4a79-b2dd-01dec6218aab admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:18.403550 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dac386-4b70-445e-9d4a-f0b0e7ac888a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:18.405089 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dac386-4b70-445e-9d4a-f0b0e7ac888a admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.405607 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dac386-4b70-445e-9d4a-f0b0e7ac888a admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.406101 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dac386-4b70-445e-9d4a-f0b0e7ac888a admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.407061 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dac386-4b70-445e-9d4a-f0b0e7ac888a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:18.407566 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dac386-4b70-445e-9d4a-f0b0e7ac888a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:18.409348 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dac386-4b70-445e-9d4a-f0b0e7ac888a admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:18.421030 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 316/640] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:18.424925 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1a543-77b1-41be-b5b1-03e27919a935 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.424925 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1a543-77b1-41be-b5b1-03e27919a935 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.424925 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1a543-77b1-41be-b5b1-03e27919a935 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.424925 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 317/642] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:18.425547 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 325/642] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:18.430038 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1a543-77b1-41be-b5b1-03e27919a935 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:18.430478 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dac386-4b70-445e-9d4a-f0b0e7ac888a admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:18.440750 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dac386-4b70-445e-9d4a-f0b0e7ac888a admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:18.442994 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1a543-77b1-41be-b5b1-03e27919a935 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:18.450606 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd34a83-64ec-4570-b441-b518735c7646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:18.452169 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd34a83-64ec-4570-b441-b518735c7646 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.452630 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd34a83-64ec-4570-b441-b518735c7646 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.453079 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd34a83-64ec-4570-b441-b518735c7646 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.453181 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc4aab2-2c9b-4fd8-b49f-64752f0591c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:18.454200 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4aab2-2c9b-4fd8-b49f-64752f0591c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.454554 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4aab2-2c9b-4fd8-b49f-64752f0591c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.454936 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4aab2-2c9b-4fd8-b49f-64752f0591c1 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.462842 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd34a83-64ec-4570-b441-b518735c7646 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:18.463627 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc4aab2-2c9b-4fd8-b49f-64752f0591c1 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:18.465252 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd34a83-64ec-4570-b441-b518735c7646 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:18.465849 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc4aab2-2c9b-4fd8-b49f-64752f0591c1 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:18.480027 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-2bd34a83-64ec-4570-b441-b518735c7646 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 23 19:16:18.480921 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-5bc4aab2-2c9b-4fd8-b49f-64752f0591c1 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 23 19:16:18.481648 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 326/643] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:16:18 2021] GET /identity/v3/users/cinder => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:18.483090 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 318/644] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:16:18 2021] GET /identity/v3/users/glance => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:18.483297 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ac348-2651-412c-9ad8-305495311bc4 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.483595 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ac348-2651-412c-9ad8-305495311bc4 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.484129 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ac348-2651-412c-9ad8-305495311bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.491178 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc4aab2-2c9b-4fd8-b49f-64752f0591c1 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:18.502003 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc4aab2-2c9b-4fd8-b49f-64752f0591c1 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:18.502150 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-ec2ac348-2651-412c-9ad8-305495311bc4 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:18.503237 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-ec2ac348-2651-412c-9ad8-305495311bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:18.507320 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6b00a-89af-4198-bcd7-1344ada5357a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:18.507986 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6b00a-89af-4198-bcd7-1344ada5357a admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.508270 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6b00a-89af-4198-bcd7-1344ada5357a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.508529 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6b00a-89af-4198-bcd7-1344ada5357a admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.509436 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6b00a-89af-4198-bcd7-1344ada5357a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:18.509755 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6b00a-89af-4198-bcd7-1344ada5357a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:18.511636 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6b00a-89af-4198-bcd7-1344ada5357a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:18.512875 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 327/645] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:18 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:16:18.515149 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ac348-2651-412c-9ad8-305495311bc4 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:18.528939 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ac348-2651-412c-9ad8-305495311bc4 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:18.544447 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202bce4-2462-4842-bd56-910cf4b0087d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:18.546283 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202bce4-2462-4842-bd56-910cf4b0087d admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.546770 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202bce4-2462-4842-bd56-910cf4b0087d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.547278 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202bce4-2462-4842-bd56-910cf4b0087d admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.548205 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 319/646] 10.222.0.62 () {56 vars in 1158 bytes} [Tue Nov 23 19:16:18 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:18.548644 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202bce4-2462-4842-bd56-910cf4b0087d admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:18.549097 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6b00a-89af-4198-bcd7-1344ada5357a admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:18.549567 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202bce4-2462-4842-bd56-910cf4b0087d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:18.551709 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202bce4-2462-4842-bd56-910cf4b0087d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:18.559910 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6b00a-89af-4198-bcd7-1344ada5357a admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:18.565930 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cb05f-5855-44d6-a1c5-926a625170d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:18.566705 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cb05f-5855-44d6-a1c5-926a625170d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.566988 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cb05f-5855-44d6-a1c5-926a625170d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.567266 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cb05f-5855-44d6-a1c5-926a625170d6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.573174 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 328/647] 10.222.0.62 () {56 vars in 1158 bytes} [Tue Nov 23 19:16:18 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:18.574563 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202bce4-2462-4842-bd56-910cf4b0087d admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:18.579785 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215cb05f-5855-44d6-a1c5-926a625170d6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:18.585815 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202bce4-2462-4842-bd56-910cf4b0087d admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:18.588051 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-215cb05f-5855-44d6-a1c5-926a625170d6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 19:16:18.589377 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 320/648] 10.222.0.62 () {56 vars in 1123 bytes} [Tue Nov 23 19:16:18 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:18.593624 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cb05f-5855-44d6-a1c5-926a625170d6 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:18.597672 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a270eb2-460e-4502-97b4-1bade027ca0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:18.598319 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a270eb2-460e-4502-97b4-1bade027ca0a admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.598602 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a270eb2-460e-4502-97b4-1bade027ca0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.598877 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a270eb2-460e-4502-97b4-1bade027ca0a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.609680 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cb05f-5855-44d6-a1c5-926a625170d6 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:18.612092 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a270eb2-460e-4502-97b4-1bade027ca0a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:18.613883 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a270eb2-460e-4502-97b4-1bade027ca0a admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:18.614969 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded834e-b8c1-4616-a445-b5c0267cb74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:18.615879 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded834e-b8c1-4616-a445-b5c0267cb74b admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.616356 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded834e-b8c1-4616-a445-b5c0267cb74b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.616878 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded834e-b8c1-4616-a445-b5c0267cb74b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.623328 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 329/649] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:16:18 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:16:18.624243 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a270eb2-460e-4502-97b4-1bade027ca0a admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:18.627285 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded834e-b8c1-4616-a445-b5c0267cb74b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:18.629338 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded834e-b8c1-4616-a445-b5c0267cb74b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:18.633134 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a270eb2-460e-4502-97b4-1bade027ca0a admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:18.637879 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82348bb4-e11e-414e-852d-68f756cefea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:18.639110 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82348bb4-e11e-414e-852d-68f756cefea6 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.639734 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82348bb4-e11e-414e-852d-68f756cefea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.639734 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82348bb4-e11e-414e-852d-68f756cefea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.640503 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82348bb4-e11e-414e-852d-68f756cefea6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:18.640812 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82348bb4-e11e-414e-852d-68f756cefea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:18.642275 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 321/650] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:16:18 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:16:18.642583 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82348bb4-e11e-414e-852d-68f756cefea6 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:18.643562 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded834e-b8c1-4616-a445-b5c0267cb74b admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:18.651684 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 330/651] 10.222.0.62 () {56 vars in 1124 bytes} [Tue Nov 23 19:16:18 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:18.656455 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82348bb4-e11e-414e-852d-68f756cefea6 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:18.656569 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded834e-b8c1-4616-a445-b5c0267cb74b admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:18.664625 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd7f48-0796-4d80-8b65-80d412545487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:18.665826 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd7f48-0796-4d80-8b65-80d412545487 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.666374 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd7f48-0796-4d80-8b65-80d412545487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.666875 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd7f48-0796-4d80-8b65-80d412545487 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.667178 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82348bb4-e11e-414e-852d-68f756cefea6 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:18.672656 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e4b14-952c-4d1e-9ed3-0d97e358054c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:18.673442 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e4b14-952c-4d1e-9ed3-0d97e358054c admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.673741 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e4b14-952c-4d1e-9ed3-0d97e358054c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.674023 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e4b14-952c-4d1e-9ed3-0d97e358054c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.681374 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd7f48-0796-4d80-8b65-80d412545487 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:18.683544 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd7f48-0796-4d80-8b65-80d412545487 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:18.684903 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e4b14-952c-4d1e-9ed3-0d97e358054c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:18.687510 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e4b14-952c-4d1e-9ed3-0d97e358054c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:18.705612 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-208e4b14-952c-4d1e-9ed3-0d97e358054c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:18.706119 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-90fd7f48-0796-4d80-8b65-80d412545487 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:18.706891 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 331/652] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:18.707762 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e4b14-952c-4d1e-9ed3-0d97e358054c admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:18.708157 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 322/653] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:18.715041 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd7f48-0796-4d80-8b65-80d412545487 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:18.718633 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e4b14-952c-4d1e-9ed3-0d97e358054c admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:18.723660 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ab545-b89d-48a2-bead-1f602168f5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:18.724470 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ab545-b89d-48a2-bead-1f602168f5a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.724744 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ab545-b89d-48a2-bead-1f602168f5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.725023 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ab545-b89d-48a2-bead-1f602168f5a5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.727535 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd7f48-0796-4d80-8b65-80d412545487 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:18.733393 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55cefe-0eba-4703-93ce-7893135d217b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:18.734531 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55cefe-0eba-4703-93ce-7893135d217b admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.735013 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55cefe-0eba-4703-93ce-7893135d217b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.735525 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55cefe-0eba-4703-93ce-7893135d217b admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.736555 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55cefe-0eba-4703-93ce-7893135d217b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:18.737088 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55cefe-0eba-4703-93ce-7893135d217b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:18.737499 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ab545-b89d-48a2-bead-1f602168f5a5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:18.739230 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55cefe-0eba-4703-93ce-7893135d217b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:18.739339 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ab545-b89d-48a2-bead-1f602168f5a5 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:18.753065 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 323/654] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:18.753817 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55cefe-0eba-4703-93ce-7893135d217b admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:18.759252 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-5e3ab545-b89d-48a2-bead-1f602168f5a5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:18.760556 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 332/655] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:18.761213 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ab545-b89d-48a2-bead-1f602168f5a5 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:18.764195 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55cefe-0eba-4703-93ce-7893135d217b admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:18.770726 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012082a0-a030-47c1-b652-64129726acb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:18.771251 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ab545-b89d-48a2-bead-1f602168f5a5 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:18.771720 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012082a0-a030-47c1-b652-64129726acb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.772238 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012082a0-a030-47c1-b652-64129726acb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.772729 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012082a0-a030-47c1-b652-64129726acb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.773691 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012082a0-a030-47c1-b652-64129726acb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:18.774126 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012082a0-a030-47c1-b652-64129726acb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:18.775699 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39434f31-3fe9-40bd-8c95-71643eee59a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:18.776292 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012082a0-a030-47c1-b652-64129726acb0 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:18.776455 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39434f31-3fe9-40bd-8c95-71643eee59a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.776750 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39434f31-3fe9-40bd-8c95-71643eee59a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.777008 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39434f31-3fe9-40bd-8c95-71643eee59a1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.790359 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39434f31-3fe9-40bd-8c95-71643eee59a1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:18.791742 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 324/656] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:18.792317 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39434f31-3fe9-40bd-8c95-71643eee59a1 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:18.793000 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012082a0-a030-47c1-b652-64129726acb0 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:18.807310 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012082a0-a030-47c1-b652-64129726acb0 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:18.812319 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31119700-afa9-45d3-b93b-0d1ff3db4bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:18.813127 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31119700-afa9-45d3-b93b-0d1ff3db4bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.813592 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31119700-afa9-45d3-b93b-0d1ff3db4bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.814000 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31119700-afa9-45d3-b93b-0d1ff3db4bc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.814866 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31119700-afa9-45d3-b93b-0d1ff3db4bc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:18.815326 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31119700-afa9-45d3-b93b-0d1ff3db4bc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:18.817021 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31119700-afa9-45d3-b93b-0d1ff3db4bc4 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:18.818202 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-39434f31-3fe9-40bd-8c95-71643eee59a1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:16:18.819507 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 333/657] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:18.820333 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39434f31-3fe9-40bd-8c95-71643eee59a1 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:18.831076 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 325/658] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:18.831223 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39434f31-3fe9-40bd-8c95-71643eee59a1 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:18.835903 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31119700-afa9-45d3-b93b-0d1ff3db4bc4 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:18.845643 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718f9eb-3d09-4739-a8a1-e34b371e08cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:18.846504 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31119700-afa9-45d3-b93b-0d1ff3db4bc4 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:18.847028 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718f9eb-3d09-4739-a8a1-e34b371e08cd admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.847577 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718f9eb-3d09-4739-a8a1-e34b371e08cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.847951 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718f9eb-3d09-4739-a8a1-e34b371e08cd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.851670 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1b1a7-3942-427d-9536-059b60b7a338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:18.852520 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1b1a7-3942-427d-9536-059b60b7a338 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.852983 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1b1a7-3942-427d-9536-059b60b7a338 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.853425 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1b1a7-3942-427d-9536-059b60b7a338 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.854540 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1b1a7-3942-427d-9536-059b60b7a338 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:18.854994 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1b1a7-3942-427d-9536-059b60b7a338 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:18.856416 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718f9eb-3d09-4739-a8a1-e34b371e08cd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:18.857995 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1b1a7-3942-427d-9536-059b60b7a338 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:18.859120 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718f9eb-3d09-4739-a8a1-e34b371e08cd admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:18.870930 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 326/659] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:16:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:18.872057 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1b1a7-3942-427d-9536-059b60b7a338 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:18.874454 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-1718f9eb-3d09-4739-a8a1-e34b371e08cd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:16:18.875975 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 334/660] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:18.878369 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718f9eb-3d09-4739-a8a1-e34b371e08cd admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:18.885688 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1b1a7-3942-427d-9536-059b60b7a338 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:18.891045 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c231b-6aaf-47d6-809c-6527f9892878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:18.892079 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c231b-6aaf-47d6-809c-6527f9892878 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.892590 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c231b-6aaf-47d6-809c-6527f9892878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.892915 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718f9eb-3d09-4739-a8a1-e34b371e08cd admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:18.893292 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c231b-6aaf-47d6-809c-6527f9892878 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.898214 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc769b43-775d-463c-87c0-b9da2a1b376f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:18.898924 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc769b43-775d-463c-87c0-b9da2a1b376f admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.899286 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc769b43-775d-463c-87c0-b9da2a1b376f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.899628 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc769b43-775d-463c-87c0-b9da2a1b376f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.900537 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc769b43-775d-463c-87c0-b9da2a1b376f admin admin] RBAC: Adding query filter params (role.id=e68dc60061bd41dc894e1be26b4d5027, scope.project.id=2955b3037801465c9eec5d78fe2e3ae9, user.id=9845615593004371a592e46701b5ece6) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:18.900909 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc769b43-775d-463c-87c0-b9da2a1b376f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:18.902674 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c231b-6aaf-47d6-809c-6527f9892878 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:18.903203 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc769b43-775d-463c-87c0-b9da2a1b376f admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:18.906266 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c231b-6aaf-47d6-809c-6527f9892878 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:18.910064 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 335/661] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:16:18 2021] GET /identity/v3/role_assignments?user.id=9845615593004371a592e46701b5ece6&scope.project.id=2955b3037801465c9eec5d78fe2e3ae9&role.id=e68dc60061bd41dc894e1be26b4d5027 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:18.911382 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc769b43-775d-463c-87c0-b9da2a1b376f admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:18.921090 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc769b43-775d-463c-87c0-b9da2a1b376f admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:18.921913 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-d57c231b-6aaf-47d6-809c-6527f9892878 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 23 19:16:18.923521 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 327/662] 10.222.0.62 () {56 vars in 1114 bytes} [Tue Nov 23 19:16:18 2021] GET /identity/v3/users/nova => generated 82 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:18.925071 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43957960-8dd3-4a09-9bc9-8ce63eaed2f9 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.925366 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43957960-8dd3-4a09-9bc9-8ce63eaed2f9 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.925671 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43957960-8dd3-4a09-9bc9-8ce63eaed2f9 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.927859 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 328/663] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:18.929098 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43957960-8dd3-4a09-9bc9-8ce63eaed2f9 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:18.931424 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b781286-c883-480c-b50c-7ccb820b3f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:18.932393 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b781286-c883-480c-b50c-7ccb820b3f87 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.933030 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b781286-c883-480c-b50c-7ccb820b3f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.933482 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b781286-c883-480c-b50c-7ccb820b3f87 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.934398 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b781286-c883-480c-b50c-7ccb820b3f87 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:18.934808 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b781286-c883-480c-b50c-7ccb820b3f87 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:18.936803 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b781286-c883-480c-b50c-7ccb820b3f87 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:18.942802 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43957960-8dd3-4a09-9bc9-8ce63eaed2f9 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:18.947817 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35651d75-0517-41d4-9059-9094fc379966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:18.948498 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35651d75-0517-41d4-9059-9094fc379966 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.948780 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35651d75-0517-41d4-9059-9094fc379966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.949057 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35651d75-0517-41d4-9059-9094fc379966 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.949961 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35651d75-0517-41d4-9059-9094fc379966 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:18.950274 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35651d75-0517-41d4-9059-9094fc379966 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:18.952557 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35651d75-0517-41d4-9059-9094fc379966 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:18.952905 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 336/664] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:16:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:18.954586 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ef3e1-71c3-4d0a-a461-bec903a35719 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:18.955108 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ef3e1-71c3-4d0a-a461-bec903a35719 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:18.955619 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ef3e1-71c3-4d0a-a461-bec903a35719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:18.974394 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 329/665] 10.222.0.62 () {56 vars in 1154 bytes} [Tue Nov 23 19:16:18 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:18.980729 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35651d75-0517-41d4-9059-9094fc379966 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:18.986682 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-b17ef3e1-71c3-4d0a-a461-bec903a35719 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:18.988192 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-b17ef3e1-71c3-4d0a-a461-bec903a35719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:18.992761 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35651d75-0517-41d4-9059-9094fc379966 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:18.997177 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 337/666] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:18 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:16:18.998955 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ef3e1-71c3-4d0a-a461-bec903a35719 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:18.999061 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cb9bc-1e11-44ba-9e7d-844b5b577ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:18.999839 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cb9bc-1e11-44ba-9e7d-844b5b577ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:19.000194 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cb9bc-1e11-44ba-9e7d-844b5b577ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:19.000608 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cb9bc-1e11-44ba-9e7d-844b5b577ae2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:19.001581 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9cb9bc-1e11-44ba-9e7d-844b5b577ae2 admin admin] RBAC: Adding query filter params (role.id=e68dc60061bd41dc894e1be26b4d5027, scope.project.id=2955b3037801465c9eec5d78fe2e3ae9, user.id=544443ed44ef41bcaa86af52926bfd14) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:19.002013 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9cb9bc-1e11-44ba-9e7d-844b5b577ae2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:19.003984 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9cb9bc-1e11-44ba-9e7d-844b5b577ae2 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:19.017582 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 330/667] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:16:18 2021] GET /identity/v3/role_assignments?user.id=544443ed44ef41bcaa86af52926bfd14&scope.project.id=2955b3037801465c9eec5d78fe2e3ae9&role.id=e68dc60061bd41dc894e1be26b4d5027 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:19.018165 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ef3e1-71c3-4d0a-a461-bec903a35719 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:19.023211 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f10fbd-bd74-4d23-a927-cf334d92e707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:19.024176 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f10fbd-bd74-4d23-a927-cf334d92e707 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:19.026376 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f10fbd-bd74-4d23-a927-cf334d92e707 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:19.026376 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f10fbd-bd74-4d23-a927-cf334d92e707 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:19.026650 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cb9bc-1e11-44ba-9e7d-844b5b577ae2 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:19.036484 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f10fbd-bd74-4d23-a927-cf334d92e707 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:19.038660 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f10fbd-bd74-4d23-a927-cf334d92e707 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:19.050923 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cb9bc-1e11-44ba-9e7d-844b5b577ae2 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:19.052668 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 338/668] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:16:18 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:16:19.058741 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f10fbd-bd74-4d23-a927-cf334d92e707 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:19.069788 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439a385-a5ad-44ab-96b0-542b6c4cb02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:19.073245 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439a385-a5ad-44ab-96b0-542b6c4cb02d admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:19.074357 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f10fbd-bd74-4d23-a927-cf334d92e707 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:19.074596 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439a385-a5ad-44ab-96b0-542b6c4cb02d admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:19.086483 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439a385-a5ad-44ab-96b0-542b6c4cb02d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:19.088917 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa2851-98ca-4b81-bc99-bef39bdc586e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:19.089885 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa2851-98ca-4b81-bc99-bef39bdc586e admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:19.090171 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa2851-98ca-4b81-bc99-bef39bdc586e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:19.090448 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa2851-98ca-4b81-bc99-bef39bdc586e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:19.105354 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439a385-a5ad-44ab-96b0-542b6c4cb02d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:19.111605 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa2851-98ca-4b81-bc99-bef39bdc586e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:19.113771 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa2851-98ca-4b81-bc99-bef39bdc586e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:19.113893 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-6439a385-a5ad-44ab-96b0-542b6c4cb02d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 19:16:19.120641 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 331/669] 10.222.0.62 () {56 vars in 1123 bytes} [Tue Nov 23 19:16:19 2021] GET /identity/v3/roles/service => generated 85 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:19.122244 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439a385-a5ad-44ab-96b0-542b6c4cb02d admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:19.137435 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439a385-a5ad-44ab-96b0-542b6c4cb02d admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:19.139027 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708fc6de-ec1b-4120-b859-9a20d5f4ba03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:19.139973 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fc6de-ec1b-4120-b859-9a20d5f4ba03 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:19.140269 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fc6de-ec1b-4120-b859-9a20d5f4ba03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:19.140545 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fc6de-ec1b-4120-b859-9a20d5f4ba03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:19.141468 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708fc6de-ec1b-4120-b859-9a20d5f4ba03 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:19.141785 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708fc6de-ec1b-4120-b859-9a20d5f4ba03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:19.143463 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708fc6de-ec1b-4120-b859-9a20d5f4ba03 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:19.149023 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-08aa2851-98ca-4b81-bc99-bef39bdc586e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:19.150296 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 339/670] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:19.155060 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 332/671] 10.222.0.62 () {56 vars in 1124 bytes} [Tue Nov 23 19:16:19 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:19.161351 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa2851-98ca-4b81-bc99-bef39bdc586e admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:19.161626 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708fc6de-ec1b-4120-b859-9a20d5f4ba03 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:19.183042 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708fc6de-ec1b-4120-b859-9a20d5f4ba03 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:19.187801 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa2851-98ca-4b81-bc99-bef39bdc586e admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:19.193299 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e12d14-6f47-49e6-89c2-4fdb9c70bbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:19.194691 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e12d14-6f47-49e6-89c2-4fdb9c70bbcb admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:19.194976 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e12d14-6f47-49e6-89c2-4fdb9c70bbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:19.195253 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e12d14-6f47-49e6-89c2-4fdb9c70bbcb admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:19.195996 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e12d14-6f47-49e6-89c2-4fdb9c70bbcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:19.196571 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e12d14-6f47-49e6-89c2-4fdb9c70bbcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:19.196770 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4601c98-92d1-4e52-a211-5ed7c5bf5c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:19.197635 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4601c98-92d1-4e52-a211-5ed7c5bf5c5d admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:19.197915 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4601c98-92d1-4e52-a211-5ed7c5bf5c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:19.198182 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e12d14-6f47-49e6-89c2-4fdb9c70bbcb admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:19.198277 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4601c98-92d1-4e52-a211-5ed7c5bf5c5d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:19.211539 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 333/672] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:19.212601 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4601c98-92d1-4e52-a211-5ed7c5bf5c5d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:19.214555 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4601c98-92d1-4e52-a211-5ed7c5bf5c5d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:19.220500 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e12d14-6f47-49e6-89c2-4fdb9c70bbcb admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:19.236375 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e12d14-6f47-49e6-89c2-4fdb9c70bbcb admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:19.239331 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-c4601c98-92d1-4e52-a211-5ed7c5bf5c5d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:19.240808 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 340/673] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:19.246703 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4601c98-92d1-4e52-a211-5ed7c5bf5c5d admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:19.250584 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e28a3-7bbd-4682-8911-76e5517f8ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:19.251883 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e28a3-7bbd-4682-8911-76e5517f8ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:19.252389 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e28a3-7bbd-4682-8911-76e5517f8ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:19.252957 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e28a3-7bbd-4682-8911-76e5517f8ad5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:19.263876 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e28a3-7bbd-4682-8911-76e5517f8ad5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:19.265888 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e28a3-7bbd-4682-8911-76e5517f8ad5 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:19.268148 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4601c98-92d1-4e52-a211-5ed7c5bf5c5d admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:19.280538 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2698a-c3bd-453c-a26b-542d3524e47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:19.281215 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2698a-c3bd-453c-a26b-542d3524e47a admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:19.281536 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2698a-c3bd-453c-a26b-542d3524e47a admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:19.281808 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2698a-c3bd-453c-a26b-542d3524e47a admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:19.282567 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2698a-c3bd-453c-a26b-542d3524e47a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:19.282878 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2698a-c3bd-453c-a26b-542d3524e47a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:19.284523 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2698a-c3bd-453c-a26b-542d3524e47a admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:19.289628 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-be2e28a3-7bbd-4682-8911-76e5517f8ad5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:16:19.291640 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 334/674] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:19 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:19.300880 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e28a3-7bbd-4682-8911-76e5517f8ad5 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:19.305860 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 341/675] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:19.312572 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2698a-c3bd-453c-a26b-542d3524e47a admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:19.312942 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e28a3-7bbd-4682-8911-76e5517f8ad5 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:19.319333 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef34513-21f2-4e5e-a04c-98ffed71870d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:19.320319 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef34513-21f2-4e5e-a04c-98ffed71870d admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:19.320825 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef34513-21f2-4e5e-a04c-98ffed71870d admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:19.321627 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef34513-21f2-4e5e-a04c-98ffed71870d admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:19.322588 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef34513-21f2-4e5e-a04c-98ffed71870d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:19.323121 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef34513-21f2-4e5e-a04c-98ffed71870d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:19.324592 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2698a-c3bd-453c-a26b-542d3524e47a admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:19.325374 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef34513-21f2-4e5e-a04c-98ffed71870d admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:19.330335 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1f27e-36e7-4589-ace3-79175a21946c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:19.331303 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1f27e-36e7-4589-ace3-79175a21946c admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:19.331303 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1f27e-36e7-4589-ace3-79175a21946c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:19.331303 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1f27e-36e7-4589-ace3-79175a21946c admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:19.341570 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 335/676] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:16:19 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:19.342251 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1f27e-36e7-4589-ace3-79175a21946c admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:19.344318 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1f27e-36e7-4589-ace3-79175a21946c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:19.349026 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef34513-21f2-4e5e-a04c-98ffed71870d admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:19.361435 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-5ba1f27e-36e7-4589-ace3-79175a21946c admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 23 19:16:19.363061 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 342/677] 10.222.0.62 () {56 vars in 1123 bytes} [Tue Nov 23 19:16:19 2021] GET /identity/v3/users/neutron => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:19.367893 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef34513-21f2-4e5e-a04c-98ffed71870d admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:19.369373 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1f27e-36e7-4589-ace3-79175a21946c admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:19.374754 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b445de-43d2-4233-a313-6f0dcb0ebbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:19.375654 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b445de-43d2-4233-a313-6f0dcb0ebbe4 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:19.376141 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b445de-43d2-4233-a313-6f0dcb0ebbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:19.376616 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b445de-43d2-4233-a313-6f0dcb0ebbe4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:19.377764 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b445de-43d2-4233-a313-6f0dcb0ebbe4 admin admin] RBAC: Adding query filter params (role.id=e68dc60061bd41dc894e1be26b4d5027, scope.project.id=2955b3037801465c9eec5d78fe2e3ae9, user.id=6d91fe7f996b48b0bc28e1eadc4f8869) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:19.378285 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b445de-43d2-4233-a313-6f0dcb0ebbe4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:19.381234 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b445de-43d2-4233-a313-6f0dcb0ebbe4 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:19.381940 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1f27e-36e7-4589-ace3-79175a21946c admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:19.388205 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49aebe1-9fdd-4a00-8a01-b7ac96b1e7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:19.389668 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49aebe1-9fdd-4a00-8a01-b7ac96b1e7bd admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:19.389953 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49aebe1-9fdd-4a00-8a01-b7ac96b1e7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:19.390244 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49aebe1-9fdd-4a00-8a01-b7ac96b1e7bd admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:19.391185 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49aebe1-9fdd-4a00-8a01-b7ac96b1e7bd admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:19.391380 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49aebe1-9fdd-4a00-8a01-b7ac96b1e7bd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:19.391860 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 336/678] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:16:19 2021] GET /identity/v3/role_assignments?user.id=6d91fe7f996b48b0bc28e1eadc4f8869&scope.project.id=2955b3037801465c9eec5d78fe2e3ae9&role.id=e68dc60061bd41dc894e1be26b4d5027 => generated 608 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:19.393198 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49aebe1-9fdd-4a00-8a01-b7ac96b1e7bd admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:19.418815 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 343/679] 10.222.0.62 () {56 vars in 1160 bytes} [Tue Nov 23 19:16:19 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:19.425524 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b445de-43d2-4233-a313-6f0dcb0ebbe4 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:19.438888 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b445de-43d2-4233-a313-6f0dcb0ebbe4 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:19.448000 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85cde6-7e9e-4198-830a-4b683833fe6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:19.449627 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85cde6-7e9e-4198-830a-4b683833fe6b admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:19.449922 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85cde6-7e9e-4198-830a-4b683833fe6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:19.450089 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1933c8-975d-4093-8c05-96628d484d8d None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:19.450185 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85cde6-7e9e-4198-830a-4b683833fe6b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:19.450452 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1933c8-975d-4093-8c05-96628d484d8d None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:19.450727 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1933c8-975d-4093-8c05-96628d484d8d None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:19.454129 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 344/680] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:19 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 19:16:19.461322 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f6e30-a87c-4313-8fb0-4b88dab1af0c None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:19.461664 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f6e30-a87c-4313-8fb0-4b88dab1af0c None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:19.461830 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85cde6-7e9e-4198-830a-4b683833fe6b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:19.461927 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f6e30-a87c-4313-8fb0-4b88dab1af0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:19.463599 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85cde6-7e9e-4198-830a-4b683833fe6b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:19.477884 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 337/681] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:16:19 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:16:19.484674 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85cde6-7e9e-4198-830a-4b683833fe6b admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:19.489895 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-d84f6e30-a87c-4313-8fb0-4b88dab1af0c None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:19.491124 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-d84f6e30-a87c-4313-8fb0-4b88dab1af0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:19.494870 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85cde6-7e9e-4198-830a-4b683833fe6b admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:19.500637 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a12a4a-5f8a-4532-ba9b-d5a795756a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:19.501598 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a12a4a-5f8a-4532-ba9b-d5a795756a6b admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:19.502027 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a12a4a-5f8a-4532-ba9b-d5a795756a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:19.502274 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 345/682] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 19:16:19.502513 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a12a4a-5f8a-4532-ba9b-d5a795756a6b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:19.515972 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a12a4a-5f8a-4532-ba9b-d5a795756a6b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:19.518049 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a12a4a-5f8a-4532-ba9b-d5a795756a6b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:19.527251 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f6e30-a87c-4313-8fb0-4b88dab1af0c None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:19.537304 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-86a12a4a-5f8a-4532-ba9b-d5a795756a6b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:19.539015 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 338/683] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:19.541890 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f6e30-a87c-4313-8fb0-4b88dab1af0c None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:19.546433 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a12a4a-5f8a-4532-ba9b-d5a795756a6b admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:19.552323 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2dc32-7217-4387-b9ad-07f29535ac73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:19.553521 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2dc32-7217-4387-b9ad-07f29535ac73 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:19.554005 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2dc32-7217-4387-b9ad-07f29535ac73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:19.554538 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2dc32-7217-4387-b9ad-07f29535ac73 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:19.561910 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a12a4a-5f8a-4532-ba9b-d5a795756a6b admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:19.567642 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01802b-8f04-49b7-afe1-cbb920858435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:19.568315 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01802b-8f04-49b7-afe1-cbb920858435 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:19.568602 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01802b-8f04-49b7-afe1-cbb920858435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:19.569053 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01802b-8f04-49b7-afe1-cbb920858435 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:19.570387 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01802b-8f04-49b7-afe1-cbb920858435 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:19.570387 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01802b-8f04-49b7-afe1-cbb920858435 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:19.571751 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de2dc32-7217-4387-b9ad-07f29535ac73 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:19.572184 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01802b-8f04-49b7-afe1-cbb920858435 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:19.582010 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-8de2dc32-7217-4387-b9ad-07f29535ac73 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 19:16:19.583411 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 346/684] 10.222.0.62 () {56 vars in 1123 bytes} [Tue Nov 23 19:16:19 2021] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:19.588639 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 339/685] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:19.595422 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2dc32-7217-4387-b9ad-07f29535ac73 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:19.598849 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01802b-8f04-49b7-afe1-cbb920858435 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:19.607191 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2dc32-7217-4387-b9ad-07f29535ac73 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:19.612253 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0022cca-a256-47ba-bf0e-6e28bb22b1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:19.612927 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0022cca-a256-47ba-bf0e-6e28bb22b1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:19.613134 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01802b-8f04-49b7-afe1-cbb920858435 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:19.613236 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0022cca-a256-47ba-bf0e-6e28bb22b1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:19.613516 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0022cca-a256-47ba-bf0e-6e28bb22b1b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:19.614292 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0022cca-a256-47ba-bf0e-6e28bb22b1b7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:19.614604 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0022cca-a256-47ba-bf0e-6e28bb22b1b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:19.616541 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0022cca-a256-47ba-bf0e-6e28bb22b1b7 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:19.625710 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902bb445-8236-4f0a-96ad-817e5abba1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:19.626973 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bb445-8236-4f0a-96ad-817e5abba1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:19.632636 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 347/686] 10.222.0.62 () {56 vars in 1124 bytes} [Tue Nov 23 19:16:19 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:19.632823 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bb445-8236-4f0a-96ad-817e5abba1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:19.632823 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bb445-8236-4f0a-96ad-817e5abba1a1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:19.638301 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902bb445-8236-4f0a-96ad-817e5abba1a1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:19.641021 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0022cca-a256-47ba-bf0e-6e28bb22b1b7 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:19.644787 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902bb445-8236-4f0a-96ad-817e5abba1a1 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:19.651119 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0022cca-a256-47ba-bf0e-6e28bb22b1b7 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:19.656805 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f86ded-fa23-4c83-9190-8205d27ed7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:19.657642 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f86ded-fa23-4c83-9190-8205d27ed7ab admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:19.657926 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f86ded-fa23-4c83-9190-8205d27ed7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:19.658202 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f86ded-fa23-4c83-9190-8205d27ed7ab admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:19.666016 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-902bb445-8236-4f0a-96ad-817e5abba1a1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:16:19.667740 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 340/687] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:19 2021] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:19.672732 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f86ded-fa23-4c83-9190-8205d27ed7ab admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:19.674823 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f86ded-fa23-4c83-9190-8205d27ed7ab admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:19.675908 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902bb445-8236-4f0a-96ad-817e5abba1a1 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:19.688011 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902bb445-8236-4f0a-96ad-817e5abba1a1 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:19.694353 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8ee5f-1e24-4af5-99f4-ddd64f345122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:19.695302 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8ee5f-1e24-4af5-99f4-ddd64f345122 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:19.695783 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8ee5f-1e24-4af5-99f4-ddd64f345122 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:19.696568 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8ee5f-1e24-4af5-99f4-ddd64f345122 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:19.697651 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f8ee5f-1e24-4af5-99f4-ddd64f345122 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:19.698158 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f8ee5f-1e24-4af5-99f4-ddd64f345122 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:19.700215 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f8ee5f-1e24-4af5-99f4-ddd64f345122 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:19.702044 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-97f86ded-fa23-4c83-9190-8205d27ed7ab admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:19.703391 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 348/688] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:19.712761 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f86ded-fa23-4c83-9190-8205d27ed7ab admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:19.721106 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 341/689] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:16:19 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:19.728402 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8ee5f-1e24-4af5-99f4-ddd64f345122 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:19.730651 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f86ded-fa23-4c83-9190-8205d27ed7ab admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:19.738316 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4c5ec-bfca-459d-be3e-4d300b55b249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:19.738981 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4c5ec-bfca-459d-be3e-4d300b55b249 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:19.739265 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4c5ec-bfca-459d-be3e-4d300b55b249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:19.739539 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4c5ec-bfca-459d-be3e-4d300b55b249 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:19.740277 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4c5ec-bfca-459d-be3e-4d300b55b249 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:19.740581 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4c5ec-bfca-459d-be3e-4d300b55b249 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:19.741053 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8ee5f-1e24-4af5-99f4-ddd64f345122 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:19.743169 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4c5ec-bfca-459d-be3e-4d300b55b249 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:19.749917 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11194471-02d5-4305-b54f-6a808f468f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:19.750862 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11194471-02d5-4305-b54f-6a808f468f08 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:19.751414 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11194471-02d5-4305-b54f-6a808f468f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:19.751884 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11194471-02d5-4305-b54f-6a808f468f08 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:19.753603 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11194471-02d5-4305-b54f-6a808f468f08 admin admin] RBAC: Adding query filter params (role.id=e68dc60061bd41dc894e1be26b4d5027, scope.project.id=2955b3037801465c9eec5d78fe2e3ae9, user.id=f1ef2ac0a788451eb50fa80f559f808f) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:19.754165 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11194471-02d5-4305-b54f-6a808f468f08 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:19.757097 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11194471-02d5-4305-b54f-6a808f468f08 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:19.758297 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 349/690] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:19.765788 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4c5ec-bfca-459d-be3e-4d300b55b249 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:19.767852 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 342/691] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:16:19 2021] GET /identity/v3/role_assignments?user.id=f1ef2ac0a788451eb50fa80f559f808f&scope.project.id=2955b3037801465c9eec5d78fe2e3ae9&role.id=e68dc60061bd41dc894e1be26b4d5027 => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:19.782074 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4c5ec-bfca-459d-be3e-4d300b55b249 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:19.793171 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018cf4a-e9d5-4bbd-b469-fdc13223152f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:19.794445 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018cf4a-e9d5-4bbd-b469-fdc13223152f admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:19.795157 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018cf4a-e9d5-4bbd-b469-fdc13223152f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:19.795658 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018cf4a-e9d5-4bbd-b469-fdc13223152f admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:19.812368 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f018cf4a-e9d5-4bbd-b469-fdc13223152f admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:19.814969 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f018cf4a-e9d5-4bbd-b469-fdc13223152f admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:19.830722 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-f018cf4a-e9d5-4bbd-b469-fdc13223152f admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 23 19:16:19.832386 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 350/692] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:16:19 2021] GET /identity/v3/users/swift => generated 83 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:19.839007 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11194471-02d5-4305-b54f-6a808f468f08 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:19.850717 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11194471-02d5-4305-b54f-6a808f468f08 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:19.855782 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab36b1-41b9-406b-be9f-8ec959b21bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:19.856842 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab36b1-41b9-406b-be9f-8ec959b21bcb admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:19.857974 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab36b1-41b9-406b-be9f-8ec959b21bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:19.858533 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab36b1-41b9-406b-be9f-8ec959b21bcb admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:19.859707 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab36b1-41b9-406b-be9f-8ec959b21bcb admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:19.860246 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab36b1-41b9-406b-be9f-8ec959b21bcb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:19.862461 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab36b1-41b9-406b-be9f-8ec959b21bcb admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:19.883359 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 343/693] 10.222.0.62 () {56 vars in 1156 bytes} [Tue Nov 23 19:16:19 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:19.890964 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018cf4a-e9d5-4bbd-b469-fdc13223152f admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:19.901723 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018cf4a-e9d5-4bbd-b469-fdc13223152f admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:19.909356 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff76f5c-7e14-450f-b74a-dbdfe68f1bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:19.910629 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff76f5c-7e14-450f-b74a-dbdfe68f1bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:19.911109 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff76f5c-7e14-450f-b74a-dbdfe68f1bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:19.911632 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff76f5c-7e14-450f-b74a-dbdfe68f1bc9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:19.924671 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff76f5c-7e14-450f-b74a-dbdfe68f1bc9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:19.927037 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff76f5c-7e14-450f-b74a-dbdfe68f1bc9 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:19.945742 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-6ff76f5c-7e14-450f-b74a-dbdfe68f1bc9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:19.948065 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 351/694] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:19.955446 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab36b1-41b9-406b-be9f-8ec959b21bcb admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:19.966046 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab36b1-41b9-406b-be9f-8ec959b21bcb admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:19.971778 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e6367-30ab-4c3a-a5a6-ae2fdb388942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:19.972834 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e6367-30ab-4c3a-a5a6-ae2fdb388942 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:19.973342 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e6367-30ab-4c3a-a5a6-ae2fdb388942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:19.973857 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e6367-30ab-4c3a-a5a6-ae2fdb388942 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:19.974838 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e6367-30ab-4c3a-a5a6-ae2fdb388942 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:19.975363 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e6367-30ab-4c3a-a5a6-ae2fdb388942 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:19.977293 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e6367-30ab-4c3a-a5a6-ae2fdb388942 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:19.991307 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 344/695] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:19.997823 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff76f5c-7e14-450f-b74a-dbdfe68f1bc9 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:20.008149 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff76f5c-7e14-450f-b74a-dbdfe68f1bc9 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:20.014526 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3259167-b1a4-4ae0-b64c-3def88242019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:20.015633 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3259167-b1a4-4ae0-b64c-3def88242019 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:20.016138 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3259167-b1a4-4ae0-b64c-3def88242019 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:20.016607 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3259167-b1a4-4ae0-b64c-3def88242019 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:20.024184 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3259167-b1a4-4ae0-b64c-3def88242019 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:20.026412 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3259167-b1a4-4ae0-b64c-3def88242019 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:20.040763 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-c3259167-b1a4-4ae0-b64c-3def88242019 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:16:20.042310 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 352/696] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:19 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:20.049294 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e6367-30ab-4c3a-a5a6-ae2fdb388942 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:20.059348 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e6367-30ab-4c3a-a5a6-ae2fdb388942 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:20.064815 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95887ac6-cf67-46e9-a512-02e48ef3f369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:20.065773 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95887ac6-cf67-46e9-a512-02e48ef3f369 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:20.066258 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95887ac6-cf67-46e9-a512-02e48ef3f369 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:20.066778 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95887ac6-cf67-46e9-a512-02e48ef3f369 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:20.067776 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95887ac6-cf67-46e9-a512-02e48ef3f369 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:20.068349 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95887ac6-cf67-46e9-a512-02e48ef3f369 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:20.070479 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95887ac6-cf67-46e9-a512-02e48ef3f369 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:20.085271 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 345/697] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:16:20 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:20.092389 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3259167-b1a4-4ae0-b64c-3def88242019 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:20.102917 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3259167-b1a4-4ae0-b64c-3def88242019 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:20.108784 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94ddc9-6bc2-43b3-81ba-683a52510c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:20.109954 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94ddc9-6bc2-43b3-81ba-683a52510c64 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:20.110432 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94ddc9-6bc2-43b3-81ba-683a52510c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:20.110918 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94ddc9-6bc2-43b3-81ba-683a52510c64 admin admin] PATH_INFO: `/v3/projects/2955b3037801465c9eec5d78fe2e3ae9/users/87b6ed93587a4c87ad5002fc80b985c9/roles/e68dc60061bd41dc894e1be26b4d5027` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:20.126883 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af94ddc9-6bc2-43b3-81ba-683a52510c64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2955b3037801465c9eec5d78fe2e3ae9, user_id=87b6ed93587a4c87ad5002fc80b985c9, role_id=e68dc60061bd41dc894e1be26b4d5027)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:20.129813 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af94ddc9-6bc2-43b3-81ba-683a52510c64 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:20.214126 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 353/698] 10.222.0.62 () {58 vars in 1460 bytes} [Tue Nov 23 19:16:20 2021] PUT /identity/v3/projects/2955b3037801465c9eec5d78fe2e3ae9/users/87b6ed93587a4c87ad5002fc80b985c9/roles/e68dc60061bd41dc894e1be26b4d5027 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:16:21.887231 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b1f28-f002-4d82-8e99-48a4c62721d7 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:21.887815 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b1f28-f002-4d82-8e99-48a4c62721d7 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:21.887815 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b1f28-f002-4d82-8e99-48a4c62721d7 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:21.890724 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 346/699] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:21 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 19:16:21.897444 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac71ad-19cf-4528-8851-16bed3feed05 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:21.897981 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac71ad-19cf-4528-8851-16bed3feed05 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:21.897981 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac71ad-19cf-4528-8851-16bed3feed05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:21.922415 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-56ac71ad-19cf-4528-8851-16bed3feed05 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:21.923618 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-56ac71ad-19cf-4528-8851-16bed3feed05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:21.989060 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 354/700] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:16:22.025781 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b1f28-f002-4d82-8e99-48a4c62721d7 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:22.048113 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b1f28-f002-4d82-8e99-48a4c62721d7 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:22.055869 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65fcf17-f849-4831-8408-5b0c69e58859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:22.056743 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fcf17-f849-4831-8408-5b0c69e58859 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:22.056967 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fcf17-f849-4831-8408-5b0c69e58859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:22.057241 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fcf17-f849-4831-8408-5b0c69e58859 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:22.057962 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65fcf17-f849-4831-8408-5b0c69e58859 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:22.058962 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING py.warnings [None req-e65fcf17-f849-4831-8408-5b0c69e58859 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:16:22.058962 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: warnings.warn(msg) Nov 23 19:16:22.058962 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: Nov 23 19:16:22.059848 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65fcf17-f849-4831-8408-5b0c69e58859 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:22.074234 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae5c60-a42b-454e-b630-c25cbfae9476 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:22.074521 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae5c60-a42b-454e-b630-c25cbfae9476 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:22.074799 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae5c60-a42b-454e-b630-c25cbfae9476 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:22.076957 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 355/701] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:22.080076 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-e65fcf17-f849-4831-8408-5b0c69e58859 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 23 19:16:22.081629 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 347/702] 10.222.0.62 () {56 vars in 1150 bytes} [Tue Nov 23 19:16:22 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:22.082395 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232339e-4dc6-4d04-b5f5-5f1f0e5c084c None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:22.082683 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232339e-4dc6-4d04-b5f5-5f1f0e5c084c None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:22.082962 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232339e-4dc6-4d04-b5f5-5f1f0e5c084c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:22.088031 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65fcf17-f849-4831-8408-5b0c69e58859 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:22.105920 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65fcf17-f849-4831-8408-5b0c69e58859 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:22.115443 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d414e7-7002-4560-9197-6daefedb6e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:22.116094 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d414e7-7002-4560-9197-6daefedb6e59 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:22.116376 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d414e7-7002-4560-9197-6daefedb6e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:22.116650 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d414e7-7002-4560-9197-6daefedb6e59 admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:22.117366 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d414e7-7002-4560-9197-6daefedb6e59 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:22.117703 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d414e7-7002-4560-9197-6daefedb6e59 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:22.118701 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING py.warnings [None req-87d414e7-7002-4560-9197-6daefedb6e59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:16:22.118701 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: warnings.warn(msg) Nov 23 19:16:22.118701 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: Nov 23 19:16:22.119579 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d414e7-7002-4560-9197-6daefedb6e59 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:22.121438 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-0232339e-4dc6-4d04-b5f5-5f1f0e5c084c None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:22.122624 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-0232339e-4dc6-4d04-b5f5-5f1f0e5c084c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:22.128739 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 348/703] 10.222.0.62 () {56 vars in 1145 bytes} [Tue Nov 23 19:16:22 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:22.134819 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d414e7-7002-4560-9197-6daefedb6e59 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:22.144752 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 356/704] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:22 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:16:22.152860 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d414e7-7002-4560-9197-6daefedb6e59 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:22.161435 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fe652-744f-4cb5-b572-ac5888071285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:22.162097 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fe652-744f-4cb5-b572-ac5888071285 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:22.162379 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fe652-744f-4cb5-b572-ac5888071285 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:22.162652 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fe652-744f-4cb5-b572-ac5888071285 admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:22.163368 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fe652-744f-4cb5-b572-ac5888071285 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:22.163675 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fe652-744f-4cb5-b572-ac5888071285 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:22.165233 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fe652-744f-4cb5-b572-ac5888071285 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:22.172318 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232339e-4dc6-4d04-b5f5-5f1f0e5c084c None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:22.175837 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 349/705] 10.222.0.62 () {56 vars in 1145 bytes} [Tue Nov 23 19:16:22 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:22.190079 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232339e-4dc6-4d04-b5f5-5f1f0e5c084c None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:22.202311 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec63c0-3070-48d4-b00d-eebe50d5e5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:22.203331 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec63c0-3070-48d4-b00d-eebe50d5e5b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:22.203702 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec63c0-3070-48d4-b00d-eebe50d5e5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:22.204066 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec63c0-3070-48d4-b00d-eebe50d5e5b5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:22.216930 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec63c0-3070-48d4-b00d-eebe50d5e5b5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:22.219081 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec63c0-3070-48d4-b00d-eebe50d5e5b5 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:22.244339 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-6fec63c0-3070-48d4-b00d-eebe50d5e5b5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:22.245868 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 357/706] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:22.252379 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fe652-744f-4cb5-b572-ac5888071285 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:22.276205 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fe652-744f-4cb5-b572-ac5888071285 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:22.290287 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794e219-bcf6-4e4b-93ea-6a7250e2d12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:22.290986 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794e219-bcf6-4e4b-93ea-6a7250e2d12b admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:22.291268 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794e219-bcf6-4e4b-93ea-6a7250e2d12b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:22.291550 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794e219-bcf6-4e4b-93ea-6a7250e2d12b admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:22.292299 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794e219-bcf6-4e4b-93ea-6a7250e2d12b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:22.292606 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794e219-bcf6-4e4b-93ea-6a7250e2d12b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:22.294238 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794e219-bcf6-4e4b-93ea-6a7250e2d12b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:22.336742 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 350/707] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:22.354512 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec63c0-3070-48d4-b00d-eebe50d5e5b5 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:22.381126 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec63c0-3070-48d4-b00d-eebe50d5e5b5 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:22.402142 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ce399-a549-4422-88c7-d684e2f4a850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:22.403111 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ce399-a549-4422-88c7-d684e2f4a850 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:22.403544 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ce399-a549-4422-88c7-d684e2f4a850 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:22.403962 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ce399-a549-4422-88c7-d684e2f4a850 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:22.405656 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ce399-a549-4422-88c7-d684e2f4a850 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:22.407758 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ce399-a549-4422-88c7-d684e2f4a850 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:22.536264 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 358/708] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Nov 23 19:16:22 2021] POST /identity/v3/users => generated 254 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:16:22.726961 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37abbb-d278-4b94-b424-448b204676e1 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:22.727251 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37abbb-d278-4b94-b424-448b204676e1 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:22.727529 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37abbb-d278-4b94-b424-448b204676e1 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:22.729724 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 351/709] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:22.737822 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48551e38-32aa-4218-8fc7-abc1907bbb22 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:22.738112 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48551e38-32aa-4218-8fc7-abc1907bbb22 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:22.738389 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48551e38-32aa-4218-8fc7-abc1907bbb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:22.759440 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-48551e38-32aa-4218-8fc7-abc1907bbb22 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:22.760638 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-48551e38-32aa-4218-8fc7-abc1907bbb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:22.769356 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 359/710] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:22 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 23 19:16:22.794467 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37abbb-d278-4b94-b424-448b204676e1 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:22.810901 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37abbb-d278-4b94-b424-448b204676e1 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:22.816359 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2588e16-c96d-4207-9426-feb4877dff3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:22.817680 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2588e16-c96d-4207-9426-feb4877dff3d admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:22.818160 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2588e16-c96d-4207-9426-feb4877dff3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:22.818575 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2588e16-c96d-4207-9426-feb4877dff3d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:22.832047 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2588e16-c96d-4207-9426-feb4877dff3d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:22.839550 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-b2588e16-c96d-4207-9426-feb4877dff3d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 19:16:22.840978 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 352/711] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:16:22 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:22.848800 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48551e38-32aa-4218-8fc7-abc1907bbb22 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:22.859773 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48551e38-32aa-4218-8fc7-abc1907bbb22 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:22.864720 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13edbf6-693b-4569-afc0-d4a416749f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:22.865644 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13edbf6-693b-4569-afc0-d4a416749f34 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:22.866085 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13edbf6-693b-4569-afc0-d4a416749f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:22.866512 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13edbf6-693b-4569-afc0-d4a416749f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:22.867495 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13edbf6-693b-4569-afc0-d4a416749f34 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:22.867971 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13edbf6-693b-4569-afc0-d4a416749f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:22.869858 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13edbf6-693b-4569-afc0-d4a416749f34 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:22.880406 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 360/712] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:16:22 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:22.887110 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2588e16-c96d-4207-9426-feb4877dff3d admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:22.899432 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2588e16-c96d-4207-9426-feb4877dff3d admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:22.905586 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d879c3-633e-4f15-9459-8e9313acb9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:22.906653 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d879c3-633e-4f15-9459-8e9313acb9db admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:22.907080 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d879c3-633e-4f15-9459-8e9313acb9db admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:22.907508 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d879c3-633e-4f15-9459-8e9313acb9db admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:22.918672 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d879c3-633e-4f15-9459-8e9313acb9db admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:22.922029 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d879c3-633e-4f15-9459-8e9313acb9db admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:22.941107 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-f3d879c3-633e-4f15-9459-8e9313acb9db admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:22.942888 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 353/713] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:22.949377 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13edbf6-693b-4569-afc0-d4a416749f34 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:22.960444 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13edbf6-693b-4569-afc0-d4a416749f34 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:22.965295 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15aaca-9f21-40a7-9553-7b73e88ab5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:22.966184 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15aaca-9f21-40a7-9553-7b73e88ab5af admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:22.966696 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15aaca-9f21-40a7-9553-7b73e88ab5af admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:22.967717 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15aaca-9f21-40a7-9553-7b73e88ab5af admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:22.968657 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b15aaca-9f21-40a7-9553-7b73e88ab5af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:22.969116 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b15aaca-9f21-40a7-9553-7b73e88ab5af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:22.970967 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b15aaca-9f21-40a7-9553-7b73e88ab5af admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:22.985126 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 361/714] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:22.991280 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d879c3-633e-4f15-9459-8e9313acb9db admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:23.002763 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d879c3-633e-4f15-9459-8e9313acb9db admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:23.007458 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777b9ff-6c1f-4896-a387-3fb9f3b07d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:23.008295 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777b9ff-6c1f-4896-a387-3fb9f3b07d11 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:23.008570 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777b9ff-6c1f-4896-a387-3fb9f3b07d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:23.008889 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777b9ff-6c1f-4896-a387-3fb9f3b07d11 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:23.018223 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777b9ff-6c1f-4896-a387-3fb9f3b07d11 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:23.020324 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777b9ff-6c1f-4896-a387-3fb9f3b07d11 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:23.034570 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-f777b9ff-6c1f-4896-a387-3fb9f3b07d11 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 23 19:16:23.036191 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 354/715] 10.222.0.62 () {56 vars in 1114 bytes} [Tue Nov 23 19:16:22 2021] GET /identity/v3/users/nova => generated 82 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:23.042656 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15aaca-9f21-40a7-9553-7b73e88ab5af admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:23.054491 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15aaca-9f21-40a7-9553-7b73e88ab5af admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:23.059423 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732d604-ef0a-4f4b-904b-6bd6368fa0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:23.060112 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732d604-ef0a-4f4b-904b-6bd6368fa0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:23.061084 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732d604-ef0a-4f4b-904b-6bd6368fa0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:23.061364 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732d604-ef0a-4f4b-904b-6bd6368fa0a4 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:23.062295 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732d604-ef0a-4f4b-904b-6bd6368fa0a4 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:23.062604 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732d604-ef0a-4f4b-904b-6bd6368fa0a4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:23.064541 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732d604-ef0a-4f4b-904b-6bd6368fa0a4 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:23.084376 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 362/716] 10.222.0.62 () {56 vars in 1154 bytes} [Tue Nov 23 19:16:23 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:23.090501 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777b9ff-6c1f-4896-a387-3fb9f3b07d11 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:23.100634 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777b9ff-6c1f-4896-a387-3fb9f3b07d11 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:23.105249 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5d795-7d0a-4157-a6a2-b74ab1f47fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:23.106016 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5d795-7d0a-4157-a6a2-b74ab1f47fda admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:23.106294 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5d795-7d0a-4157-a6a2-b74ab1f47fda admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:23.106566 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5d795-7d0a-4157-a6a2-b74ab1f47fda admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:23.116400 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5d795-7d0a-4157-a6a2-b74ab1f47fda admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:23.118208 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5d795-7d0a-4157-a6a2-b74ab1f47fda admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:23.128260 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 355/717] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:16:23 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:16:23.134183 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732d604-ef0a-4f4b-904b-6bd6368fa0a4 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:23.144020 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732d604-ef0a-4f4b-904b-6bd6368fa0a4 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:23.148676 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2cf784-e8b6-4dd5-a4d5-d0a7cc73fdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:23.149577 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cf784-e8b6-4dd5-a4d5-d0a7cc73fdf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:23.149862 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cf784-e8b6-4dd5-a4d5-d0a7cc73fdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:23.150129 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cf784-e8b6-4dd5-a4d5-d0a7cc73fdf7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:23.162254 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2cf784-e8b6-4dd5-a4d5-d0a7cc73fdf7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:23.164293 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2cf784-e8b6-4dd5-a4d5-d0a7cc73fdf7 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:23.183905 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-5a2cf784-e8b6-4dd5-a4d5-d0a7cc73fdf7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:23.186205 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 363/718] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:23.192589 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5d795-7d0a-4157-a6a2-b74ab1f47fda admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:23.202651 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5d795-7d0a-4157-a6a2-b74ab1f47fda admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:23.208507 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769db08f-dcee-4032-8e32-932da97bb4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:23.209170 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769db08f-dcee-4032-8e32-932da97bb4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:23.209536 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769db08f-dcee-4032-8e32-932da97bb4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:23.209813 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769db08f-dcee-4032-8e32-932da97bb4c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:23.210601 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769db08f-dcee-4032-8e32-932da97bb4c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:23.210905 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769db08f-dcee-4032-8e32-932da97bb4c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:23.212503 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769db08f-dcee-4032-8e32-932da97bb4c7 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:23.225788 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 356/719] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:23.230619 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d912c-66be-454a-b0af-bf3b0297c68f None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:23.230907 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d912c-66be-454a-b0af-bf3b0297c68f None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:23.231183 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d912c-66be-454a-b0af-bf3b0297c68f None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:23.231402 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769db08f-dcee-4032-8e32-932da97bb4c7 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:23.233781 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 364/720] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:23.239451 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89d53a-dda9-456f-9658-c3d9493e3579 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:23.239682 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89d53a-dda9-456f-9658-c3d9493e3579 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:23.239943 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89d53a-dda9-456f-9658-c3d9493e3579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:23.241984 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769db08f-dcee-4032-8e32-932da97bb4c7 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:23.248757 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269df3ea-c16a-4fe0-8e49-d4e8f941cb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:23.249634 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269df3ea-c16a-4fe0-8e49-d4e8f941cb63 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:23.249911 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269df3ea-c16a-4fe0-8e49-d4e8f941cb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:23.250178 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269df3ea-c16a-4fe0-8e49-d4e8f941cb63 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:23.258134 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269df3ea-c16a-4fe0-8e49-d4e8f941cb63 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:23.260054 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269df3ea-c16a-4fe0-8e49-d4e8f941cb63 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:23.264112 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-be89d53a-dda9-456f-9658-c3d9493e3579 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:23.265298 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-be89d53a-dda9-456f-9658-c3d9493e3579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:23.276810 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-269df3ea-c16a-4fe0-8e49-d4e8f941cb63 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:16:23.278027 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 357/721] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:23.278973 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 365/722] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 19:16:23.284469 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269df3ea-c16a-4fe0-8e49-d4e8f941cb63 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:23.295899 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269df3ea-c16a-4fe0-8e49-d4e8f941cb63 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:23.300455 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b273aa-cb84-4951-a034-735a7ac68a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:23.301093 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b273aa-cb84-4951-a034-735a7ac68a21 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:23.301369 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b273aa-cb84-4951-a034-735a7ac68a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:23.301668 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b273aa-cb84-4951-a034-735a7ac68a21 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:23.302459 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b273aa-cb84-4951-a034-735a7ac68a21 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:23.302763 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b273aa-cb84-4951-a034-735a7ac68a21 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:23.304556 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b273aa-cb84-4951-a034-735a7ac68a21 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:23.307381 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89d53a-dda9-456f-9658-c3d9493e3579 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:23.317546 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 358/723] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:16:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:23.319086 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be89d53a-dda9-456f-9658-c3d9493e3579 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:23.323926 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b273aa-cb84-4951-a034-735a7ac68a21 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:23.325578 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66db411-42b3-45a7-b232-67009ad3d137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:23.326845 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66db411-42b3-45a7-b232-67009ad3d137 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:23.327345 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66db411-42b3-45a7-b232-67009ad3d137 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:23.327821 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66db411-42b3-45a7-b232-67009ad3d137 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:23.328867 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66db411-42b3-45a7-b232-67009ad3d137 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:23.331887 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING py.warnings [None req-c66db411-42b3-45a7-b232-67009ad3d137 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:16:23.331887 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: warnings.warn(msg) Nov 23 19:16:23.331887 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: Nov 23 19:16:23.333218 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b273aa-cb84-4951-a034-735a7ac68a21 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:23.333536 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66db411-42b3-45a7-b232-67009ad3d137 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:23.338218 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c6ce0-3cea-409f-9363-a4230949a4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:23.338852 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c6ce0-3cea-409f-9363-a4230949a4c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:23.339129 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c6ce0-3cea-409f-9363-a4230949a4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:23.339549 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c6ce0-3cea-409f-9363-a4230949a4c5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:23.340533 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c6ce0-3cea-409f-9363-a4230949a4c5 admin admin] RBAC: Adding query filter params (role.id=6d9a8878ffeb49fea19d854657c6b767, scope.project.id=2955b3037801465c9eec5d78fe2e3ae9, user.id=6d91fe7f996b48b0bc28e1eadc4f8869) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:23.340839 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c6ce0-3cea-409f-9363-a4230949a4c5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:23.343334 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371c6ce0-3cea-409f-9363-a4230949a4c5 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:23.349204 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 359/724] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:16:23 2021] GET /identity/v3/role_assignments?user.id=6d91fe7f996b48b0bc28e1eadc4f8869&scope.project.id=2955b3037801465c9eec5d78fe2e3ae9&role.id=6d9a8878ffeb49fea19d854657c6b767 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:23.356329 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-c66db411-42b3-45a7-b232-67009ad3d137 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 23 19:16:23.358686 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 366/725] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:23 2021] GET /identity/v3/services/network => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:23.365394 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c6ce0-3cea-409f-9363-a4230949a4c5 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:23.379635 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c6ce0-3cea-409f-9363-a4230949a4c5 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:23.384978 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b121b36-6d25-4e8e-8a16-377de261406d None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:23.385607 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b121b36-6d25-4e8e-8a16-377de261406d None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:23.386145 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b121b36-6d25-4e8e-8a16-377de261406d None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:23.389299 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 367/726] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 19:16:23.390591 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c1764-a346-4a9d-afb1-f9496c878b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:23.391249 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c1764-a346-4a9d-afb1-f9496c878b92 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:23.391529 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c1764-a346-4a9d-afb1-f9496c878b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:23.391801 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c1764-a346-4a9d-afb1-f9496c878b92 admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:23.392526 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230c1764-a346-4a9d-afb1-f9496c878b92 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:23.392832 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230c1764-a346-4a9d-afb1-f9496c878b92 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:23.396666 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230c1764-a346-4a9d-afb1-f9496c878b92 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:23.401827 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eec9b-db57-49c5-93f5-d45c9c1f72ad None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:23.402493 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eec9b-db57-49c5-93f5-d45c9c1f72ad None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:23.402978 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eec9b-db57-49c5-93f5-d45c9c1f72ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:23.405317 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 360/727] 10.222.0.62 () {56 vars in 1133 bytes} [Tue Nov 23 19:16:23 2021] GET /identity/v3/services?name=network => generated 124 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:23.411488 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c1764-a346-4a9d-afb1-f9496c878b92 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:23.426553 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c1764-a346-4a9d-afb1-f9496c878b92 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:23.434073 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-ba3eec9b-db57-49c5-93f5-d45c9c1f72ad None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:23.437571 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-ba3eec9b-db57-49c5-93f5-d45c9c1f72ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:23.440922 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32012ab2-cd91-4bcc-b463-a7fc7c64b617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:23.442214 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32012ab2-cd91-4bcc-b463-a7fc7c64b617 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:23.443118 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32012ab2-cd91-4bcc-b463-a7fc7c64b617 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:23.443815 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32012ab2-cd91-4bcc-b463-a7fc7c64b617 admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:23.446190 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32012ab2-cd91-4bcc-b463-a7fc7c64b617 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:23.447619 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32012ab2-cd91-4bcc-b463-a7fc7c64b617 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:23.451745 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32012ab2-cd91-4bcc-b463-a7fc7c64b617 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:23.458001 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 368/728] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 19:16:23.461143 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 361/729] 10.222.0.62 () {56 vars in 1133 bytes} [Tue Nov 23 19:16:23 2021] GET /identity/v3/services?type=network => generated 124 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:23.488124 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3eec9b-db57-49c5-93f5-d45c9c1f72ad None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:23.498590 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3eec9b-db57-49c5-93f5-d45c9c1f72ad None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:23.506954 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7259bd9-d024-4b78-a5a0-74ea71834190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:23.508183 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7259bd9-d024-4b78-a5a0-74ea71834190 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:23.508697 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7259bd9-d024-4b78-a5a0-74ea71834190 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:23.509227 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7259bd9-d024-4b78-a5a0-74ea71834190 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:23.524805 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7259bd9-d024-4b78-a5a0-74ea71834190 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:23.533398 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-f7259bd9-d024-4b78-a5a0-74ea71834190 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 19:16:23.535089 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 369/730] 10.222.0.62 () {56 vars in 1123 bytes} [Tue Nov 23 19:16:23 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:23.541457 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32012ab2-cd91-4bcc-b463-a7fc7c64b617 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:23.552423 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32012ab2-cd91-4bcc-b463-a7fc7c64b617 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:23.562154 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e479566-c874-4fb7-a5d3-40463463ea55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:23.563263 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e479566-c874-4fb7-a5d3-40463463ea55 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:23.563817 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e479566-c874-4fb7-a5d3-40463463ea55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:23.564310 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e479566-c874-4fb7-a5d3-40463463ea55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:23.565461 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e479566-c874-4fb7-a5d3-40463463ea55 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:23.566012 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e479566-c874-4fb7-a5d3-40463463ea55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:23.567922 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e479566-c874-4fb7-a5d3-40463463ea55 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:23.582701 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 362/731] 10.222.0.62 () {56 vars in 1124 bytes} [Tue Nov 23 19:16:23 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:23.589040 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7259bd9-d024-4b78-a5a0-74ea71834190 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:23.601897 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7259bd9-d024-4b78-a5a0-74ea71834190 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:23.611396 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8ad4f-9aec-48d8-9922-c52666019b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:23.612628 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8ad4f-9aec-48d8-9922-c52666019b33 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:23.613118 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8ad4f-9aec-48d8-9922-c52666019b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:23.613665 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8ad4f-9aec-48d8-9922-c52666019b33 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:23.628693 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe8ad4f-9aec-48d8-9922-c52666019b33 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:23.631077 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe8ad4f-9aec-48d8-9922-c52666019b33 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:23.656718 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-3fe8ad4f-9aec-48d8-9922-c52666019b33 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:23.658016 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 370/732] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:23.664245 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e479566-c874-4fb7-a5d3-40463463ea55 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:23.677570 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e479566-c874-4fb7-a5d3-40463463ea55 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:23.689123 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78778089-7754-4632-bee5-6d2e786aea6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:23.690252 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78778089-7754-4632-bee5-6d2e786aea6a admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:23.690742 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78778089-7754-4632-bee5-6d2e786aea6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:23.691299 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78778089-7754-4632-bee5-6d2e786aea6a admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:23.692251 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78778089-7754-4632-bee5-6d2e786aea6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:23.692930 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78778089-7754-4632-bee5-6d2e786aea6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:23.694841 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78778089-7754-4632-bee5-6d2e786aea6a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:23.714294 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 363/733] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:23.720505 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8ad4f-9aec-48d8-9922-c52666019b33 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:23.731508 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8ad4f-9aec-48d8-9922-c52666019b33 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:23.737590 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e836b7-ca9f-4a9e-80ab-8360c9bc56ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:23.738781 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e836b7-ca9f-4a9e-80ab-8360c9bc56ff admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:23.739305 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e836b7-ca9f-4a9e-80ab-8360c9bc56ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:23.739778 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e836b7-ca9f-4a9e-80ab-8360c9bc56ff admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:23.749476 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e836b7-ca9f-4a9e-80ab-8360c9bc56ff admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:23.751997 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e836b7-ca9f-4a9e-80ab-8360c9bc56ff admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:23.767644 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-38e836b7-ca9f-4a9e-80ab-8360c9bc56ff admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 23 19:16:23.769640 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 371/734] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:16:23 2021] GET /identity/v3/users/swift => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:23.777997 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78778089-7754-4632-bee5-6d2e786aea6a admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:23.789480 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78778089-7754-4632-bee5-6d2e786aea6a admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:23.798131 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f3470-ba9f-4c98-a4db-5456522b101b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:23.799086 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f3470-ba9f-4c98-a4db-5456522b101b admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:23.799584 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f3470-ba9f-4c98-a4db-5456522b101b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:23.800081 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f3470-ba9f-4c98-a4db-5456522b101b admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:23.801129 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f3470-ba9f-4c98-a4db-5456522b101b admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:23.801710 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f3470-ba9f-4c98-a4db-5456522b101b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:23.803738 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f3470-ba9f-4c98-a4db-5456522b101b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:23.824993 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 364/735] 10.222.0.62 () {56 vars in 1156 bytes} [Tue Nov 23 19:16:23 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:23.831937 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e836b7-ca9f-4a9e-80ab-8360c9bc56ff admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:23.846723 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e836b7-ca9f-4a9e-80ab-8360c9bc56ff admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:23.853882 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df416f9-64c5-4548-a7f6-334a7eb1f384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:23.854669 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df416f9-64c5-4548-a7f6-334a7eb1f384 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:23.855054 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df416f9-64c5-4548-a7f6-334a7eb1f384 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:23.855440 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df416f9-64c5-4548-a7f6-334a7eb1f384 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:23.869563 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df416f9-64c5-4548-a7f6-334a7eb1f384 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:23.871447 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df416f9-64c5-4548-a7f6-334a7eb1f384 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:23.885618 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 372/736] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:16:23 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:16:23.893088 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f3470-ba9f-4c98-a4db-5456522b101b admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:23.906597 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f3470-ba9f-4c98-a4db-5456522b101b admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:23.917677 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65427608-0bd0-4d00-a7c4-ae637b984ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:23.918614 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65427608-0bd0-4d00-a7c4-ae637b984ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:23.919004 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65427608-0bd0-4d00-a7c4-ae637b984ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:23.919385 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65427608-0bd0-4d00-a7c4-ae637b984ee6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:23.936800 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65427608-0bd0-4d00-a7c4-ae637b984ee6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:23.938804 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65427608-0bd0-4d00-a7c4-ae637b984ee6 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:23.967856 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-65427608-0bd0-4d00-a7c4-ae637b984ee6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:23.969635 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 365/737] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:23.975705 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df416f9-64c5-4548-a7f6-334a7eb1f384 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:23.985834 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df416f9-64c5-4548-a7f6-334a7eb1f384 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:23.993681 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5c1c6-1d24-461c-9d29-5c6ba4e8d69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:23.994462 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5c1c6-1d24-461c-9d29-5c6ba4e8d69a admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:23.994803 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5c1c6-1d24-461c-9d29-5c6ba4e8d69a admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:24.005489 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5c1c6-1d24-461c-9d29-5c6ba4e8d69a admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:24.005489 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5c1c6-1d24-461c-9d29-5c6ba4e8d69a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:24.005489 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5c1c6-1d24-461c-9d29-5c6ba4e8d69a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:24.005489 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5c1c6-1d24-461c-9d29-5c6ba4e8d69a admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:24.014765 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 373/738] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:24.020860 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65427608-0bd0-4d00-a7c4-ae637b984ee6 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:24.031453 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65427608-0bd0-4d00-a7c4-ae637b984ee6 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:24.041982 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca5080-09cd-4b05-b72f-6bebd77797f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:24.042910 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca5080-09cd-4b05-b72f-6bebd77797f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:24.043333 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca5080-09cd-4b05-b72f-6bebd77797f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:24.043712 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca5080-09cd-4b05-b72f-6bebd77797f5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:24.055946 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca5080-09cd-4b05-b72f-6bebd77797f5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:24.058049 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca5080-09cd-4b05-b72f-6bebd77797f5 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:24.081745 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-b6ca5080-09cd-4b05-b72f-6bebd77797f5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:16:24.083268 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 366/739] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:24 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:24.089776 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5c1c6-1d24-461c-9d29-5c6ba4e8d69a admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:24.111808 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5c1c6-1d24-461c-9d29-5c6ba4e8d69a admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:24.126070 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55278f-a8dc-4583-9e89-b2b6a18264a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:24.126734 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55278f-a8dc-4583-9e89-b2b6a18264a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:24.127014 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55278f-a8dc-4583-9e89-b2b6a18264a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:24.127281 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55278f-a8dc-4583-9e89-b2b6a18264a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:24.128080 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb55278f-a8dc-4583-9e89-b2b6a18264a6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:24.128380 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb55278f-a8dc-4583-9e89-b2b6a18264a6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:24.130252 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb55278f-a8dc-4583-9e89-b2b6a18264a6 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:24.146210 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 374/740] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:16:24 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:24.152702 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca5080-09cd-4b05-b72f-6bebd77797f5 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:24.163786 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca5080-09cd-4b05-b72f-6bebd77797f5 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:24.174162 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e1598-8219-4094-a95a-f656ab29969a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:24.174914 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e1598-8219-4094-a95a-f656ab29969a admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:24.175307 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e1598-8219-4094-a95a-f656ab29969a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:24.175688 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e1598-8219-4094-a95a-f656ab29969a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:24.176633 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e1598-8219-4094-a95a-f656ab29969a admin admin] RBAC: Adding query filter params (role.id=e68dc60061bd41dc894e1be26b4d5027, scope.project.id=2955b3037801465c9eec5d78fe2e3ae9, user.id=87b6ed93587a4c87ad5002fc80b985c9) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:24.177067 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e1598-8219-4094-a95a-f656ab29969a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:24.178998 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e1598-8219-4094-a95a-f656ab29969a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:24.185206 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 367/741] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:16:24 2021] GET /identity/v3/role_assignments?user.id=87b6ed93587a4c87ad5002fc80b985c9&scope.project.id=2955b3037801465c9eec5d78fe2e3ae9&role.id=e68dc60061bd41dc894e1be26b4d5027 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:25.220796 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e95236-e332-4712-acb4-57799084897d None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:25.221536 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e95236-e332-4712-acb4-57799084897d None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:25.221536 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e95236-e332-4712-acb4-57799084897d None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:25.223944 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 375/742] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:25.230686 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8d393-2917-4260-b3ef-3539c9245efe None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:25.231236 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8d393-2917-4260-b3ef-3539c9245efe None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:25.231236 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8d393-2917-4260-b3ef-3539c9245efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:25.253440 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-1db8d393-2917-4260-b3ef-3539c9245efe None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:25.254653 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-1db8d393-2917-4260-b3ef-3539c9245efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:25.268436 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 368/743] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:25 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 23 19:16:25.304889 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e95236-e332-4712-acb4-57799084897d None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:25.323048 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e95236-e332-4712-acb4-57799084897d None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:25.330501 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e881b-b5c6-45dc-afcc-f3179ac7fa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:25.331159 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e881b-b5c6-45dc-afcc-f3179ac7fa1d admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:25.331438 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e881b-b5c6-45dc-afcc-f3179ac7fa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:25.331713 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e881b-b5c6-45dc-afcc-f3179ac7fa1d admin admin] PATH_INFO: `/v3/services` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:25.332451 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e881b-b5c6-45dc-afcc-f3179ac7fa1d admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:25.333474 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING py.warnings [None req-714e881b-b5c6-45dc-afcc-f3179ac7fa1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:16:25.333474 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: warnings.warn(msg) Nov 23 19:16:25.333474 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: Nov 23 19:16:25.334330 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e881b-b5c6-45dc-afcc-f3179ac7fa1d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:25.449937 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 376/744] 10.222.0.62 () {60 vars in 1162 bytes} [Tue Nov 23 19:16:25 2021] POST /identity/v3/services => generated 251 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:16:25.714823 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19735d-3e3d-40b0-aa3e-3bcebd9b2ac6 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:25.715208 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19735d-3e3d-40b0-aa3e-3bcebd9b2ac6 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:25.715386 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19735d-3e3d-40b0-aa3e-3bcebd9b2ac6 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:25.718113 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 369/745] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:25.723958 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc4c20-3a42-4a6a-b10b-4019ee46eda7 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:25.724262 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc4c20-3a42-4a6a-b10b-4019ee46eda7 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:25.724508 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc4c20-3a42-4a6a-b10b-4019ee46eda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:25.750448 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-9cbc4c20-3a42-4a6a-b10b-4019ee46eda7 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:25.751671 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-9cbc4c20-3a42-4a6a-b10b-4019ee46eda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:25.775439 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 377/746] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:25 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:16:25.801252 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19735d-3e3d-40b0-aa3e-3bcebd9b2ac6 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:25.816673 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19735d-3e3d-40b0-aa3e-3bcebd9b2ac6 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:25.821209 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639aff0a-eb03-42b5-8133-ab145450d163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:25.822412 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639aff0a-eb03-42b5-8133-ab145450d163 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:25.822693 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639aff0a-eb03-42b5-8133-ab145450d163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:25.822971 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639aff0a-eb03-42b5-8133-ab145450d163 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:25.835357 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639aff0a-eb03-42b5-8133-ab145450d163 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:25.843343 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-639aff0a-eb03-42b5-8133-ab145450d163 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 19:16:25.844918 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 370/747] 10.222.0.62 () {56 vars in 1123 bytes} [Tue Nov 23 19:16:25 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:25.852466 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc4c20-3a42-4a6a-b10b-4019ee46eda7 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:25.862707 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc4c20-3a42-4a6a-b10b-4019ee46eda7 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:25.867464 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047b679-71c7-49ff-bff7-0f1b8436f9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:25.868146 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047b679-71c7-49ff-bff7-0f1b8436f9ec admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:25.868428 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047b679-71c7-49ff-bff7-0f1b8436f9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:25.868703 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047b679-71c7-49ff-bff7-0f1b8436f9ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:25.869508 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1047b679-71c7-49ff-bff7-0f1b8436f9ec admin admin] RBAC: Adding query filter params (name=service) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:25.869820 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1047b679-71c7-49ff-bff7-0f1b8436f9ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:25.871470 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1047b679-71c7-49ff-bff7-0f1b8436f9ec admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:25.880704 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 378/748] 10.222.0.62 () {56 vars in 1124 bytes} [Tue Nov 23 19:16:25 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:25.887951 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639aff0a-eb03-42b5-8133-ab145450d163 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:25.898330 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639aff0a-eb03-42b5-8133-ab145450d163 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:25.902914 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1ee85-8ec3-450b-bc80-6802907acc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:25.903753 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1ee85-8ec3-450b-bc80-6802907acc6b admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:25.904046 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1ee85-8ec3-450b-bc80-6802907acc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:25.905014 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1ee85-8ec3-450b-bc80-6802907acc6b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:25.916461 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1ee85-8ec3-450b-bc80-6802907acc6b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:25.918374 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1ee85-8ec3-450b-bc80-6802907acc6b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:25.935443 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-3ce1ee85-8ec3-450b-bc80-6802907acc6b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:25.936645 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 371/749] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:25.942848 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047b679-71c7-49ff-bff7-0f1b8436f9ec admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:25.954279 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047b679-71c7-49ff-bff7-0f1b8436f9ec admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:25.959486 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11774151-a3d8-4e2c-9237-18a59420ffb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:25.960238 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11774151-a3d8-4e2c-9237-18a59420ffb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:25.960522 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11774151-a3d8-4e2c-9237-18a59420ffb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:25.960837 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11774151-a3d8-4e2c-9237-18a59420ffb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:25.961642 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11774151-a3d8-4e2c-9237-18a59420ffb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:25.962042 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11774151-a3d8-4e2c-9237-18a59420ffb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:25.963685 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11774151-a3d8-4e2c-9237-18a59420ffb0 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:25.976722 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 379/750] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:25.983318 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1ee85-8ec3-450b-bc80-6802907acc6b admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:25.993807 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1ee85-8ec3-450b-bc80-6802907acc6b admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:25.999317 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec524ec-18cb-497c-b234-08b3557040e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:26.002851 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec524ec-18cb-497c-b234-08b3557040e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:26.002851 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec524ec-18cb-497c-b234-08b3557040e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:26.002851 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec524ec-18cb-497c-b234-08b3557040e3 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:26.010127 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec524ec-18cb-497c-b234-08b3557040e3 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:26.012556 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec524ec-18cb-497c-b234-08b3557040e3 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:26.027919 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-fec524ec-18cb-497c-b234-08b3557040e3 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 23 19:16:26.029921 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 372/751] 10.222.0.62 () {56 vars in 1138 bytes} [Tue Nov 23 19:16:25 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:26.036195 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11774151-a3d8-4e2c-9237-18a59420ffb0 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:26.043932 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e349837-de2f-4bc7-87f0-4ff90ac1d629 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:26.044330 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e349837-de2f-4bc7-87f0-4ff90ac1d629 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:26.044588 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e349837-de2f-4bc7-87f0-4ff90ac1d629 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:26.047102 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 373/752] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:26.051328 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11774151-a3d8-4e2c-9237-18a59420ffb0 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:26.056350 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cd2a1-1f1c-48b8-9f63-d9964de94393 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:26.056713 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cd2a1-1f1c-48b8-9f63-d9964de94393 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:26.057016 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cd2a1-1f1c-48b8-9f63-d9964de94393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:26.059199 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2e614-fba4-4632-b0b9-927c7953244c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:26.060303 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2e614-fba4-4632-b0b9-927c7953244c admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:26.061618 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2e614-fba4-4632-b0b9-927c7953244c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:26.062127 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2e614-fba4-4632-b0b9-927c7953244c admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:26.063518 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2e614-fba4-4632-b0b9-927c7953244c admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:26.064052 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2e614-fba4-4632-b0b9-927c7953244c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:26.066147 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2e614-fba4-4632-b0b9-927c7953244c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:26.080690 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-258cd2a1-1f1c-48b8-9f63-d9964de94393 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:26.082008 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-258cd2a1-1f1c-48b8-9f63-d9964de94393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:26.091281 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 380/753] 10.222.0.62 () {56 vars in 1170 bytes} [Tue Nov 23 19:16:26 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:26.098292 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2e614-fba4-4632-b0b9-927c7953244c admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:26.102877 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 374/754] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:26 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:16:26.110448 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2e614-fba4-4632-b0b9-927c7953244c admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:26.117697 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388301c-56fe-41bd-8d6b-84d89d11dc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:26.118703 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388301c-56fe-41bd-8d6b-84d89d11dc2c admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:26.119230 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388301c-56fe-41bd-8d6b-84d89d11dc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:26.119725 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388301c-56fe-41bd-8d6b-84d89d11dc2c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:26.133548 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388301c-56fe-41bd-8d6b-84d89d11dc2c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:26.135780 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388301c-56fe-41bd-8d6b-84d89d11dc2c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:26.147755 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 381/755] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:16:26 2021] GET /identity/v3/auth/tokens => generated 1018 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:16:26.153914 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258cd2a1-1f1c-48b8-9f63-d9964de94393 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:26.156999 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388301c-56fe-41bd-8d6b-84d89d11dc2c admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:26.169455 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388301c-56fe-41bd-8d6b-84d89d11dc2c admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:26.173264 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258cd2a1-1f1c-48b8-9f63-d9964de94393 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:26.180835 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f955e1-38fa-4f6f-8d55-23271b9f67cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:26.182739 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f406de-06f8-4046-9cc7-39e4a88b3eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:26.183368 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f955e1-38fa-4f6f-8d55-23271b9f67cc admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:26.183982 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f955e1-38fa-4f6f-8d55-23271b9f67cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:26.184965 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f406de-06f8-4046-9cc7-39e4a88b3eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:26.186671 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f406de-06f8-4046-9cc7-39e4a88b3eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:26.187177 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f406de-06f8-4046-9cc7-39e4a88b3eb8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:26.188065 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f955e1-38fa-4f6f-8d55-23271b9f67cc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:26.212094 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f406de-06f8-4046-9cc7-39e4a88b3eb8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:26.213310 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f955e1-38fa-4f6f-8d55-23271b9f67cc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:26.222611 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f955e1-38fa-4f6f-8d55-23271b9f67cc admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:26.231271 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-84f406de-06f8-4046-9cc7-39e4a88b3eb8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 19:16:26.238763 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 382/756] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:16:26 2021] GET /identity/v3/roles/admin => generated 83 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:26.242328 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f406de-06f8-4046-9cc7-39e4a88b3eb8 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:26.257462 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-10f955e1-38fa-4f6f-8d55-23271b9f67cc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:26.261758 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 375/757] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:26.262929 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f406de-06f8-4046-9cc7-39e4a88b3eb8 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:26.268271 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f955e1-38fa-4f6f-8d55-23271b9f67cc admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:26.273960 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4576b5b-32f0-4261-ae94-a79b02c160ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:26.275550 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4576b5b-32f0-4261-ae94-a79b02c160ee admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:26.277018 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4576b5b-32f0-4261-ae94-a79b02c160ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:26.277564 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4576b5b-32f0-4261-ae94-a79b02c160ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:26.278569 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4576b5b-32f0-4261-ae94-a79b02c160ee admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:26.280199 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4576b5b-32f0-4261-ae94-a79b02c160ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:26.282097 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4576b5b-32f0-4261-ae94-a79b02c160ee admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:26.285366 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f955e1-38fa-4f6f-8d55-23271b9f67cc admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:26.296240 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818df2c-a5d4-4f94-b750-022b67221ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:26.297959 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818df2c-a5d4-4f94-b750-022b67221ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:26.298933 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818df2c-a5d4-4f94-b750-022b67221ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:26.299414 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818df2c-a5d4-4f94-b750-022b67221ee0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:26.301211 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818df2c-a5d4-4f94-b750-022b67221ee0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:26.303988 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 383/758] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:16:26 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:26.304601 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818df2c-a5d4-4f94-b750-022b67221ee0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:26.306402 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818df2c-a5d4-4f94-b750-022b67221ee0 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:26.316339 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4576b5b-32f0-4261-ae94-a79b02c160ee admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:26.328993 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4576b5b-32f0-4261-ae94-a79b02c160ee admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:26.333812 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 376/759] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:26.337514 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fefdba-9ebd-4a3f-9959-eb25614536b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:26.339413 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818df2c-a5d4-4f94-b750-022b67221ee0 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:26.340058 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fefdba-9ebd-4a3f-9959-eb25614536b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:26.343629 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fefdba-9ebd-4a3f-9959-eb25614536b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:26.344150 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fefdba-9ebd-4a3f-9959-eb25614536b1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:26.354300 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818df2c-a5d4-4f94-b750-022b67221ee0 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:26.358812 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fefdba-9ebd-4a3f-9959-eb25614536b1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:26.361044 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fefdba-9ebd-4a3f-9959-eb25614536b1 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:26.367468 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb225720-27d4-428c-826c-e85ca82bc18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:26.368268 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb225720-27d4-428c-826c-e85ca82bc18b admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:26.368555 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb225720-27d4-428c-826c-e85ca82bc18b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:26.368830 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb225720-27d4-428c-826c-e85ca82bc18b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:26.380071 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb225720-27d4-428c-826c-e85ca82bc18b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:26.381999 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-13fefdba-9ebd-4a3f-9959-eb25614536b1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:26.382133 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb225720-27d4-428c-826c-e85ca82bc18b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:26.384075 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 384/760] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:26.385619 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef502603-1059-46a4-9852-4ce109b2ad55 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:26.386160 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef502603-1059-46a4-9852-4ce109b2ad55 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:26.386632 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef502603-1059-46a4-9852-4ce109b2ad55 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:26.389391 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 385/761] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:26.390319 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef502603-1059-46a4-9852-4ce109b2ad55 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:26.397011 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-bb225720-27d4-428c-826c-e85ca82bc18b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:16:26.398478 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 377/762] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:26.399719 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7849f-088b-4268-9e64-5238a1da91c3 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:26.400005 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7849f-088b-4268-9e64-5238a1da91c3 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:26.400276 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7849f-088b-4268-9e64-5238a1da91c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:26.405545 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef502603-1059-46a4-9852-4ce109b2ad55 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:26.411241 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d71fc-96b9-476c-a257-325af853f180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:26.412131 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d71fc-96b9-476c-a257-325af853f180 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:26.412642 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d71fc-96b9-476c-a257-325af853f180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:26.413096 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d71fc-96b9-476c-a257-325af853f180 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:26.414084 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d71fc-96b9-476c-a257-325af853f180 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:26.414568 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d71fc-96b9-476c-a257-325af853f180 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:26.416535 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d71fc-96b9-476c-a257-325af853f180 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:26.419590 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-25e7849f-088b-4268-9e64-5238a1da91c3 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:26.421232 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-25e7849f-088b-4268-9e64-5238a1da91c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:26.429182 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 378/763] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:26 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:16:26.430109 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7849f-088b-4268-9e64-5238a1da91c3 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:26.431435 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 386/764] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:26.438575 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d71fc-96b9-476c-a257-325af853f180 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:26.439799 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7849f-088b-4268-9e64-5238a1da91c3 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:26.450043 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee01674-3058-4702-9e4b-bd636113184c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:26.450680 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee01674-3058-4702-9e4b-bd636113184c admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:26.450992 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee01674-3058-4702-9e4b-bd636113184c admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:26.451275 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee01674-3058-4702-9e4b-bd636113184c admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:26.453502 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee01674-3058-4702-9e4b-bd636113184c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:26.453817 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee01674-3058-4702-9e4b-bd636113184c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:26.455618 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee01674-3058-4702-9e4b-bd636113184c admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:26.457034 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d71fc-96b9-476c-a257-325af853f180 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:26.461931 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d91e2-bc6b-49d1-a6d8-d1a85de2fe85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:26.462759 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d91e2-bc6b-49d1-a6d8-d1a85de2fe85 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:26.463095 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d91e2-bc6b-49d1-a6d8-d1a85de2fe85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:26.463377 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d91e2-bc6b-49d1-a6d8-d1a85de2fe85 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:26.469016 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 379/765] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:16:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:26.469898 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee01674-3058-4702-9e4b-bd636113184c admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:26.472378 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d91e2-bc6b-49d1-a6d8-d1a85de2fe85 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:26.474621 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d91e2-bc6b-49d1-a6d8-d1a85de2fe85 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:26.479292 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee01674-3058-4702-9e4b-bd636113184c admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:26.484333 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf0b7c-ed40-4e65-b0dc-eded12325551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:26.484902 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf0b7c-ed40-4e65-b0dc-eded12325551 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:26.485180 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf0b7c-ed40-4e65-b0dc-eded12325551 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:26.485485 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf0b7c-ed40-4e65-b0dc-eded12325551 admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:26.486207 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf0b7c-ed40-4e65-b0dc-eded12325551 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:26.487182 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING py.warnings [None req-ebbf0b7c-ed40-4e65-b0dc-eded12325551 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:16:26.487182 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: warnings.warn(msg) Nov 23 19:16:26.487182 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: Nov 23 19:16:26.488020 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf0b7c-ed40-4e65-b0dc-eded12325551 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:26.490138 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-5e8d91e2-bc6b-49d1-a6d8-d1a85de2fe85 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 23 19:16:26.491530 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 387/766] 10.222.0.62 () {56 vars in 1114 bytes} [Tue Nov 23 19:16:26 2021] GET /identity/v3/users/nova => generated 82 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:26.492187 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d91e2-bc6b-49d1-a6d8-d1a85de2fe85 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:26.503347 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d91e2-bc6b-49d1-a6d8-d1a85de2fe85 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:26.507790 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26366b-0662-441a-b5f9-d5aea8007dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:26.508399 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26366b-0662-441a-b5f9-d5aea8007dbe admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:26.508675 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26366b-0662-441a-b5f9-d5aea8007dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:26.508951 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26366b-0662-441a-b5f9-d5aea8007dbe admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:26.509871 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26366b-0662-441a-b5f9-d5aea8007dbe admin admin] RBAC: Adding query filter params (role.id=e68dc60061bd41dc894e1be26b4d5027, scope.project.id=2955b3037801465c9eec5d78fe2e3ae9, user.id=abc393885c6c4cf6bd4dd52f698fc38c) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:26.510177 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26366b-0662-441a-b5f9-d5aea8007dbe admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:26.511951 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26366b-0662-441a-b5f9-d5aea8007dbe admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:26.517465 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 388/767] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:16:26 2021] GET /identity/v3/role_assignments?user.id=abc393885c6c4cf6bd4dd52f698fc38c&scope.project.id=2955b3037801465c9eec5d78fe2e3ae9&role.id=e68dc60061bd41dc894e1be26b4d5027 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:26.521437 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26366b-0662-441a-b5f9-d5aea8007dbe admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:26.533066 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26366b-0662-441a-b5f9-d5aea8007dbe admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:26.538085 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa074dd-1b97-4f02-9a46-7efe1cc8e970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:26.538821 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa074dd-1b97-4f02-9a46-7efe1cc8e970 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:26.539109 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa074dd-1b97-4f02-9a46-7efe1cc8e970 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:26.539435 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa074dd-1b97-4f02-9a46-7efe1cc8e970 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:26.540365 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa074dd-1b97-4f02-9a46-7efe1cc8e970 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:26.540669 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa074dd-1b97-4f02-9a46-7efe1cc8e970 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:26.542725 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa074dd-1b97-4f02-9a46-7efe1cc8e970 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:26.565668 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 389/768] 10.222.0.62 () {56 vars in 1154 bytes} [Tue Nov 23 19:16:26 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:26.571101 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 380/769] 10.222.0.62 () {60 vars in 1162 bytes} [Tue Nov 23 19:16:26 2021] POST /identity/v3/services => generated 240 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:16:26.572561 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa074dd-1b97-4f02-9a46-7efe1cc8e970 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:26.589194 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa074dd-1b97-4f02-9a46-7efe1cc8e970 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:26.608774 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3bc70-98ca-47b2-be99-494fcf433682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:26.609633 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3bc70-98ca-47b2-be99-494fcf433682 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:26.609917 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3bc70-98ca-47b2-be99-494fcf433682 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:26.610243 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3bc70-98ca-47b2-be99-494fcf433682 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:26.625328 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3bc70-98ca-47b2-be99-494fcf433682 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:26.627214 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3bc70-98ca-47b2-be99-494fcf433682 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:26.650601 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-ecf3bc70-98ca-47b2-be99-494fcf433682 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:26.651912 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 390/770] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:26.658989 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf0b7c-ed40-4e65-b0dc-eded12325551 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:26.669779 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf0b7c-ed40-4e65-b0dc-eded12325551 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:26.678985 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bca55-fc9c-4473-8e49-72ecfb094c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:26.679665 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bca55-fc9c-4473-8e49-72ecfb094c94 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:26.680013 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bca55-fc9c-4473-8e49-72ecfb094c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:26.680291 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bca55-fc9c-4473-8e49-72ecfb094c94 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:26.681094 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5bca55-fc9c-4473-8e49-72ecfb094c94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:26.681435 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5bca55-fc9c-4473-8e49-72ecfb094c94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:26.683109 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5bca55-fc9c-4473-8e49-72ecfb094c94 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:26.702796 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 381/771] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:26.709226 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3bc70-98ca-47b2-be99-494fcf433682 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:26.720775 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3bc70-98ca-47b2-be99-494fcf433682 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:26.729535 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd476bb-fecc-4521-ade4-e0a2c1db25e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:26.730371 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd476bb-fecc-4521-ade4-e0a2c1db25e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:26.730653 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd476bb-fecc-4521-ade4-e0a2c1db25e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:26.730971 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd476bb-fecc-4521-ade4-e0a2c1db25e7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:26.742963 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd476bb-fecc-4521-ade4-e0a2c1db25e7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:26.744914 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd476bb-fecc-4521-ade4-e0a2c1db25e7 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:26.760343 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-5fd476bb-fecc-4521-ade4-e0a2c1db25e7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:16:26.761948 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 391/772] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:26.770653 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bca55-fc9c-4473-8e49-72ecfb094c94 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:26.789045 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bca55-fc9c-4473-8e49-72ecfb094c94 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:26.798256 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804ac9a-963c-4a39-8eea-3ff13cbd6288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:26.798928 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804ac9a-963c-4a39-8eea-3ff13cbd6288 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:26.799219 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804ac9a-963c-4a39-8eea-3ff13cbd6288 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:26.799495 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804ac9a-963c-4a39-8eea-3ff13cbd6288 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:26.800304 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804ac9a-963c-4a39-8eea-3ff13cbd6288 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:26.800617 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804ac9a-963c-4a39-8eea-3ff13cbd6288 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:26.804595 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804ac9a-963c-4a39-8eea-3ff13cbd6288 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:26.817036 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 382/773] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:16:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:26.823672 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd476bb-fecc-4521-ade4-e0a2c1db25e7 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:26.839896 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd476bb-fecc-4521-ade4-e0a2c1db25e7 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:26.853011 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6dd06f-3222-4a67-af3d-1cdd399e2dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:26.853910 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6dd06f-3222-4a67-af3d-1cdd399e2dc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:26.854188 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6dd06f-3222-4a67-af3d-1cdd399e2dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:26.854456 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6dd06f-3222-4a67-af3d-1cdd399e2dc2 admin admin] PATH_INFO: `/v3/projects/2955b3037801465c9eec5d78fe2e3ae9/users/6d91fe7f996b48b0bc28e1eadc4f8869/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:26.856634 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6dd06f-3222-4a67-af3d-1cdd399e2dc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2955b3037801465c9eec5d78fe2e3ae9, user_id=6d91fe7f996b48b0bc28e1eadc4f8869, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:26.860014 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6dd06f-3222-4a67-af3d-1cdd399e2dc2 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:26.956574 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 392/774] 10.222.0.62 () {58 vars in 1460 bytes} [Tue Nov 23 19:16:26 2021] PUT /identity/v3/projects/2955b3037801465c9eec5d78fe2e3ae9/users/6d91fe7f996b48b0bc28e1eadc4f8869/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:16:27.362287 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb65c03-77e2-4d36-8065-3f9836f624ed None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:27.362812 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb65c03-77e2-4d36-8065-3f9836f624ed None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:27.362812 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb65c03-77e2-4d36-8065-3f9836f624ed None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:27.364898 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 383/775] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:27.370856 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9edc1-2cfb-4245-8d5a-4c4852619cc4 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:27.371258 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9edc1-2cfb-4245-8d5a-4c4852619cc4 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:27.371409 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9edc1-2cfb-4245-8d5a-4c4852619cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:27.397289 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-c1f9edc1-2cfb-4245-8d5a-4c4852619cc4 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:27.398489 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-c1f9edc1-2cfb-4245-8d5a-4c4852619cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:27.473572 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 393/776] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:27 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:16:27.493835 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb65c03-77e2-4d36-8065-3f9836f624ed None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:27.506786 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb65c03-77e2-4d36-8065-3f9836f624ed None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:27.511080 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367751a7-db79-4493-84e0-599d6c7b8323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:27.511854 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367751a7-db79-4493-84e0-599d6c7b8323 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:27.512127 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367751a7-db79-4493-84e0-599d6c7b8323 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:27.512395 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367751a7-db79-4493-84e0-599d6c7b8323 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:27.522652 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367751a7-db79-4493-84e0-599d6c7b8323 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:27.529599 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-367751a7-db79-4493-84e0-599d6c7b8323 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 19:16:27.536082 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 384/777] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:16:27 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:27.537836 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9edc1-2cfb-4245-8d5a-4c4852619cc4 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:27.547306 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9edc1-2cfb-4245-8d5a-4c4852619cc4 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:27.551814 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179a8b7-90f4-42d4-adf1-de7b7baa4599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:27.552461 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179a8b7-90f4-42d4-adf1-de7b7baa4599 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:27.552737 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179a8b7-90f4-42d4-adf1-de7b7baa4599 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:27.553007 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179a8b7-90f4-42d4-adf1-de7b7baa4599 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:27.553796 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f179a8b7-90f4-42d4-adf1-de7b7baa4599 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:27.554096 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f179a8b7-90f4-42d4-adf1-de7b7baa4599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:27.555671 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f179a8b7-90f4-42d4-adf1-de7b7baa4599 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:27.564627 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 394/778] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:16:27 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:27.570367 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367751a7-db79-4493-84e0-599d6c7b8323 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:27.581783 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367751a7-db79-4493-84e0-599d6c7b8323 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:27.586263 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9150fb-8951-429e-bed8-12b1c214e1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:27.587038 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9150fb-8951-429e-bed8-12b1c214e1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:27.587314 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9150fb-8951-429e-bed8-12b1c214e1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:27.587587 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9150fb-8951-429e-bed8-12b1c214e1c2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:27.598059 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9150fb-8951-429e-bed8-12b1c214e1c2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:27.599894 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9150fb-8951-429e-bed8-12b1c214e1c2 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:27.616960 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-de9150fb-8951-429e-bed8-12b1c214e1c2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:27.618436 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 385/779] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:27.626502 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179a8b7-90f4-42d4-adf1-de7b7baa4599 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:27.642444 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179a8b7-90f4-42d4-adf1-de7b7baa4599 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:27.654010 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b0e8b-7c90-4c67-b21f-ec3344896e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:27.655220 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b0e8b-7c90-4c67-b21f-ec3344896e0e admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:27.655505 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b0e8b-7c90-4c67-b21f-ec3344896e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:27.655784 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b0e8b-7c90-4c67-b21f-ec3344896e0e admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:27.656529 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b0e8b-7c90-4c67-b21f-ec3344896e0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:27.656838 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b0e8b-7c90-4c67-b21f-ec3344896e0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:27.658452 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b0e8b-7c90-4c67-b21f-ec3344896e0e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:27.671447 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 395/780] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:27.677439 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9150fb-8951-429e-bed8-12b1c214e1c2 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:27.689769 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9150fb-8951-429e-bed8-12b1c214e1c2 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:27.697022 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c485d-9fec-41bf-b604-683b7808d9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:27.697883 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c485d-9fec-41bf-b604-683b7808d9c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:27.698163 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c485d-9fec-41bf-b604-683b7808d9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:27.698435 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c485d-9fec-41bf-b604-683b7808d9c7 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:27.708488 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c485d-9fec-41bf-b604-683b7808d9c7 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:27.710547 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c485d-9fec-41bf-b604-683b7808d9c7 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:27.729151 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-252c485d-9fec-41bf-b604-683b7808d9c7 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 23 19:16:27.735396 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 386/781] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:16:27 2021] GET /identity/v3/users/swift => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:27.737003 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b0e8b-7c90-4c67-b21f-ec3344896e0e admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:27.751733 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b0e8b-7c90-4c67-b21f-ec3344896e0e admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:27.763376 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c71132-e37f-4b15-90e3-621b871383de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:27.765525 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c71132-e37f-4b15-90e3-621b871383de admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:27.765810 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c71132-e37f-4b15-90e3-621b871383de admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:27.766087 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c71132-e37f-4b15-90e3-621b871383de admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:27.766942 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c71132-e37f-4b15-90e3-621b871383de admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:27.767253 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c71132-e37f-4b15-90e3-621b871383de admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:27.769087 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c71132-e37f-4b15-90e3-621b871383de admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:27.797578 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 396/782] 10.222.0.62 () {56 vars in 1156 bytes} [Tue Nov 23 19:16:27 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:27.803603 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c485d-9fec-41bf-b604-683b7808d9c7 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:27.822985 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c485d-9fec-41bf-b604-683b7808d9c7 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:27.832286 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b87b1-2352-4013-bd29-ec7ad5e70785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:27.832942 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b87b1-2352-4013-bd29-ec7ad5e70785 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:27.833218 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b87b1-2352-4013-bd29-ec7ad5e70785 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:27.833532 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b87b1-2352-4013-bd29-ec7ad5e70785 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:27.849275 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b87b1-2352-4013-bd29-ec7ad5e70785 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:27.851120 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b87b1-2352-4013-bd29-ec7ad5e70785 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:27.864166 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 387/783] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:16:27 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:16:27.869914 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c71132-e37f-4b15-90e3-621b871383de admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:27.882668 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c71132-e37f-4b15-90e3-621b871383de admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:27.898020 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cdaf4-2518-44d6-8081-a090c03a9939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:27.898819 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cdaf4-2518-44d6-8081-a090c03a9939 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:27.899099 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cdaf4-2518-44d6-8081-a090c03a9939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:27.899380 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cdaf4-2518-44d6-8081-a090c03a9939 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:27.910803 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1cdaf4-2518-44d6-8081-a090c03a9939 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:27.912647 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1cdaf4-2518-44d6-8081-a090c03a9939 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:27.944998 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-fe1cdaf4-2518-44d6-8081-a090c03a9939 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:27.946283 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 397/784] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:27.952660 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b87b1-2352-4013-bd29-ec7ad5e70785 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:27.966409 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b87b1-2352-4013-bd29-ec7ad5e70785 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:27.977036 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc0dcc-a443-46c9-89c4-4ba40f7f7d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:27.977788 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc0dcc-a443-46c9-89c4-4ba40f7f7d54 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:27.978072 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc0dcc-a443-46c9-89c4-4ba40f7f7d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:27.978348 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc0dcc-a443-46c9-89c4-4ba40f7f7d54 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:27.979082 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc0dcc-a443-46c9-89c4-4ba40f7f7d54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:27.979385 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc0dcc-a443-46c9-89c4-4ba40f7f7d54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:27.980941 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc0dcc-a443-46c9-89c4-4ba40f7f7d54 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:28.003070 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 388/785] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:28.008906 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cdaf4-2518-44d6-8081-a090c03a9939 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:28.023439 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cdaf4-2518-44d6-8081-a090c03a9939 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:28.034552 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0d541-ecf4-4867-9967-ea34c77825bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:28.035360 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0d541-ecf4-4867-9967-ea34c77825bb admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:28.035643 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0d541-ecf4-4867-9967-ea34c77825bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:28.035918 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0d541-ecf4-4867-9967-ea34c77825bb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:28.045625 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0d541-ecf4-4867-9967-ea34c77825bb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:28.047582 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0d541-ecf4-4867-9967-ea34c77825bb admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:28.067587 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-bbf0d541-ecf4-4867-9967-ea34c77825bb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:16:28.077962 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 398/786] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:28.084239 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc0dcc-a443-46c9-89c4-4ba40f7f7d54 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:28.103195 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc0dcc-a443-46c9-89c4-4ba40f7f7d54 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:28.109823 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ddaa04-e5d9-4d8e-b51a-414f4612daf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:28.110687 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ddaa04-e5d9-4d8e-b51a-414f4612daf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:28.111134 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ddaa04-e5d9-4d8e-b51a-414f4612daf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:28.111547 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ddaa04-e5d9-4d8e-b51a-414f4612daf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:28.112509 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ddaa04-e5d9-4d8e-b51a-414f4612daf2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:28.112957 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ddaa04-e5d9-4d8e-b51a-414f4612daf2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:28.115025 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ddaa04-e5d9-4d8e-b51a-414f4612daf2 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:28.135206 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 389/787] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:16:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:28.142115 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0d541-ecf4-4867-9967-ea34c77825bb admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:28.152742 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0d541-ecf4-4867-9967-ea34c77825bb admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:28.165241 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88259f35-f930-4de9-8d7f-b3869a37961c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:28.165926 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88259f35-f930-4de9-8d7f-b3869a37961c admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:28.166208 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88259f35-f930-4de9-8d7f-b3869a37961c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:28.166479 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88259f35-f930-4de9-8d7f-b3869a37961c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:28.167330 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88259f35-f930-4de9-8d7f-b3869a37961c admin admin] RBAC: Adding query filter params (role.id=6d9a8878ffeb49fea19d854657c6b767, scope.project.id=2955b3037801465c9eec5d78fe2e3ae9, user.id=87b6ed93587a4c87ad5002fc80b985c9) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:28.167644 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88259f35-f930-4de9-8d7f-b3869a37961c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:28.169483 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88259f35-f930-4de9-8d7f-b3869a37961c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:28.175675 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 399/788] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:16:28 2021] GET /identity/v3/role_assignments?user.id=87b6ed93587a4c87ad5002fc80b985c9&scope.project.id=2955b3037801465c9eec5d78fe2e3ae9&role.id=6d9a8878ffeb49fea19d854657c6b767 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:28.427807 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35a5f9-1d34-44b3-98c5-4675f1535117 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:28.428308 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35a5f9-1d34-44b3-98c5-4675f1535117 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:28.428308 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35a5f9-1d34-44b3-98c5-4675f1535117 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:28.430501 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 390/789] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:28.436869 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114aa25-2002-46df-acb4-191d8b836a55 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:28.437474 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114aa25-2002-46df-acb4-191d8b836a55 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:28.437474 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114aa25-2002-46df-acb4-191d8b836a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:28.456879 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-1114aa25-2002-46df-acb4-191d8b836a55 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:28.458121 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-1114aa25-2002-46df-acb4-191d8b836a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:28.466256 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 400/790] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:28 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:16:28.491291 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35a5f9-1d34-44b3-98c5-4675f1535117 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:28.512783 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35a5f9-1d34-44b3-98c5-4675f1535117 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:28.521171 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb9575-c08b-4e58-a2ba-6d73f2c9d1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:28.522008 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb9575-c08b-4e58-a2ba-6d73f2c9d1b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:28.522289 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb9575-c08b-4e58-a2ba-6d73f2c9d1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:28.522563 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb9575-c08b-4e58-a2ba-6d73f2c9d1b5 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:28.523243 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb9575-c08b-4e58-a2ba-6d73f2c9d1b5 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:28.524839 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb9575-c08b-4e58-a2ba-6d73f2c9d1b5 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:28.541382 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-b5eb9575-c08b-4e58-a2ba-6d73f2c9d1b5 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 23 19:16:28.542956 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 391/791] 10.222.0.62 () {56 vars in 1150 bytes} [Tue Nov 23 19:16:28 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:28.549776 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114aa25-2002-46df-acb4-191d8b836a55 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:28.564226 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114aa25-2002-46df-acb4-191d8b836a55 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:28.575113 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdfa10-3742-4b71-8c21-2d49ccc354fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:28.575821 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdfa10-3742-4b71-8c21-2d49ccc354fc admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:28.576155 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdfa10-3742-4b71-8c21-2d49ccc354fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:28.576582 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdfa10-3742-4b71-8c21-2d49ccc354fc admin admin] PATH_INFO: `/v3/services` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:28.577575 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fdfa10-3742-4b71-8c21-2d49ccc354fc admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:28.577890 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fdfa10-3742-4b71-8c21-2d49ccc354fc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:28.578938 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING py.warnings [None req-74fdfa10-3742-4b71-8c21-2d49ccc354fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:16:28.578938 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: warnings.warn(msg) Nov 23 19:16:28.578938 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: Nov 23 19:16:28.579855 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fdfa10-3742-4b71-8c21-2d49ccc354fc admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:28.588167 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 401/792] 10.222.0.62 () {56 vars in 1145 bytes} [Tue Nov 23 19:16:28 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:28.594590 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb9575-c08b-4e58-a2ba-6d73f2c9d1b5 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:28.611369 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb9575-c08b-4e58-a2ba-6d73f2c9d1b5 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:28.619993 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91fdd9-d324-47fb-8ff7-f23474508797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:28.620650 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91fdd9-d324-47fb-8ff7-f23474508797 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:28.620933 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91fdd9-d324-47fb-8ff7-f23474508797 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:28.621211 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91fdd9-d324-47fb-8ff7-f23474508797 admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:28.621971 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91fdd9-d324-47fb-8ff7-f23474508797 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:28.622313 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91fdd9-d324-47fb-8ff7-f23474508797 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:28.623890 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91fdd9-d324-47fb-8ff7-f23474508797 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:28.634160 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 392/793] 10.222.0.62 () {56 vars in 1145 bytes} [Tue Nov 23 19:16:28 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:28.640414 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdfa10-3742-4b71-8c21-2d49ccc354fc admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:28.655214 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdfa10-3742-4b71-8c21-2d49ccc354fc admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:28.659936 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515aef2-d955-4a45-8bac-9d092ef68391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:28.660645 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515aef2-d955-4a45-8bac-9d092ef68391 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:28.660932 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515aef2-d955-4a45-8bac-9d092ef68391 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:28.661213 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515aef2-d955-4a45-8bac-9d092ef68391 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:28.662062 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515aef2-d955-4a45-8bac-9d092ef68391 admin admin] RBAC: Adding query filter params (interface=public, service_id=4230975ed3cf4e4384c281c94be97dfc, region_id=RegionOne) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:28.662433 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515aef2-d955-4a45-8bac-9d092ef68391 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:28.663442 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING py.warnings [None req-5515aef2-d955-4a45-8bac-9d092ef68391 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:16:28.663442 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: warnings.warn(msg) Nov 23 19:16:28.663442 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: Nov 23 19:16:28.664307 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515aef2-d955-4a45-8bac-9d092ef68391 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:28.675113 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 402/794] 10.222.0.62 () {56 vars in 1272 bytes} [Tue Nov 23 19:16:28 2021] GET /identity/v3/endpoints?service_id=4230975ed3cf4e4384c281c94be97dfc&interface=public®ion_id=RegionOne => generated 194 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:28.681158 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91fdd9-d324-47fb-8ff7-f23474508797 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:28.691683 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91fdd9-d324-47fb-8ff7-f23474508797 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:28.697870 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d43f57-fe33-48cc-b19c-3ec774e2ecba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:28.698529 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d43f57-fe33-48cc-b19c-3ec774e2ecba admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:28.698963 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d43f57-fe33-48cc-b19c-3ec774e2ecba admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:28.699250 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d43f57-fe33-48cc-b19c-3ec774e2ecba admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:28.699991 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d43f57-fe33-48cc-b19c-3ec774e2ecba admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:28.701887 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d43f57-fe33-48cc-b19c-3ec774e2ecba admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:28.708397 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 393/795] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Nov 23 19:16:28 2021] GET /identity/v3/services => generated 772 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:29.123404 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0dd313-ee4f-4b94-b04e-fe586a2c9493 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:29.123825 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0dd313-ee4f-4b94-b04e-fe586a2c9493 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:29.123997 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0dd313-ee4f-4b94-b04e-fe586a2c9493 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:29.126010 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 403/796] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:29.131667 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083d45a-be3c-49ec-ab25-d8d609c14561 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:29.131962 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083d45a-be3c-49ec-ab25-d8d609c14561 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:29.132244 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083d45a-be3c-49ec-ab25-d8d609c14561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:29.152112 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-8083d45a-be3c-49ec-ab25-d8d609c14561 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:29.153372 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-8083d45a-be3c-49ec-ab25-d8d609c14561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:29.164723 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 394/797] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:29 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:16:29.189063 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0dd313-ee4f-4b94-b04e-fe586a2c9493 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:29.205803 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0dd313-ee4f-4b94-b04e-fe586a2c9493 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:29.214604 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0900608-c327-4aef-b559-9cc9df2c93e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:29.215401 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0900608-c327-4aef-b559-9cc9df2c93e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:29.215734 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0900608-c327-4aef-b559-9cc9df2c93e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:29.216021 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0900608-c327-4aef-b559-9cc9df2c93e5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:29.231220 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0900608-c327-4aef-b559-9cc9df2c93e5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:29.239099 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-c0900608-c327-4aef-b559-9cc9df2c93e5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 19:16:29.250503 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 404/798] 10.222.0.62 () {56 vars in 1123 bytes} [Tue Nov 23 19:16:29 2021] GET /identity/v3/roles/service => generated 85 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:29.256893 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083d45a-be3c-49ec-ab25-d8d609c14561 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:29.270590 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083d45a-be3c-49ec-ab25-d8d609c14561 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:29.282031 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8854f09-5ee1-4d3b-af9d-29b0fa308d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:29.282703 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8854f09-5ee1-4d3b-af9d-29b0fa308d08 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:29.282989 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8854f09-5ee1-4d3b-af9d-29b0fa308d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:29.283271 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8854f09-5ee1-4d3b-af9d-29b0fa308d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:29.284229 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8854f09-5ee1-4d3b-af9d-29b0fa308d08 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:29.284544 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8854f09-5ee1-4d3b-af9d-29b0fa308d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:29.286244 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8854f09-5ee1-4d3b-af9d-29b0fa308d08 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:29.297568 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 395/799] 10.222.0.62 () {56 vars in 1124 bytes} [Tue Nov 23 19:16:29 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:29.303219 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0900608-c327-4aef-b559-9cc9df2c93e5 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:29.318515 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0900608-c327-4aef-b559-9cc9df2c93e5 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:29.329250 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464790bc-6ee5-449b-a57e-3ea6d1e387bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:29.330073 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464790bc-6ee5-449b-a57e-3ea6d1e387bd admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:29.330350 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464790bc-6ee5-449b-a57e-3ea6d1e387bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:29.330622 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464790bc-6ee5-449b-a57e-3ea6d1e387bd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:29.349694 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464790bc-6ee5-449b-a57e-3ea6d1e387bd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:29.351504 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464790bc-6ee5-449b-a57e-3ea6d1e387bd admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:29.379892 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-464790bc-6ee5-449b-a57e-3ea6d1e387bd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:29.381307 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 405/800] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:29.387690 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8854f09-5ee1-4d3b-af9d-29b0fa308d08 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:29.402382 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8854f09-5ee1-4d3b-af9d-29b0fa308d08 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:29.418031 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651a07e-251b-4c24-90f2-ccf30d78331e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:29.418984 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651a07e-251b-4c24-90f2-ccf30d78331e admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:29.419461 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651a07e-251b-4c24-90f2-ccf30d78331e admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:29.420601 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3651a07e-251b-4c24-90f2-ccf30d78331e admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:29.421642 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651a07e-251b-4c24-90f2-ccf30d78331e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:29.422144 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651a07e-251b-4c24-90f2-ccf30d78331e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:29.423912 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3651a07e-251b-4c24-90f2-ccf30d78331e admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:29.439238 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 396/801] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:29.444727 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464790bc-6ee5-449b-a57e-3ea6d1e387bd admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:29.458590 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464790bc-6ee5-449b-a57e-3ea6d1e387bd admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:29.469842 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09245c-9637-4e35-b502-8e7349eef787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:29.470642 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09245c-9637-4e35-b502-8e7349eef787 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:29.470918 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09245c-9637-4e35-b502-8e7349eef787 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:29.471188 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09245c-9637-4e35-b502-8e7349eef787 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:29.490546 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09245c-9637-4e35-b502-8e7349eef787 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:29.492534 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09245c-9637-4e35-b502-8e7349eef787 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:29.513439 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-0f09245c-9637-4e35-b502-8e7349eef787 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 23 19:16:29.514979 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 406/802] 10.222.0.62 () {56 vars in 1138 bytes} [Tue Nov 23 19:16:29 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:29.520979 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651a07e-251b-4c24-90f2-ccf30d78331e admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:29.539809 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3651a07e-251b-4c24-90f2-ccf30d78331e admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:29.549751 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e871099-3b53-4b54-b63a-9188c4516516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:29.550695 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e871099-3b53-4b54-b63a-9188c4516516 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:29.551177 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e871099-3b53-4b54-b63a-9188c4516516 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:29.551658 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e871099-3b53-4b54-b63a-9188c4516516 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:29.552690 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e871099-3b53-4b54-b63a-9188c4516516 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:29.553206 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e871099-3b53-4b54-b63a-9188c4516516 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:29.555455 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e871099-3b53-4b54-b63a-9188c4516516 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:29.584599 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 397/803] 10.222.0.62 () {56 vars in 1170 bytes} [Tue Nov 23 19:16:29 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:29.590443 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09245c-9637-4e35-b502-8e7349eef787 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:29.606398 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09245c-9637-4e35-b502-8e7349eef787 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:29.617090 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc28d1a-42f5-4f2d-9368-5239d40ea8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:29.617905 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc28d1a-42f5-4f2d-9368-5239d40ea8ab admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:29.618182 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc28d1a-42f5-4f2d-9368-5239d40ea8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:29.618451 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc28d1a-42f5-4f2d-9368-5239d40ea8ab admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:29.637582 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc28d1a-42f5-4f2d-9368-5239d40ea8ab admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:29.639914 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc28d1a-42f5-4f2d-9368-5239d40ea8ab admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:29.667438 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-ddc28d1a-42f5-4f2d-9368-5239d40ea8ab admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:29.668831 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 407/804] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:29.675261 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e871099-3b53-4b54-b63a-9188c4516516 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:29.691315 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e871099-3b53-4b54-b63a-9188c4516516 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:29.706370 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652f6cf-54a4-488b-afb2-b266b2e45861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:29.707070 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652f6cf-54a4-488b-afb2-b266b2e45861 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:29.707441 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652f6cf-54a4-488b-afb2-b266b2e45861 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:29.707726 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652f6cf-54a4-488b-afb2-b266b2e45861 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:29.708483 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652f6cf-54a4-488b-afb2-b266b2e45861 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:29.708802 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652f6cf-54a4-488b-afb2-b266b2e45861 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:29.710566 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652f6cf-54a4-488b-afb2-b266b2e45861 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:29.733567 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 398/805] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:29.739522 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc28d1a-42f5-4f2d-9368-5239d40ea8ab admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:29.755901 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc28d1a-42f5-4f2d-9368-5239d40ea8ab admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:29.764690 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51491b01-21bc-4038-81cc-aee3a300f393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:29.765515 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51491b01-21bc-4038-81cc-aee3a300f393 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:29.765796 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51491b01-21bc-4038-81cc-aee3a300f393 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:29.766069 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51491b01-21bc-4038-81cc-aee3a300f393 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:29.782632 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51491b01-21bc-4038-81cc-aee3a300f393 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:29.784571 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51491b01-21bc-4038-81cc-aee3a300f393 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:29.805030 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-51491b01-21bc-4038-81cc-aee3a300f393 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:16:29.806928 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 408/806] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:29 2021] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:29.813371 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652f6cf-54a4-488b-afb2-b266b2e45861 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:29.827342 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652f6cf-54a4-488b-afb2-b266b2e45861 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:29.835884 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccee6b4-5897-4af8-bfcd-7b98cd84599c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:29.836596 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccee6b4-5897-4af8-bfcd-7b98cd84599c admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:29.836886 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccee6b4-5897-4af8-bfcd-7b98cd84599c admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:29.837164 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccee6b4-5897-4af8-bfcd-7b98cd84599c admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:29.838082 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccee6b4-5897-4af8-bfcd-7b98cd84599c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:29.838393 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccee6b4-5897-4af8-bfcd-7b98cd84599c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:29.840289 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccee6b4-5897-4af8-bfcd-7b98cd84599c admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:29.861352 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 399/807] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:16:29 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:29.867781 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51491b01-21bc-4038-81cc-aee3a300f393 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:29.882507 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51491b01-21bc-4038-81cc-aee3a300f393 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:29.893202 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b5fa7-822c-4252-ba00-747b8a28c28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:29.894050 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b5fa7-822c-4252-ba00-747b8a28c28c admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:29.894333 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b5fa7-822c-4252-ba00-747b8a28c28c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:29.894602 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b5fa7-822c-4252-ba00-747b8a28c28c admin admin] PATH_INFO: `/v3/projects/2955b3037801465c9eec5d78fe2e3ae9/users/abc393885c6c4cf6bd4dd52f698fc38c/roles/e68dc60061bd41dc894e1be26b4d5027` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:29.918940 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b5fa7-822c-4252-ba00-747b8a28c28c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2955b3037801465c9eec5d78fe2e3ae9, user_id=abc393885c6c4cf6bd4dd52f698fc38c, role_id=e68dc60061bd41dc894e1be26b4d5027)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:29.922235 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b5fa7-822c-4252-ba00-747b8a28c28c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:29.962812 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cecf76-f430-4f37-b770-3e2d6475e47a None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:29.963170 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cecf76-f430-4f37-b770-3e2d6475e47a None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:29.963380 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cecf76-f430-4f37-b770-3e2d6475e47a None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:29.965300 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 400/808] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 19:16:29.966261 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d20d7f-7731-4cf3-83a9-d79321252f6b None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:29.966544 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d20d7f-7731-4cf3-83a9-d79321252f6b None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:29.966946 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d20d7f-7731-4cf3-83a9-d79321252f6b None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:29.968667 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 401/809] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:29.972153 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fc044-137e-4a27-9fca-66a49c70458a None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:29.972445 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fc044-137e-4a27-9fca-66a49c70458a None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:29.972728 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fc044-137e-4a27-9fca-66a49c70458a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:29.991131 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-a80fc044-137e-4a27-9fca-66a49c70458a None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:29.992324 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-a80fc044-137e-4a27-9fca-66a49c70458a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:30.000299 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 402/810] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:29 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:16:30.001361 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1933dd8-a0cb-4883-bd5b-0a966d06a006 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:30.001840 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1933dd8-a0cb-4883-bd5b-0a966d06a006 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:30.001944 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1933dd8-a0cb-4883-bd5b-0a966d06a006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:30.019740 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 409/811] 10.222.0.62 () {58 vars in 1460 bytes} [Tue Nov 23 19:16:29 2021] PUT /identity/v3/projects/2955b3037801465c9eec5d78fe2e3ae9/users/abc393885c6c4cf6bd4dd52f698fc38c/roles/e68dc60061bd41dc894e1be26b4d5027 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:16:30.032122 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b5fa7-822c-4252-ba00-747b8a28c28c admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:30.032329 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-c1933dd8-a0cb-4883-bd5b-0a966d06a006 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:30.033536 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-c1933dd8-a0cb-4883-bd5b-0a966d06a006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:30.112706 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b5fa7-822c-4252-ba00-747b8a28c28c admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:30.118696 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53850bd9-8ae9-4799-bb44-d23bb5690bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:30.120013 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53850bd9-8ae9-4799-bb44-d23bb5690bca admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:30.120503 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53850bd9-8ae9-4799-bb44-d23bb5690bca admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:30.120981 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53850bd9-8ae9-4799-bb44-d23bb5690bca admin admin] PATH_INFO: `/v3/services/network` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:30.122030 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53850bd9-8ae9-4799-bb44-d23bb5690bca admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:30.124480 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53850bd9-8ae9-4799-bb44-d23bb5690bca admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:30.130690 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 403/812] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:30 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:16:30.142880 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-53850bd9-8ae9-4799-bb44-d23bb5690bca admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 23 19:16:30.144852 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 410/813] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:30 2021] GET /identity/v3/services/network => generated 88 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:30.167614 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1933dd8-a0cb-4883-bd5b-0a966d06a006 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:30.172347 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53850bd9-8ae9-4799-bb44-d23bb5690bca admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:30.183985 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1933dd8-a0cb-4883-bd5b-0a966d06a006 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:30.184755 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53850bd9-8ae9-4799-bb44-d23bb5690bca admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:30.190991 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d027893-cc5b-479a-aaec-402efa9e684f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:30.191548 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbaf1d-4228-48c2-86f0-99ef56eb4ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:30.192227 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbaf1d-4228-48c2-86f0-99ef56eb4ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:30.192515 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbaf1d-4228-48c2-86f0-99ef56eb4ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:30.192789 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbaf1d-4228-48c2-86f0-99ef56eb4ca5 admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:30.193086 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d027893-cc5b-479a-aaec-402efa9e684f admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:30.193558 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbaf1d-4228-48c2-86f0-99ef56eb4ca5 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:30.193819 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d027893-cc5b-479a-aaec-402efa9e684f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:30.193919 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbaf1d-4228-48c2-86f0-99ef56eb4ca5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:30.194379 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d027893-cc5b-479a-aaec-402efa9e684f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:30.195460 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbaf1d-4228-48c2-86f0-99ef56eb4ca5 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:30.206770 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 404/814] 10.222.0.62 () {56 vars in 1133 bytes} [Tue Nov 23 19:16:30 2021] GET /identity/v3/services?name=network => generated 124 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:30.214224 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d027893-cc5b-479a-aaec-402efa9e684f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:30.214740 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbaf1d-4228-48c2-86f0-99ef56eb4ca5 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:30.223036 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-5d027893-cc5b-479a-aaec-402efa9e684f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 19:16:30.230562 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 411/815] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:16:30 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:30.233274 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d027893-cc5b-479a-aaec-402efa9e684f admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:30.240088 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbaf1d-4228-48c2-86f0-99ef56eb4ca5 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:30.245308 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d027893-cc5b-479a-aaec-402efa9e684f admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:30.250435 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233dca0-7f87-4c79-bba9-1801fd9d119a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:30.251365 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233dca0-7f87-4c79-bba9-1801fd9d119a admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:30.251871 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233dca0-7f87-4c79-bba9-1801fd9d119a admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:30.252411 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233dca0-7f87-4c79-bba9-1801fd9d119a admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:30.253377 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233dca0-7f87-4c79-bba9-1801fd9d119a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:30.253999 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233dca0-7f87-4c79-bba9-1801fd9d119a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:30.255889 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233dca0-7f87-4c79-bba9-1801fd9d119a admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:30.262146 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0af301-a87d-41cd-afee-9331d7ca93bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:30.262796 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0af301-a87d-41cd-afee-9331d7ca93bf admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:30.263081 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0af301-a87d-41cd-afee-9331d7ca93bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:30.263361 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0af301-a87d-41cd-afee-9331d7ca93bf admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:30.264829 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0af301-a87d-41cd-afee-9331d7ca93bf admin admin] RBAC: Adding query filter params (type=network) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:30.265143 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0af301-a87d-41cd-afee-9331d7ca93bf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:30.266753 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0af301-a87d-41cd-afee-9331d7ca93bf admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:30.266963 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 412/816] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:16:30 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:30.274145 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233dca0-7f87-4c79-bba9-1801fd9d119a admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:30.275818 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 405/817] 10.222.0.62 () {56 vars in 1133 bytes} [Tue Nov 23 19:16:30 2021] GET /identity/v3/services?type=network => generated 350 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:30.283012 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0af301-a87d-41cd-afee-9331d7ca93bf admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:30.285050 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233dca0-7f87-4c79-bba9-1801fd9d119a admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:30.289728 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a7473-ae64-42a2-8c28-1cf418555836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:30.291043 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a7473-ae64-42a2-8c28-1cf418555836 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:30.291332 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a7473-ae64-42a2-8c28-1cf418555836 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:30.291613 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a7473-ae64-42a2-8c28-1cf418555836 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:30.297884 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0af301-a87d-41cd-afee-9331d7ca93bf admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:30.303878 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a7473-ae64-42a2-8c28-1cf418555836 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:30.305804 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a7473-ae64-42a2-8c28-1cf418555836 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:30.318996 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad06f1-46e0-45aa-9dc8-38f63c12a43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:30.319668 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad06f1-46e0-45aa-9dc8-38f63c12a43f admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:30.319950 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad06f1-46e0-45aa-9dc8-38f63c12a43f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:30.320227 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad06f1-46e0-45aa-9dc8-38f63c12a43f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:30.321041 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad06f1-46e0-45aa-9dc8-38f63c12a43f admin admin] RBAC: Adding query filter params (interface=public, service_id=80f43322abb1466aae34998da0863ef1, region_id=RegionOne) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:30.321351 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad06f1-46e0-45aa-9dc8-38f63c12a43f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:30.322637 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING py.warnings [None req-d4ad06f1-46e0-45aa-9dc8-38f63c12a43f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:16:30.322637 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: warnings.warn(msg) Nov 23 19:16:30.322637 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: Nov 23 19:16:30.323503 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad06f1-46e0-45aa-9dc8-38f63c12a43f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:30.325005 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-6b3a7473-ae64-42a2-8c28-1cf418555836 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:30.327317 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 413/818] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:30.333199 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a7473-ae64-42a2-8c28-1cf418555836 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:30.344602 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a7473-ae64-42a2-8c28-1cf418555836 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:30.349084 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8801ca7-f51f-4058-9130-f9c60831212d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:30.349915 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8801ca7-f51f-4058-9130-f9c60831212d admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:30.350203 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8801ca7-f51f-4058-9130-f9c60831212d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:30.350482 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8801ca7-f51f-4058-9130-f9c60831212d admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:30.351219 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8801ca7-f51f-4058-9130-f9c60831212d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:30.351705 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 406/819] 10.222.0.62 () {56 vars in 1272 bytes} [Tue Nov 23 19:16:30 2021] GET /identity/v3/endpoints?service_id=80f43322abb1466aae34998da0863ef1&interface=public®ion_id=RegionOne => generated 194 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:30.351880 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8801ca7-f51f-4058-9130-f9c60831212d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:30.353168 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8801ca7-f51f-4058-9130-f9c60831212d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:30.357200 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad06f1-46e0-45aa-9dc8-38f63c12a43f admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:30.366814 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 414/820] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:30.374347 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad06f1-46e0-45aa-9dc8-38f63c12a43f admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:30.374606 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8801ca7-f51f-4058-9130-f9c60831212d admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:30.385647 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c7acb-65ce-4eeb-9fe8-a7e9b82fdc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:30.386305 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c7acb-65ce-4eeb-9fe8-a7e9b82fdc89 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:30.386587 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c7acb-65ce-4eeb-9fe8-a7e9b82fdc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:30.386863 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c7acb-65ce-4eeb-9fe8-a7e9b82fdc89 admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:30.387558 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c7acb-65ce-4eeb-9fe8-a7e9b82fdc89 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:30.389906 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c7acb-65ce-4eeb-9fe8-a7e9b82fdc89 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:30.392415 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8801ca7-f51f-4058-9130-f9c60831212d admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:30.401786 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 407/821] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Nov 23 19:16:30 2021] GET /identity/v3/services => generated 772 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:30.403749 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddf97d-04ea-4ae9-b50a-2ba05d9db245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:30.405308 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddf97d-04ea-4ae9-b50a-2ba05d9db245 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:30.405654 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddf97d-04ea-4ae9-b50a-2ba05d9db245 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:30.405933 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddf97d-04ea-4ae9-b50a-2ba05d9db245 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:30.415011 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bddf97d-04ea-4ae9-b50a-2ba05d9db245 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:30.417091 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bddf97d-04ea-4ae9-b50a-2ba05d9db245 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:30.432375 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-5bddf97d-04ea-4ae9-b50a-2ba05d9db245 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 23 19:16:30.433901 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 415/822] 10.222.0.62 () {56 vars in 1114 bytes} [Tue Nov 23 19:16:30 2021] GET /identity/v3/users/nova => generated 82 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:30.442619 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c7acb-65ce-4eeb-9fe8-a7e9b82fdc89 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:30.458010 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c7acb-65ce-4eeb-9fe8-a7e9b82fdc89 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:30.470312 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add051ea-bbfd-431c-9d4f-5f052a01135f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:30.471027 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add051ea-bbfd-431c-9d4f-5f052a01135f admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:30.471312 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add051ea-bbfd-431c-9d4f-5f052a01135f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:30.471592 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add051ea-bbfd-431c-9d4f-5f052a01135f admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:30.472475 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add051ea-bbfd-431c-9d4f-5f052a01135f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:30.472792 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add051ea-bbfd-431c-9d4f-5f052a01135f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:30.474740 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add051ea-bbfd-431c-9d4f-5f052a01135f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:30.502192 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 408/823] 10.222.0.62 () {56 vars in 1154 bytes} [Tue Nov 23 19:16:30 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:30.508708 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddf97d-04ea-4ae9-b50a-2ba05d9db245 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:30.522924 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddf97d-04ea-4ae9-b50a-2ba05d9db245 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:30.533445 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679acb1-7e79-40af-8ad6-049dadfde2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:30.534169 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679acb1-7e79-40af-8ad6-049dadfde2ab admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:30.534460 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679acb1-7e79-40af-8ad6-049dadfde2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:30.534736 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679acb1-7e79-40af-8ad6-049dadfde2ab admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:30.550025 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679acb1-7e79-40af-8ad6-049dadfde2ab admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:30.551903 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679acb1-7e79-40af-8ad6-049dadfde2ab admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:30.566092 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 416/824] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:16:30 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:16:30.572863 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add051ea-bbfd-431c-9d4f-5f052a01135f admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:30.589369 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add051ea-bbfd-431c-9d4f-5f052a01135f admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:30.597400 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b13c9d-c836-4a2c-9a04-4752ef906a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:30.598256 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b13c9d-c836-4a2c-9a04-4752ef906a08 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:30.598539 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b13c9d-c836-4a2c-9a04-4752ef906a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:30.598816 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b13c9d-c836-4a2c-9a04-4752ef906a08 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:30.617435 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b13c9d-c836-4a2c-9a04-4752ef906a08 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:30.619272 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b13c9d-c836-4a2c-9a04-4752ef906a08 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:30.646686 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-19b13c9d-c836-4a2c-9a04-4752ef906a08 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:30.647886 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 409/825] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:30.654191 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679acb1-7e79-40af-8ad6-049dadfde2ab admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:30.664133 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679acb1-7e79-40af-8ad6-049dadfde2ab admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:30.669826 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88a512-bebb-4f3b-b2a3-e086f0e395b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:30.671067 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88a512-bebb-4f3b-b2a3-e086f0e395b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:30.671351 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88a512-bebb-4f3b-b2a3-e086f0e395b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:30.671674 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88a512-bebb-4f3b-b2a3-e086f0e395b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:30.672410 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88a512-bebb-4f3b-b2a3-e086f0e395b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:30.672714 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88a512-bebb-4f3b-b2a3-e086f0e395b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:30.674307 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88a512-bebb-4f3b-b2a3-e086f0e395b2 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:30.690093 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 417/826] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:30.695949 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b13c9d-c836-4a2c-9a04-4752ef906a08 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:30.706763 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b13c9d-c836-4a2c-9a04-4752ef906a08 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:30.713710 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6460b6-2fb7-44ba-a124-28494e48a75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:30.714535 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6460b6-2fb7-44ba-a124-28494e48a75d admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:30.714822 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6460b6-2fb7-44ba-a124-28494e48a75d admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:30.715094 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6460b6-2fb7-44ba-a124-28494e48a75d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:30.722671 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6460b6-2fb7-44ba-a124-28494e48a75d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:30.724602 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6460b6-2fb7-44ba-a124-28494e48a75d admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:30.740156 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-aa6460b6-2fb7-44ba-a124-28494e48a75d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:16:30.741602 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 410/827] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:30 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:30.748643 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88a512-bebb-4f3b-b2a3-e086f0e395b2 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:30.762609 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88a512-bebb-4f3b-b2a3-e086f0e395b2 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:30.769523 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d88475-0acb-4e0e-9ee5-025a98d81c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:30.770236 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d88475-0acb-4e0e-9ee5-025a98d81c3b admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:30.770520 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d88475-0acb-4e0e-9ee5-025a98d81c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:30.770796 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d88475-0acb-4e0e-9ee5-025a98d81c3b admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:30.771657 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d88475-0acb-4e0e-9ee5-025a98d81c3b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:30.771971 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d88475-0acb-4e0e-9ee5-025a98d81c3b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:30.773946 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d88475-0acb-4e0e-9ee5-025a98d81c3b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:30.793025 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 418/828] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:16:30 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:30.799850 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6460b6-2fb7-44ba-a124-28494e48a75d admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:30.811637 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6460b6-2fb7-44ba-a124-28494e48a75d admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:30.821889 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b67c4-8f81-4336-9783-e31ddafa4f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:30.822583 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b67c4-8f81-4336-9783-e31ddafa4f07 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:30.822864 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b67c4-8f81-4336-9783-e31ddafa4f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:30.823137 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b67c4-8f81-4336-9783-e31ddafa4f07 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:30.824033 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b67c4-8f81-4336-9783-e31ddafa4f07 admin admin] RBAC: Adding query filter params (role.id=6d9a8878ffeb49fea19d854657c6b767, scope.project.id=2955b3037801465c9eec5d78fe2e3ae9, user.id=6d91fe7f996b48b0bc28e1eadc4f8869) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:30.824341 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b67c4-8f81-4336-9783-e31ddafa4f07 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:30.826284 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b67c4-8f81-4336-9783-e31ddafa4f07 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:30.832962 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 411/829] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:16:30 2021] GET /identity/v3/role_assignments?user.id=6d91fe7f996b48b0bc28e1eadc4f8869&scope.project.id=2955b3037801465c9eec5d78fe2e3ae9&role.id=6d9a8878ffeb49fea19d854657c6b767 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:31.300007 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d771f-10aa-4f10-992c-81505a115fe9 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:31.300654 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d771f-10aa-4f10-992c-81505a115fe9 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:31.301142 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d771f-10aa-4f10-992c-81505a115fe9 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:31.303430 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 419/830] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:31.309276 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da326537-5eed-4513-a364-6356c486eede None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:31.309608 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da326537-5eed-4513-a364-6356c486eede None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:31.309887 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da326537-5eed-4513-a364-6356c486eede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:31.329306 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-da326537-5eed-4513-a364-6356c486eede None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:31.330564 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-da326537-5eed-4513-a364-6356c486eede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:31.345065 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 412/831] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:31 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:16:31.370192 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d771f-10aa-4f10-992c-81505a115fe9 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:31.387234 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d771f-10aa-4f10-992c-81505a115fe9 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:31.396486 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e5d99-9cd7-4c57-aebc-d2f94669ab88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:31.397290 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e5d99-9cd7-4c57-aebc-d2f94669ab88 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:31.397596 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e5d99-9cd7-4c57-aebc-d2f94669ab88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:31.397869 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e5d99-9cd7-4c57-aebc-d2f94669ab88 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:31.418580 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e5d99-9cd7-4c57-aebc-d2f94669ab88 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:31.426413 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-9a2e5d99-9cd7-4c57-aebc-d2f94669ab88 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 19:16:31.427977 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 420/832] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:16:31 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:31.434155 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da326537-5eed-4513-a364-6356c486eede None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:31.446289 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da326537-5eed-4513-a364-6356c486eede None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:31.458298 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab57a41-0c08-424e-bc98-e5e4be61bdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:31.458971 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab57a41-0c08-424e-bc98-e5e4be61bdc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:31.459256 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab57a41-0c08-424e-bc98-e5e4be61bdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:31.459530 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab57a41-0c08-424e-bc98-e5e4be61bdc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:31.460350 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab57a41-0c08-424e-bc98-e5e4be61bdc8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:31.460661 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab57a41-0c08-424e-bc98-e5e4be61bdc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:31.462320 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab57a41-0c08-424e-bc98-e5e4be61bdc8 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:31.472169 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 413/833] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:16:31 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:31.478391 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e5d99-9cd7-4c57-aebc-d2f94669ab88 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:31.494415 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e5d99-9cd7-4c57-aebc-d2f94669ab88 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:31.503074 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aebbcb5-539b-4060-b65a-a13e7699f679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:31.503867 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebbcb5-539b-4060-b65a-a13e7699f679 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:31.504147 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebbcb5-539b-4060-b65a-a13e7699f679 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:31.504426 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebbcb5-539b-4060-b65a-a13e7699f679 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:31.525205 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aebbcb5-539b-4060-b65a-a13e7699f679 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:31.527078 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aebbcb5-539b-4060-b65a-a13e7699f679 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:31.553648 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-6aebbcb5-539b-4060-b65a-a13e7699f679 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:31.555073 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 421/834] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:31.560896 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab57a41-0c08-424e-bc98-e5e4be61bdc8 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:31.575924 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab57a41-0c08-424e-bc98-e5e4be61bdc8 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:31.591231 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba87c0-316f-4a26-b422-e4cb9e1eae91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:31.592805 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba87c0-316f-4a26-b422-e4cb9e1eae91 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:31.593242 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba87c0-316f-4a26-b422-e4cb9e1eae91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:31.593694 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba87c0-316f-4a26-b422-e4cb9e1eae91 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:31.594612 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba87c0-316f-4a26-b422-e4cb9e1eae91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:31.595089 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba87c0-316f-4a26-b422-e4cb9e1eae91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:31.596881 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba87c0-316f-4a26-b422-e4cb9e1eae91 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:31.614804 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 414/835] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:31.620828 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aebbcb5-539b-4060-b65a-a13e7699f679 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:31.634862 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aebbcb5-539b-4060-b65a-a13e7699f679 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:31.645774 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45f364-d712-477d-9158-08b2fe8b6a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:31.646617 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45f364-d712-477d-9158-08b2fe8b6a85 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:31.646900 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45f364-d712-477d-9158-08b2fe8b6a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:31.647175 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45f364-d712-477d-9158-08b2fe8b6a85 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:31.659469 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45f364-d712-477d-9158-08b2fe8b6a85 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:31.661545 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45f364-d712-477d-9158-08b2fe8b6a85 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:31.682009 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-fe45f364-d712-477d-9158-08b2fe8b6a85 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 23 19:16:31.683488 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 422/836] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:16:31 2021] GET /identity/v3/users/swift => generated 83 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:31.689515 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba87c0-316f-4a26-b422-e4cb9e1eae91 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:31.703741 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba87c0-316f-4a26-b422-e4cb9e1eae91 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:31.713994 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb2a12-67fb-4abf-adb0-e065da00c5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:31.714824 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb2a12-67fb-4abf-adb0-e065da00c5fd admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:31.715277 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb2a12-67fb-4abf-adb0-e065da00c5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:31.715699 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb2a12-67fb-4abf-adb0-e065da00c5fd admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:31.716690 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb2a12-67fb-4abf-adb0-e065da00c5fd admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:31.717756 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb2a12-67fb-4abf-adb0-e065da00c5fd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:31.719801 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb2a12-67fb-4abf-adb0-e065da00c5fd admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:31.743829 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 415/837] 10.222.0.62 () {56 vars in 1156 bytes} [Tue Nov 23 19:16:31 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:31.750080 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45f364-d712-477d-9158-08b2fe8b6a85 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:31.763085 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45f364-d712-477d-9158-08b2fe8b6a85 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:31.773247 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f71b4c-7165-4020-a7cf-6994c035d1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:31.774119 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f71b4c-7165-4020-a7cf-6994c035d1b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:31.774495 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f71b4c-7165-4020-a7cf-6994c035d1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:31.774770 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f71b4c-7165-4020-a7cf-6994c035d1b5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:31.791058 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f71b4c-7165-4020-a7cf-6994c035d1b5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:31.792879 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f71b4c-7165-4020-a7cf-6994c035d1b5 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:31.799460 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a985349-a948-413d-b219-d7fda521f6cf None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:31.800101 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a985349-a948-413d-b219-d7fda521f6cf None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:31.800589 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a985349-a948-413d-b219-d7fda521f6cf None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:31.804196 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 416/838] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:31 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:31.814838 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae42b53-2272-493b-8a07-7257f91baaed None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:31.815129 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae42b53-2272-493b-8a07-7257f91baaed None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:31.815410 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae42b53-2272-493b-8a07-7257f91baaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:31.817764 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-80f71b4c-7165-4020-a7cf-6994c035d1b5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:31.819221 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 423/839] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:31.834430 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f71b4c-7165-4020-a7cf-6994c035d1b5 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:31.841468 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-3ae42b53-2272-493b-8a07-7257f91baaed None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:31.843245 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-3ae42b53-2272-493b-8a07-7257f91baaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:31.853320 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f71b4c-7165-4020-a7cf-6994c035d1b5 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:31.858123 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 417/840] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:31 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:16:31.868620 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c8587-f8ab-4b78-9098-4c4ff181c1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:31.869290 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c8587-f8ab-4b78-9098-4c4ff181c1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:31.869642 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c8587-f8ab-4b78-9098-4c4ff181c1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:31.869916 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c8587-f8ab-4b78-9098-4c4ff181c1a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:31.870718 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c8587-f8ab-4b78-9098-4c4ff181c1a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:31.871021 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c8587-f8ab-4b78-9098-4c4ff181c1a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:31.872763 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c8587-f8ab-4b78-9098-4c4ff181c1a9 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:31.881328 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae42b53-2272-493b-8a07-7257f91baaed None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:31.893988 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae42b53-2272-493b-8a07-7257f91baaed None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:31.901222 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410736d-e4af-43c7-95df-bd05b62615b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:31.903504 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 424/841] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:31.904085 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410736d-e4af-43c7-95df-bd05b62615b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:31.904450 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410736d-e4af-43c7-95df-bd05b62615b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:31.904793 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410736d-e4af-43c7-95df-bd05b62615b7 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:31.905490 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410736d-e4af-43c7-95df-bd05b62615b7 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:31.907129 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410736d-e4af-43c7-95df-bd05b62615b7 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:31.913500 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c8587-f8ab-4b78-9098-4c4ff181c1a9 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:31.932710 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c8587-f8ab-4b78-9098-4c4ff181c1a9 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:31.937739 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-d410736d-e4af-43c7-95df-bd05b62615b7 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 23 19:16:31.939351 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 418/842] 10.222.0.62 () {56 vars in 1150 bytes} [Tue Nov 23 19:16:31 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:31.943072 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b653f9-980c-4873-8981-922b29432d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:31.943932 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b653f9-980c-4873-8981-922b29432d1d admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:31.944296 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b653f9-980c-4873-8981-922b29432d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:31.944576 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b653f9-980c-4873-8981-922b29432d1d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:31.950669 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410736d-e4af-43c7-95df-bd05b62615b7 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:31.953595 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b653f9-980c-4873-8981-922b29432d1d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:31.955644 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b653f9-980c-4873-8981-922b29432d1d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:31.970166 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-19b653f9-980c-4873-8981-922b29432d1d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:16:31.971679 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 425/843] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:31.971863 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410736d-e4af-43c7-95df-bd05b62615b7 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:31.981281 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b6149-db55-4797-9d53-c9926086555c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:31.981575 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b653f9-980c-4873-8981-922b29432d1d admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:31.981969 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b6149-db55-4797-9d53-c9926086555c admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:31.982253 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b6149-db55-4797-9d53-c9926086555c admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:31.983172 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b6149-db55-4797-9d53-c9926086555c admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:31.983926 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b6149-db55-4797-9d53-c9926086555c admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:31.984233 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b6149-db55-4797-9d53-c9926086555c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:31.985828 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b6149-db55-4797-9d53-c9926086555c admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:31.991189 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 419/844] 10.222.0.62 () {56 vars in 1145 bytes} [Tue Nov 23 19:16:31 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:32.002095 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b653f9-980c-4873-8981-922b29432d1d admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:32.002306 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b6149-db55-4797-9d53-c9926086555c admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:32.004976 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b21880-a706-4f91-8651-e7abbcf26d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:32.005665 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b21880-a706-4f91-8651-e7abbcf26d56 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:32.005949 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b21880-a706-4f91-8651-e7abbcf26d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:32.006227 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b21880-a706-4f91-8651-e7abbcf26d56 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:32.007020 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b21880-a706-4f91-8651-e7abbcf26d56 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:32.007329 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b21880-a706-4f91-8651-e7abbcf26d56 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:32.009170 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b21880-a706-4f91-8651-e7abbcf26d56 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:32.022206 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b6149-db55-4797-9d53-c9926086555c admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:32.030984 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 426/845] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:16:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:32.032139 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5ec64-7b09-4be0-941a-4e4c5b48176f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:32.032835 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5ec64-7b09-4be0-941a-4e4c5b48176f admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:32.033119 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5ec64-7b09-4be0-941a-4e4c5b48176f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:32.033396 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5ec64-7b09-4be0-941a-4e4c5b48176f admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:32.034134 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5ec64-7b09-4be0-941a-4e4c5b48176f admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:32.034445 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5ec64-7b09-4be0-941a-4e4c5b48176f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:32.036184 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5ec64-7b09-4be0-941a-4e4c5b48176f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:32.038347 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b21880-a706-4f91-8651-e7abbcf26d56 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:32.050244 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 420/846] 10.222.0.62 () {56 vars in 1145 bytes} [Tue Nov 23 19:16:31 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:32.052578 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b21880-a706-4f91-8651-e7abbcf26d56 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:32.058447 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5ec64-7b09-4be0-941a-4e4c5b48176f admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:32.064390 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ad383-d5c9-4c0f-a774-b07f34c20c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:32.065291 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ad383-d5c9-4c0f-a774-b07f34c20c2f admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:32.065596 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ad383-d5c9-4c0f-a774-b07f34c20c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:32.065864 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ad383-d5c9-4c0f-a774-b07f34c20c2f admin admin] PATH_INFO: `/v3/projects/2955b3037801465c9eec5d78fe2e3ae9/users/87b6ed93587a4c87ad5002fc80b985c9/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:32.070029 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ad383-d5c9-4c0f-a774-b07f34c20c2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2955b3037801465c9eec5d78fe2e3ae9, user_id=87b6ed93587a4c87ad5002fc80b985c9, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:32.072892 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ad383-d5c9-4c0f-a774-b07f34c20c2f admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:32.078703 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5ec64-7b09-4be0-941a-4e4c5b48176f admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:32.084494 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ecbd0-708e-4adc-87aa-fe109e7a5253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:32.085170 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ecbd0-708e-4adc-87aa-fe109e7a5253 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:32.085481 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ecbd0-708e-4adc-87aa-fe109e7a5253 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:32.085758 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ecbd0-708e-4adc-87aa-fe109e7a5253 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:32.086607 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637ecbd0-708e-4adc-87aa-fe109e7a5253 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:32.087602 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING py.warnings [None req-637ecbd0-708e-4adc-87aa-fe109e7a5253 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:16:32.087602 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: warnings.warn(msg) Nov 23 19:16:32.087602 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: Nov 23 19:16:32.088516 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637ecbd0-708e-4adc-87aa-fe109e7a5253 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:32.153314 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 427/847] 10.222.0.62 () {58 vars in 1460 bytes} [Tue Nov 23 19:16:32 2021] PUT /identity/v3/projects/2955b3037801465c9eec5d78fe2e3ae9/users/87b6ed93587a4c87ad5002fc80b985c9/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:16:32.185382 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 421/848] 10.222.0.62 () {60 vars in 1165 bytes} [Tue Nov 23 19:16:32 2021] POST /identity/v3/endpoints => generated 346 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:16:32.813712 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a95608-4778-4130-84ca-75b9bd6a498d None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:32.814264 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a95608-4778-4130-84ca-75b9bd6a498d None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:32.814264 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a95608-4778-4130-84ca-75b9bd6a498d None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:32.816023 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 428/849] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:32.823960 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc02f33-7d8a-49f6-a460-2188a96de894 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:32.823960 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc02f33-7d8a-49f6-a460-2188a96de894 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:32.823960 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc02f33-7d8a-49f6-a460-2188a96de894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:32.849535 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-fcc02f33-7d8a-49f6-a460-2188a96de894 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:32.851070 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-fcc02f33-7d8a-49f6-a460-2188a96de894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:32.955064 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 422/850] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:32 2021] POST /identity/v3/auth/tokens => generated 1303 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:16:32.991390 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a95608-4778-4130-84ca-75b9bd6a498d None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:33.011308 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a95608-4778-4130-84ca-75b9bd6a498d None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:33.021855 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f1aeb-4f76-4370-8912-1f68cb9f1aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:33.022664 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f1aeb-4f76-4370-8912-1f68cb9f1aff admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:33.022946 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f1aeb-4f76-4370-8912-1f68cb9f1aff admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:33.023215 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f1aeb-4f76-4370-8912-1f68cb9f1aff admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:33.047177 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6f1aeb-4f76-4370-8912-1f68cb9f1aff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:33.054420 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-2b6f1aeb-4f76-4370-8912-1f68cb9f1aff admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 19:16:33.056009 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 429/851] 10.222.0.62 () {56 vars in 1123 bytes} [Tue Nov 23 19:16:32 2021] GET /identity/v3/roles/service => generated 85 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:33.062875 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc02f33-7d8a-49f6-a460-2188a96de894 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:33.079860 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc02f33-7d8a-49f6-a460-2188a96de894 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:33.090095 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3976111-7434-492d-a878-d80e58d1e0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:33.090803 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3976111-7434-492d-a878-d80e58d1e0da admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:33.091090 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3976111-7434-492d-a878-d80e58d1e0da admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:33.091366 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3976111-7434-492d-a878-d80e58d1e0da admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:33.092696 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3976111-7434-492d-a878-d80e58d1e0da admin admin] RBAC: Adding query filter params (name=service) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:33.093114 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3976111-7434-492d-a878-d80e58d1e0da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:33.094792 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3976111-7434-492d-a878-d80e58d1e0da admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:33.109085 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 423/852] 10.222.0.62 () {56 vars in 1124 bytes} [Tue Nov 23 19:16:33 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:33.114697 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f1aeb-4f76-4370-8912-1f68cb9f1aff admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:33.130363 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f1aeb-4f76-4370-8912-1f68cb9f1aff admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:33.137591 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c42681-3605-477c-8695-403fbf959d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:33.138375 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c42681-3605-477c-8695-403fbf959d5b admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:33.138674 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c42681-3605-477c-8695-403fbf959d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:33.138959 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c42681-3605-477c-8695-403fbf959d5b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:33.161110 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c42681-3605-477c-8695-403fbf959d5b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:33.162965 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c42681-3605-477c-8695-403fbf959d5b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:33.192182 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-17c42681-3605-477c-8695-403fbf959d5b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:33.193632 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 430/853] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:33.199865 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3976111-7434-492d-a878-d80e58d1e0da admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:33.219109 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3976111-7434-492d-a878-d80e58d1e0da admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:33.228139 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7725a-7f75-455d-ae85-9e68e471938f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:33.228861 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7725a-7f75-455d-ae85-9e68e471938f admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:33.229146 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7725a-7f75-455d-ae85-9e68e471938f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:33.229438 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7725a-7f75-455d-ae85-9e68e471938f admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:33.230247 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7725a-7f75-455d-ae85-9e68e471938f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:33.230554 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7725a-7f75-455d-ae85-9e68e471938f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:33.232183 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7725a-7f75-455d-ae85-9e68e471938f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:33.251644 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 424/854] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:33.258050 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c42681-3605-477c-8695-403fbf959d5b admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:33.267958 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c42681-3605-477c-8695-403fbf959d5b admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:33.275854 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d6879-2584-4a5d-934a-58a88020d349 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:33.276435 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d6879-2584-4a5d-934a-58a88020d349 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:33.276954 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d6879-2584-4a5d-934a-58a88020d349 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:33.285454 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 425/855] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:33 2021] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:33.290130 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a420f75-dbec-40ab-a386-1c1873c99d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:33.291022 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a420f75-dbec-40ab-a386-1c1873c99d9b admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:33.291304 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a420f75-dbec-40ab-a386-1c1873c99d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:33.291582 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a420f75-dbec-40ab-a386-1c1873c99d9b admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:33.297743 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54c77b-dd44-4fef-bac6-d3b34c275e24 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:33.298035 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54c77b-dd44-4fef-bac6-d3b34c275e24 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:33.298368 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54c77b-dd44-4fef-bac6-d3b34c275e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:33.307403 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a420f75-dbec-40ab-a386-1c1873c99d9b admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:33.310616 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a420f75-dbec-40ab-a386-1c1873c99d9b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:33.324153 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-ae54c77b-dd44-4fef-bac6-d3b34c275e24 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:33.325338 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-ae54c77b-dd44-4fef-bac6-d3b34c275e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:33.333785 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-2a420f75-dbec-40ab-a386-1c1873c99d9b admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 23 19:16:33.335249 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 431/857] 10.222.0.62 () {56 vars in 1138 bytes} [Tue Nov 23 19:16:33 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:33.339957 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 426/857] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:33 2021] POST /identity/v3/auth/tokens => generated 1303 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:16:33.340947 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a420f75-dbec-40ab-a386-1c1873c99d9b admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:33.355874 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a420f75-dbec-40ab-a386-1c1873c99d9b admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:33.361689 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484dbfc-1413-4b52-903c-af6c60d53885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:33.362415 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484dbfc-1413-4b52-903c-af6c60d53885 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:33.362697 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484dbfc-1413-4b52-903c-af6c60d53885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:33.362974 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484dbfc-1413-4b52-903c-af6c60d53885 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:33.363884 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c484dbfc-1413-4b52-903c-af6c60d53885 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:33.364192 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c484dbfc-1413-4b52-903c-af6c60d53885 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:33.366167 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c484dbfc-1413-4b52-903c-af6c60d53885 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:33.376877 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54c77b-dd44-4fef-bac6-d3b34c275e24 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:33.386772 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54c77b-dd44-4fef-bac6-d3b34c275e24 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:33.397771 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968b951-91f6-49ec-bfa0-870e4c5adaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:33.398620 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968b951-91f6-49ec-bfa0-870e4c5adaf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:33.398903 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968b951-91f6-49ec-bfa0-870e4c5adaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:33.399179 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968b951-91f6-49ec-bfa0-870e4c5adaf4 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:33.399909 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8968b951-91f6-49ec-bfa0-870e4c5adaf4 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:33.402022 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8968b951-91f6-49ec-bfa0-870e4c5adaf4 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:33.409303 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 432/858] 10.222.0.62 () {56 vars in 1170 bytes} [Tue Nov 23 19:16:33 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:33.415788 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484dbfc-1413-4b52-903c-af6c60d53885 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:33.426600 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-8968b951-91f6-49ec-bfa0-870e4c5adaf4 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 23 19:16:33.431339 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484dbfc-1413-4b52-903c-af6c60d53885 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:33.431984 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 427/859] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:33 2021] GET /identity/v3/services/network => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:33.435072 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968b951-91f6-49ec-bfa0-870e4c5adaf4 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:33.438683 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c9fa2-3677-4805-bc07-67f051ba6a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:33.439334 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c9fa2-3677-4805-bc07-67f051ba6a11 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:33.439677 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c9fa2-3677-4805-bc07-67f051ba6a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:33.439951 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c9fa2-3677-4805-bc07-67f051ba6a11 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:33.445850 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968b951-91f6-49ec-bfa0-870e4c5adaf4 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:33.455693 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c9fa2-3677-4805-bc07-67f051ba6a11 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:33.458056 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c9fa2-3677-4805-bc07-67f051ba6a11 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:33.460036 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999703c3-0869-49d2-9b58-8403ce50d9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:33.460699 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999703c3-0869-49d2-9b58-8403ce50d9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:33.460975 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999703c3-0869-49d2-9b58-8403ce50d9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:33.461299 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999703c3-0869-49d2-9b58-8403ce50d9f1 admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:33.462045 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999703c3-0869-49d2-9b58-8403ce50d9f1 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:33.463987 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999703c3-0869-49d2-9b58-8403ce50d9f1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:33.468231 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999703c3-0869-49d2-9b58-8403ce50d9f1 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:33.476732 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 433/860] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:16:33 2021] GET /identity/v3/auth/tokens => generated 1303 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:16:33.478210 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 428/861] 10.222.0.62 () {56 vars in 1133 bytes} [Tue Nov 23 19:16:33 2021] GET /identity/v3/services?name=network => generated 124 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:33.483927 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c9fa2-3677-4805-bc07-67f051ba6a11 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:33.488708 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999703c3-0869-49d2-9b58-8403ce50d9f1 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:33.495450 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c9fa2-3677-4805-bc07-67f051ba6a11 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:33.505159 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999703c3-0869-49d2-9b58-8403ce50d9f1 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:33.507463 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69de2af-9fc3-4b54-9d4f-f8a0b8682644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:33.508295 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69de2af-9fc3-4b54-9d4f-f8a0b8682644 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:33.508575 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69de2af-9fc3-4b54-9d4f-f8a0b8682644 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:33.508903 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69de2af-9fc3-4b54-9d4f-f8a0b8682644 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:33.519428 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e5831-f594-4677-8f76-243975dc7942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:33.520128 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e5831-f594-4677-8f76-243975dc7942 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:33.520414 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e5831-f594-4677-8f76-243975dc7942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:33.520690 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e5831-f594-4677-8f76-243975dc7942 admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:33.522572 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e5831-f594-4677-8f76-243975dc7942 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:33.522888 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e5831-f594-4677-8f76-243975dc7942 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:33.525690 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e5831-f594-4677-8f76-243975dc7942 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:33.527954 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69de2af-9fc3-4b54-9d4f-f8a0b8682644 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:33.531671 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69de2af-9fc3-4b54-9d4f-f8a0b8682644 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:33.538502 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 429/862] 10.222.0.62 () {56 vars in 1133 bytes} [Tue Nov 23 19:16:33 2021] GET /identity/v3/services?type=network => generated 350 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:33.549290 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e5831-f594-4677-8f76-243975dc7942 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:33.564826 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e5831-f594-4677-8f76-243975dc7942 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:33.568443 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-c69de2af-9fc3-4b54-9d4f-f8a0b8682644 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:33.569562 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308a461-a20a-420e-a63c-4a14b831d11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:33.569888 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 434/863] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:33.570256 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308a461-a20a-420e-a63c-4a14b831d11c admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:33.570539 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308a461-a20a-420e-a63c-4a14b831d11c admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:33.570867 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308a461-a20a-420e-a63c-4a14b831d11c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:33.571955 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308a461-a20a-420e-a63c-4a14b831d11c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:33.573662 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308a461-a20a-420e-a63c-4a14b831d11c admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:33.575931 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69de2af-9fc3-4b54-9d4f-f8a0b8682644 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:33.587622 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69de2af-9fc3-4b54-9d4f-f8a0b8682644 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:33.593064 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38b07c-b38e-4a09-aa29-8e1d4a4f62a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:33.593786 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38b07c-b38e-4a09-aa29-8e1d4a4f62a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:33.594074 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38b07c-b38e-4a09-aa29-8e1d4a4f62a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:33.594350 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38b07c-b38e-4a09-aa29-8e1d4a4f62a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:33.595139 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38b07c-b38e-4a09-aa29-8e1d4a4f62a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:33.595449 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38b07c-b38e-4a09-aa29-8e1d4a4f62a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:33.597102 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38b07c-b38e-4a09-aa29-8e1d4a4f62a0 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:33.610171 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 435/864] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:33.615747 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38b07c-b38e-4a09-aa29-8e1d4a4f62a0 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:33.626350 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38b07c-b38e-4a09-aa29-8e1d4a4f62a0 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:33.631053 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1491572-fe54-4753-9cdc-a96af3a418ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:33.631903 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1491572-fe54-4753-9cdc-a96af3a418ac admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:33.632175 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1491572-fe54-4753-9cdc-a96af3a418ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:33.632447 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1491572-fe54-4753-9cdc-a96af3a418ac admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:33.640786 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1491572-fe54-4753-9cdc-a96af3a418ac admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:33.643076 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1491572-fe54-4753-9cdc-a96af3a418ac admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:33.659567 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-c1491572-fe54-4753-9cdc-a96af3a418ac admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:16:33.661260 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 436/865] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:33 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:33.667892 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1491572-fe54-4753-9cdc-a96af3a418ac admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:33.681526 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1491572-fe54-4753-9cdc-a96af3a418ac admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:33.686792 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fab487-63d5-4e1d-b727-bff9373fcaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:33.687649 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fab487-63d5-4e1d-b727-bff9373fcaa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:33.688097 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fab487-63d5-4e1d-b727-bff9373fcaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:33.688524 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fab487-63d5-4e1d-b727-bff9373fcaa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:33.689503 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fab487-63d5-4e1d-b727-bff9373fcaa2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:33.690045 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fab487-63d5-4e1d-b727-bff9373fcaa2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:33.692121 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fab487-63d5-4e1d-b727-bff9373fcaa2 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:33.707933 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 437/866] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:16:33 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:33.713610 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 430/867] 10.222.0.62 () {60 vars in 1165 bytes} [Tue Nov 23 19:16:33 2021] POST /identity/v3/endpoints => generated 327 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:16:33.715359 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fab487-63d5-4e1d-b727-bff9373fcaa2 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:33.727464 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fab487-63d5-4e1d-b727-bff9373fcaa2 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:33.744134 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa07579-86eb-4753-a3fa-26369df92180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:33.745121 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa07579-86eb-4753-a3fa-26369df92180 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:33.745642 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa07579-86eb-4753-a3fa-26369df92180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:33.746055 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa07579-86eb-4753-a3fa-26369df92180 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:33.747110 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa07579-86eb-4753-a3fa-26369df92180 admin admin] RBAC: Adding query filter params (role.id=e68dc60061bd41dc894e1be26b4d5027, scope.project.id=2955b3037801465c9eec5d78fe2e3ae9, user.id=abc393885c6c4cf6bd4dd52f698fc38c) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:33.747584 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa07579-86eb-4753-a3fa-26369df92180 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:33.750772 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa07579-86eb-4753-a3fa-26369df92180 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:33.758558 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 438/868] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:16:33 2021] GET /identity/v3/role_assignments?user.id=abc393885c6c4cf6bd4dd52f698fc38c&scope.project.id=2955b3037801465c9eec5d78fe2e3ae9&role.id=e68dc60061bd41dc894e1be26b4d5027 => generated 608 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:33.908532 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05581574-d4d3-42ed-b9c0-135c8f7a4f40 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:33.909042 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05581574-d4d3-42ed-b9c0-135c8f7a4f40 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:33.909042 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05581574-d4d3-42ed-b9c0-135c8f7a4f40 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:33.911137 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 431/869] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:33.917567 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe38f61-cfd7-4e19-9f03-716a0b4a25a1 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:33.918563 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe38f61-cfd7-4e19-9f03-716a0b4a25a1 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:33.919056 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe38f61-cfd7-4e19-9f03-716a0b4a25a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:33.947150 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-3fe38f61-cfd7-4e19-9f03-716a0b4a25a1 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:33.948740 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-3fe38f61-cfd7-4e19-9f03-716a0b4a25a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:33.959484 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 439/870] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:33 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:16:33.983403 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05581574-d4d3-42ed-b9c0-135c8f7a4f40 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:34.010277 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05581574-d4d3-42ed-b9c0-135c8f7a4f40 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:34.015341 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eafea9-3187-475d-80df-45085319df09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:34.016182 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eafea9-3187-475d-80df-45085319df09 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:34.016469 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eafea9-3187-475d-80df-45085319df09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:34.016749 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eafea9-3187-475d-80df-45085319df09 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:34.017457 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eafea9-3187-475d-80df-45085319df09 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:34.019148 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eafea9-3187-475d-80df-45085319df09 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:34.038192 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-58eafea9-3187-475d-80df-45085319df09 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 23 19:16:34.040249 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 432/871] 10.222.0.62 () {56 vars in 1153 bytes} [Tue Nov 23 19:16:33 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:34.046134 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe38f61-cfd7-4e19-9f03-716a0b4a25a1 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:34.057828 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe38f61-cfd7-4e19-9f03-716a0b4a25a1 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:34.064036 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a447a4-4cff-462d-b704-da3185c5cc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:34.064828 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a447a4-4cff-462d-b704-da3185c5cc6f admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:34.065122 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a447a4-4cff-462d-b704-da3185c5cc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:34.065400 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a447a4-4cff-462d-b704-da3185c5cc6f admin admin] PATH_INFO: `/v3/services` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:34.066149 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a447a4-4cff-462d-b704-da3185c5cc6f admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:34.066458 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a447a4-4cff-462d-b704-da3185c5cc6f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:34.068039 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a447a4-4cff-462d-b704-da3185c5cc6f admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:34.075090 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 440/872] 10.222.0.62 () {56 vars in 1147 bytes} [Tue Nov 23 19:16:34 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:34.080848 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eafea9-3187-475d-80df-45085319df09 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:34.091430 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eafea9-3187-475d-80df-45085319df09 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:34.098365 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83caf05-5062-4178-b456-b749cb615573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:34.099066 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83caf05-5062-4178-b456-b749cb615573 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:34.099343 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83caf05-5062-4178-b456-b749cb615573 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:34.099665 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83caf05-5062-4178-b456-b749cb615573 admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:34.100385 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83caf05-5062-4178-b456-b749cb615573 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:34.100707 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83caf05-5062-4178-b456-b749cb615573 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:34.102299 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83caf05-5062-4178-b456-b749cb615573 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:34.111249 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 433/873] 10.222.0.62 () {56 vars in 1147 bytes} [Tue Nov 23 19:16:34 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:34.923866 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24874a-d684-4bb2-aa48-401874fa1d74 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:34.924396 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24874a-d684-4bb2-aa48-401874fa1d74 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:34.924396 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24874a-d684-4bb2-aa48-401874fa1d74 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:34.926577 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 441/874] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:34.932476 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb95a6-af83-4094-a845-70645af9dea2 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:34.932879 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb95a6-af83-4094-a845-70645af9dea2 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:34.933081 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb95a6-af83-4094-a845-70645af9dea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:34.943569 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8a968-eb1c-4e0f-999f-6d29e9d3836d None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:34.943947 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8a968-eb1c-4e0f-999f-6d29e9d3836d None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:34.944118 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8a968-eb1c-4e0f-999f-6d29e9d3836d None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:34.945912 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 442/875] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 19:16:34.951895 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-3dcb95a6-af83-4094-a845-70645af9dea2 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:34.952203 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9d288-9567-4743-b598-e742c5d3c830 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:34.952449 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9d288-9567-4743-b598-e742c5d3c830 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:34.952634 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9d288-9567-4743-b598-e742c5d3c830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:34.953068 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-3dcb95a6-af83-4094-a845-70645af9dea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:34.961814 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 434/876] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:34 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:16:34.972050 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-33a9d288-9567-4743-b598-e742c5d3c830 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:34.973237 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-33a9d288-9567-4743-b598-e742c5d3c830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:34.985495 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 443/877] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:34 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:16:34.986709 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb95a6-af83-4094-a845-70645af9dea2 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:34.996032 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb95a6-af83-4094-a845-70645af9dea2 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:35.001305 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df467c42-ae8c-41ce-acb0-07b65621f4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:35.005418 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df467c42-ae8c-41ce-acb0-07b65621f4ae admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:35.005418 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df467c42-ae8c-41ce-acb0-07b65621f4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:35.005418 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df467c42-ae8c-41ce-acb0-07b65621f4ae admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:35.005418 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df467c42-ae8c-41ce-acb0-07b65621f4ae admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:35.005418 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df467c42-ae8c-41ce-acb0-07b65621f4ae admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:35.011232 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9d288-9567-4743-b598-e742c5d3c830 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:35.017456 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-df467c42-ae8c-41ce-acb0-07b65621f4ae admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 23 19:16:35.019231 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 435/878] 10.222.0.62 () {56 vars in 1135 bytes} [Tue Nov 23 19:16:34 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:35.020583 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9d288-9567-4743-b598-e742c5d3c830 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:35.027409 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df467c42-ae8c-41ce-acb0-07b65621f4ae admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:35.031684 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23278e36-12a6-4853-8da0-bdb8d5426b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:35.032711 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23278e36-12a6-4853-8da0-bdb8d5426b9f admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:35.033213 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23278e36-12a6-4853-8da0-bdb8d5426b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:35.033720 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23278e36-12a6-4853-8da0-bdb8d5426b9f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:35.038686 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df467c42-ae8c-41ce-acb0-07b65621f4ae admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:35.049878 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a56eb-b333-421a-8cd5-d2c6fd626013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:35.050003 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23278e36-12a6-4853-8da0-bdb8d5426b9f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:35.050080 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a56eb-b333-421a-8cd5-d2c6fd626013 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:35.050080 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a56eb-b333-421a-8cd5-d2c6fd626013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:35.050080 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a56eb-b333-421a-8cd5-d2c6fd626013 admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:35.050080 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a56eb-b333-421a-8cd5-d2c6fd626013 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:35.050080 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a56eb-b333-421a-8cd5-d2c6fd626013 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:35.050080 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a56eb-b333-421a-8cd5-d2c6fd626013 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:35.052987 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-23278e36-12a6-4853-8da0-bdb8d5426b9f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 19:16:35.058323 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 436/879] 10.222.0.62 () {56 vars in 1135 bytes} [Tue Nov 23 19:16:35 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:35.058468 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 444/880] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:16:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:35.059710 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a56eb-b333-421a-8cd5-d2c6fd626013 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:35.065340 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23278e36-12a6-4853-8da0-bdb8d5426b9f admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:35.070741 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a56eb-b333-421a-8cd5-d2c6fd626013 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:35.075214 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23278e36-12a6-4853-8da0-bdb8d5426b9f admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:35.077859 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d665e-8841-401b-b9de-c71be3ef41ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:35.078974 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d665e-8841-401b-b9de-c71be3ef41ef admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:35.079606 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d665e-8841-401b-b9de-c71be3ef41ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:35.080135 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d665e-8841-401b-b9de-c71be3ef41ef admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:35.080340 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3f666-0a85-4887-9a5b-1dd7a6f8f76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:35.080986 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3f666-0a85-4887-9a5b-1dd7a6f8f76b admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:35.081255 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3f666-0a85-4887-9a5b-1dd7a6f8f76b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:35.081574 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3f666-0a85-4887-9a5b-1dd7a6f8f76b admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:35.081819 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d665e-8841-401b-b9de-c71be3ef41ef admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:35.082321 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3f666-0a85-4887-9a5b-1dd7a6f8f76b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:35.082544 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d665e-8841-401b-b9de-c71be3ef41ef admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:35.082648 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3f666-0a85-4887-9a5b-1dd7a6f8f76b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:35.084332 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3f666-0a85-4887-9a5b-1dd7a6f8f76b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:35.084593 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d665e-8841-401b-b9de-c71be3ef41ef admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:35.091119 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 437/881] 10.222.0.62 () {56 vars in 1135 bytes} [Tue Nov 23 19:16:35 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:35.096642 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 445/882] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:16:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:35.103890 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d665e-8841-401b-b9de-c71be3ef41ef admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:35.115104 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d665e-8841-401b-b9de-c71be3ef41ef admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:35.120146 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc182024-e3b6-445c-939c-75f190f51e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:35.121310 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc182024-e3b6-445c-939c-75f190f51e2d admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:35.121868 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc182024-e3b6-445c-939c-75f190f51e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:35.122325 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc182024-e3b6-445c-939c-75f190f51e2d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:35.135232 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc182024-e3b6-445c-939c-75f190f51e2d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:35.137387 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc182024-e3b6-445c-939c-75f190f51e2d admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:35.155743 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-cc182024-e3b6-445c-939c-75f190f51e2d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:35.157777 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 438/883] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:35.164691 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3f666-0a85-4887-9a5b-1dd7a6f8f76b admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:35.176416 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3f666-0a85-4887-9a5b-1dd7a6f8f76b admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:35.181469 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6862f9d-5870-415d-a7e0-97118067f6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:35.182469 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6862f9d-5870-415d-a7e0-97118067f6f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:35.182942 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6862f9d-5870-415d-a7e0-97118067f6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:35.183396 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6862f9d-5870-415d-a7e0-97118067f6f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:35.184335 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6862f9d-5870-415d-a7e0-97118067f6f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:35.184822 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6862f9d-5870-415d-a7e0-97118067f6f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:35.187414 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6862f9d-5870-415d-a7e0-97118067f6f1 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:35.200894 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 446/884] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:35.208192 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc182024-e3b6-445c-939c-75f190f51e2d admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:35.219229 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc182024-e3b6-445c-939c-75f190f51e2d admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:35.224405 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a36eb-2e65-4560-8e40-e5c42240ca84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:35.225600 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a36eb-2e65-4560-8e40-e5c42240ca84 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:35.226069 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a36eb-2e65-4560-8e40-e5c42240ca84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:35.226524 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a36eb-2e65-4560-8e40-e5c42240ca84 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:35.237286 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a36eb-2e65-4560-8e40-e5c42240ca84 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:35.239650 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a36eb-2e65-4560-8e40-e5c42240ca84 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:35.255482 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-6b6a36eb-2e65-4560-8e40-e5c42240ca84 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 23 19:16:35.257382 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 439/885] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:16:35 2021] GET /identity/v3/users/swift => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:35.264096 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6862f9d-5870-415d-a7e0-97118067f6f1 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:35.274809 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6862f9d-5870-415d-a7e0-97118067f6f1 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:35.280447 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85cd38-279a-4926-a674-6ff403e0fd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:35.281474 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85cd38-279a-4926-a674-6ff403e0fd1a admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:35.281943 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85cd38-279a-4926-a674-6ff403e0fd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:35.282393 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85cd38-279a-4926-a674-6ff403e0fd1a admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:35.283433 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb85cd38-279a-4926-a674-6ff403e0fd1a admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:35.283922 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb85cd38-279a-4926-a674-6ff403e0fd1a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:35.286009 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb85cd38-279a-4926-a674-6ff403e0fd1a admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:35.308401 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 447/886] 10.222.0.62 () {56 vars in 1156 bytes} [Tue Nov 23 19:16:35 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:35.314508 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a36eb-2e65-4560-8e40-e5c42240ca84 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:35.326666 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a36eb-2e65-4560-8e40-e5c42240ca84 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:35.331485 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71510d18-1b34-42df-8c73-949f0643fcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:35.332185 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71510d18-1b34-42df-8c73-949f0643fcc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:35.332462 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71510d18-1b34-42df-8c73-949f0643fcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:35.332730 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71510d18-1b34-42df-8c73-949f0643fcc3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:35.341344 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71510d18-1b34-42df-8c73-949f0643fcc3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:35.343961 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71510d18-1b34-42df-8c73-949f0643fcc3 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:35.354089 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 440/887] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:16:35 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:16:35.364135 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85cd38-279a-4926-a674-6ff403e0fd1a admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:35.374634 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85cd38-279a-4926-a674-6ff403e0fd1a admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:35.379372 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef9c42-940b-406f-bc56-85c476220f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:35.380221 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef9c42-940b-406f-bc56-85c476220f94 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:35.380510 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef9c42-940b-406f-bc56-85c476220f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:35.380837 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef9c42-940b-406f-bc56-85c476220f94 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:35.392713 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef9c42-940b-406f-bc56-85c476220f94 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:35.394598 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef9c42-940b-406f-bc56-85c476220f94 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:35.412336 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-43ef9c42-940b-406f-bc56-85c476220f94 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:35.417528 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 448/888] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:35.420728 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71510d18-1b34-42df-8c73-949f0643fcc3 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:35.429937 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71510d18-1b34-42df-8c73-949f0643fcc3 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:35.434516 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10601f-9f8e-4d7f-8fd6-d308039afaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:35.435171 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10601f-9f8e-4d7f-8fd6-d308039afaa5 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:35.435455 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10601f-9f8e-4d7f-8fd6-d308039afaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:35.435787 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10601f-9f8e-4d7f-8fd6-d308039afaa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:35.436522 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10601f-9f8e-4d7f-8fd6-d308039afaa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:35.436831 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10601f-9f8e-4d7f-8fd6-d308039afaa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:35.438425 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10601f-9f8e-4d7f-8fd6-d308039afaa5 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:35.451189 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 441/889] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:35.457646 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef9c42-940b-406f-bc56-85c476220f94 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:35.468216 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef9c42-940b-406f-bc56-85c476220f94 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:35.473132 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe816a4e-2327-401a-aafc-f206d5a2d0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:35.474241 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe816a4e-2327-401a-aafc-f206d5a2d0cf admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:35.474746 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe816a4e-2327-401a-aafc-f206d5a2d0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:35.475305 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe816a4e-2327-401a-aafc-f206d5a2d0cf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:35.483571 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe816a4e-2327-401a-aafc-f206d5a2d0cf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:35.485886 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe816a4e-2327-401a-aafc-f206d5a2d0cf admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:35.499720 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-fe816a4e-2327-401a-aafc-f206d5a2d0cf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:16:35.505546 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 449/890] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:35.508233 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10601f-9f8e-4d7f-8fd6-d308039afaa5 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:35.518631 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10601f-9f8e-4d7f-8fd6-d308039afaa5 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:35.523728 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c722967-9cdf-4abc-ae73-cf9d126ac728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:35.524652 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c722967-9cdf-4abc-ae73-cf9d126ac728 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:35.525149 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c722967-9cdf-4abc-ae73-cf9d126ac728 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:35.525649 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c722967-9cdf-4abc-ae73-cf9d126ac728 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:35.526692 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c722967-9cdf-4abc-ae73-cf9d126ac728 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:35.527200 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c722967-9cdf-4abc-ae73-cf9d126ac728 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:35.529342 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c722967-9cdf-4abc-ae73-cf9d126ac728 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:35.547248 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 442/891] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:16:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:35.554323 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe816a4e-2327-401a-aafc-f206d5a2d0cf admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:35.565115 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe816a4e-2327-401a-aafc-f206d5a2d0cf admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:35.569958 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0935596-2426-4929-be1d-899975da52f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:35.570781 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0935596-2426-4929-be1d-899975da52f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:35.571208 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0935596-2426-4929-be1d-899975da52f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:35.571617 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0935596-2426-4929-be1d-899975da52f0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:35.572857 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0935596-2426-4929-be1d-899975da52f0 admin admin] RBAC: Adding query filter params (role.id=6d9a8878ffeb49fea19d854657c6b767, scope.project.id=2955b3037801465c9eec5d78fe2e3ae9, user.id=87b6ed93587a4c87ad5002fc80b985c9) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:35.573312 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0935596-2426-4929-be1d-899975da52f0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:35.575371 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0935596-2426-4929-be1d-899975da52f0 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:35.589541 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 450/892] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:16:35 2021] GET /identity/v3/role_assignments?user.id=87b6ed93587a4c87ad5002fc80b985c9&scope.project.id=2955b3037801465c9eec5d78fe2e3ae9&role.id=6d9a8878ffeb49fea19d854657c6b767 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:36.300052 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47229ad7-8e0d-484c-a95c-e5faf4e90f0e None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:36.300606 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47229ad7-8e0d-484c-a95c-e5faf4e90f0e None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:36.300606 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47229ad7-8e0d-484c-a95c-e5faf4e90f0e None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:36.302727 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 443/893] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:36.309153 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b873c-77af-40b3-9def-fb53bfb965bd None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:36.309693 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b873c-77af-40b3-9def-fb53bfb965bd None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:36.309792 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b873c-77af-40b3-9def-fb53bfb965bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:36.329671 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-041b873c-77af-40b3-9def-fb53bfb965bd None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:36.330889 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-041b873c-77af-40b3-9def-fb53bfb965bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:36.339160 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 451/894] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:36 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:16:36.364480 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47229ad7-8e0d-484c-a95c-e5faf4e90f0e None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:36.376991 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47229ad7-8e0d-484c-a95c-e5faf4e90f0e None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:36.381332 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d34a89-7847-4227-b13b-b156617f0d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:36.382162 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d34a89-7847-4227-b13b-b156617f0d7a admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:36.382441 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d34a89-7847-4227-b13b-b156617f0d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:36.382714 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d34a89-7847-4227-b13b-b156617f0d7a admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:36.394496 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d34a89-7847-4227-b13b-b156617f0d7a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:36.401935 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-08d34a89-7847-4227-b13b-b156617f0d7a admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 23 19:16:36.403415 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 444/895] 10.222.0.62 () {56 vars in 1141 bytes} [Tue Nov 23 19:16:36 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:36.410286 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b873c-77af-40b3-9def-fb53bfb965bd None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:36.419320 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b873c-77af-40b3-9def-fb53bfb965bd None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:36.424430 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324285f-1336-463a-817f-60b51f4ead1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:36.425089 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324285f-1336-463a-817f-60b51f4ead1c admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:36.425368 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324285f-1336-463a-817f-60b51f4ead1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:36.425671 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324285f-1336-463a-817f-60b51f4ead1c admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:36.426428 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324285f-1336-463a-817f-60b51f4ead1c admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:36.426734 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324285f-1336-463a-817f-60b51f4ead1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:36.428306 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324285f-1336-463a-817f-60b51f4ead1c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:36.437645 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 452/896] 10.222.0.62 () {56 vars in 1136 bytes} [Tue Nov 23 19:16:36 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:36.446595 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d34a89-7847-4227-b13b-b156617f0d7a admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:36.457740 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d34a89-7847-4227-b13b-b156617f0d7a admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:36.462446 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba148d2-9fc7-4737-8966-bbee1e23c0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:36.463278 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba148d2-9fc7-4737-8966-bbee1e23c0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:36.463562 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba148d2-9fc7-4737-8966-bbee1e23c0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:36.463834 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba148d2-9fc7-4737-8966-bbee1e23c0a9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:36.475170 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba148d2-9fc7-4737-8966-bbee1e23c0a9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:36.477052 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba148d2-9fc7-4737-8966-bbee1e23c0a9 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:36.495087 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-2ba148d2-9fc7-4737-8966-bbee1e23c0a9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:36.496273 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 445/897] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:36.503242 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324285f-1336-463a-817f-60b51f4ead1c admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:36.513147 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324285f-1336-463a-817f-60b51f4ead1c admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:36.514842 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd2636-be5c-47f5-9af6-e7a719c5c4c0 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:36.515141 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd2636-be5c-47f5-9af6-e7a719c5c4c0 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:36.515421 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd2636-be5c-47f5-9af6-e7a719c5c4c0 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:36.517661 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 446/898] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 19:16:36.518023 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a20cc-af3c-40f4-83dd-fd7e95ca43a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:36.518719 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a20cc-af3c-40f4-83dd-fd7e95ca43a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:36.519005 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a20cc-af3c-40f4-83dd-fd7e95ca43a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:36.519282 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a20cc-af3c-40f4-83dd-fd7e95ca43a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:36.520072 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a20cc-af3c-40f4-83dd-fd7e95ca43a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:36.520380 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a20cc-af3c-40f4-83dd-fd7e95ca43a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:36.522052 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a20cc-af3c-40f4-83dd-fd7e95ca43a6 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:36.523130 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be951cf-e0f7-42ac-8273-55652732f400 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:36.523619 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be951cf-e0f7-42ac-8273-55652732f400 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:36.523919 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be951cf-e0f7-42ac-8273-55652732f400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:36.535467 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 453/899] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:36.541198 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a20cc-af3c-40f4-83dd-fd7e95ca43a6 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:36.543654 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-7be951cf-e0f7-42ac-8273-55652732f400 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:36.544864 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-7be951cf-e0f7-42ac-8273-55652732f400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:36.551738 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a20cc-af3c-40f4-83dd-fd7e95ca43a6 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:36.554673 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 447/900] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:36 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:16:36.559016 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79495c70-34b4-44f6-8027-05302b164653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:36.559866 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79495c70-34b4-44f6-8027-05302b164653 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:36.560148 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79495c70-34b4-44f6-8027-05302b164653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:36.560471 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79495c70-34b4-44f6-8027-05302b164653 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:36.568614 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79495c70-34b4-44f6-8027-05302b164653 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:36.570755 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79495c70-34b4-44f6-8027-05302b164653 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:36.581215 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be951cf-e0f7-42ac-8273-55652732f400 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:36.585634 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-79495c70-34b4-44f6-8027-05302b164653 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 23 19:16:36.587150 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 454/901] 10.222.0.62 () {56 vars in 1138 bytes} [Tue Nov 23 19:16:36 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:36.590261 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be951cf-e0f7-42ac-8273-55652732f400 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:36.593306 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79495c70-34b4-44f6-8027-05302b164653 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:36.595178 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c241d8-98a7-4a6c-a1e3-1e54ce8bc740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:36.595831 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c241d8-98a7-4a6c-a1e3-1e54ce8bc740 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:36.596114 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c241d8-98a7-4a6c-a1e3-1e54ce8bc740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:36.596391 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c241d8-98a7-4a6c-a1e3-1e54ce8bc740 admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:36.597119 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c241d8-98a7-4a6c-a1e3-1e54ce8bc740 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:36.598958 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c241d8-98a7-4a6c-a1e3-1e54ce8bc740 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:36.602899 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79495c70-34b4-44f6-8027-05302b164653 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:36.608322 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc708aae-0ab7-4ae8-8cd1-26c3c309ece5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:36.608930 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc708aae-0ab7-4ae8-8cd1-26c3c309ece5 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:36.609211 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc708aae-0ab7-4ae8-8cd1-26c3c309ece5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:36.609513 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc708aae-0ab7-4ae8-8cd1-26c3c309ece5 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:36.610355 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc708aae-0ab7-4ae8-8cd1-26c3c309ece5 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:36.610662 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc708aae-0ab7-4ae8-8cd1-26c3c309ece5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:36.612522 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc708aae-0ab7-4ae8-8cd1-26c3c309ece5 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:36.630125 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 455/902] 10.222.0.62 () {56 vars in 1170 bytes} [Tue Nov 23 19:16:36 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:36.635718 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc708aae-0ab7-4ae8-8cd1-26c3c309ece5 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:36.644930 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc708aae-0ab7-4ae8-8cd1-26c3c309ece5 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:36.649447 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb15c7-c83e-4028-a675-0ef60f9771cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:36.650068 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb15c7-c83e-4028-a675-0ef60f9771cc admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:36.650353 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb15c7-c83e-4028-a675-0ef60f9771cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:36.650627 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb15c7-c83e-4028-a675-0ef60f9771cc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:36.664850 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb15c7-c83e-4028-a675-0ef60f9771cc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:36.664850 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb15c7-c83e-4028-a675-0ef60f9771cc admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:36.665593 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 448/903] 10.222.0.62 () {60 vars in 1162 bytes} [Tue Nov 23 19:16:36 2021] POST /identity/v3/services => generated 269 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:16:36.672091 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 456/904] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:16:36 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:16:36.678478 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c241d8-98a7-4a6c-a1e3-1e54ce8bc740 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:36.702094 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c241d8-98a7-4a6c-a1e3-1e54ce8bc740 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:36.707521 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6402a8-862a-4b2f-982e-c694accba405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:36.708778 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6402a8-862a-4b2f-982e-c694accba405 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:36.709295 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6402a8-862a-4b2f-982e-c694accba405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:36.709826 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6402a8-862a-4b2f-982e-c694accba405 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:36.722329 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6402a8-862a-4b2f-982e-c694accba405 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:36.724683 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6402a8-862a-4b2f-982e-c694accba405 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:36.746744 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-ef6402a8-862a-4b2f-982e-c694accba405 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:36.748919 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 449/905] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:36.755134 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb15c7-c83e-4028-a675-0ef60f9771cc admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:36.764608 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb15c7-c83e-4028-a675-0ef60f9771cc admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:36.769368 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ad45f-66df-4c7a-9520-7faabe939514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:36.770090 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ad45f-66df-4c7a-9520-7faabe939514 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:36.770372 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ad45f-66df-4c7a-9520-7faabe939514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:36.770648 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ad45f-66df-4c7a-9520-7faabe939514 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:36.771388 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ad45f-66df-4c7a-9520-7faabe939514 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:36.771697 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ad45f-66df-4c7a-9520-7faabe939514 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:36.773381 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ad45f-66df-4c7a-9520-7faabe939514 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:36.795969 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 457/906] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:36.808179 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6402a8-862a-4b2f-982e-c694accba405 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:36.819983 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6402a8-862a-4b2f-982e-c694accba405 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:36.825638 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd414148-4340-49e0-a321-3c2e7b5d81e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:36.826939 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd414148-4340-49e0-a321-3c2e7b5d81e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:36.827597 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd414148-4340-49e0-a321-3c2e7b5d81e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:36.828077 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd414148-4340-49e0-a321-3c2e7b5d81e3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:36.836665 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd414148-4340-49e0-a321-3c2e7b5d81e3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:36.839121 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd414148-4340-49e0-a321-3c2e7b5d81e3 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:36.854491 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-bd414148-4340-49e0-a321-3c2e7b5d81e3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:16:36.856546 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 450/907] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:36 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:36.862746 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ad45f-66df-4c7a-9520-7faabe939514 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:36.873952 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ad45f-66df-4c7a-9520-7faabe939514 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:36.879005 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76c557-2a4c-46f7-9cc0-66e303e3625a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:36.879966 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76c557-2a4c-46f7-9cc0-66e303e3625a admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:36.880479 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76c557-2a4c-46f7-9cc0-66e303e3625a admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:36.880956 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76c557-2a4c-46f7-9cc0-66e303e3625a admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:36.882017 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76c557-2a4c-46f7-9cc0-66e303e3625a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:36.882535 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76c557-2a4c-46f7-9cc0-66e303e3625a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:36.884605 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76c557-2a4c-46f7-9cc0-66e303e3625a admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:36.898515 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 458/908] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:16:36 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:36.905088 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd414148-4340-49e0-a321-3c2e7b5d81e3 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:36.916328 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd414148-4340-49e0-a321-3c2e7b5d81e3 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:36.921463 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfedb8f-8812-4875-a72a-6d616c6ca52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:36.922107 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfedb8f-8812-4875-a72a-6d616c6ca52a admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:36.922442 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfedb8f-8812-4875-a72a-6d616c6ca52a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:36.922666 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfedb8f-8812-4875-a72a-6d616c6ca52a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:36.923504 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfedb8f-8812-4875-a72a-6d616c6ca52a admin admin] RBAC: Adding query filter params (role.id=9a70e349a52a474991d2d74cbacad01a, scope.project.id=2955b3037801465c9eec5d78fe2e3ae9, user.id=abc393885c6c4cf6bd4dd52f698fc38c) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:36.923813 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfedb8f-8812-4875-a72a-6d616c6ca52a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:36.925642 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfedb8f-8812-4875-a72a-6d616c6ca52a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:36.931855 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 451/909] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:16:36 2021] GET /identity/v3/role_assignments?user.id=abc393885c6c4cf6bd4dd52f698fc38c&scope.project.id=2955b3037801465c9eec5d78fe2e3ae9&role.id=9a70e349a52a474991d2d74cbacad01a => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:37.408155 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02813d2b-1818-446a-9eba-775001832c57 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:37.408699 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02813d2b-1818-446a-9eba-775001832c57 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:37.408699 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02813d2b-1818-446a-9eba-775001832c57 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:37.410718 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 459/910] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:37.416483 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de089c7-bb1b-45f8-8059-429f1cd3cbb9 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:37.416905 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de089c7-bb1b-45f8-8059-429f1cd3cbb9 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:37.417073 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de089c7-bb1b-45f8-8059-429f1cd3cbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:37.434540 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-5de089c7-bb1b-45f8-8059-429f1cd3cbb9 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:37.435766 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-5de089c7-bb1b-45f8-8059-429f1cd3cbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:37.443848 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 452/911] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:37 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:16:37.468349 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02813d2b-1818-446a-9eba-775001832c57 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:37.480691 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02813d2b-1818-446a-9eba-775001832c57 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:37.486236 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64421287-08d0-4827-9e86-cb77b103a17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:37.487113 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64421287-08d0-4827-9e86-cb77b103a17b admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:37.487613 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64421287-08d0-4827-9e86-cb77b103a17b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:37.488078 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64421287-08d0-4827-9e86-cb77b103a17b admin admin] PATH_INFO: `/v3/services` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:37.488996 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64421287-08d0-4827-9e86-cb77b103a17b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:37.490795 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64421287-08d0-4827-9e86-cb77b103a17b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:37.587796 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 460/912] 10.222.0.62 () {60 vars in 1162 bytes} [Tue Nov 23 19:16:37 2021] POST /identity/v3/services => generated 251 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:16:37.971642 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874bc6e-26e5-46c9-8cd0-48e1b656187c None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:37.972012 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874bc6e-26e5-46c9-8cd0-48e1b656187c None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:37.972205 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874bc6e-26e5-46c9-8cd0-48e1b656187c None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:37.974272 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 453/913] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:37.980637 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2115f93-68a8-46d0-8c01-f2291c36b1c8 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:37.980936 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2115f93-68a8-46d0-8c01-f2291c36b1c8 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:37.981219 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2115f93-68a8-46d0-8c01-f2291c36b1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:38.000245 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-f2115f93-68a8-46d0-8c01-f2291c36b1c8 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:38.001793 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-f2115f93-68a8-46d0-8c01-f2291c36b1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:38.021049 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 461/914] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:37 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:16:38.044443 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874bc6e-26e5-46c9-8cd0-48e1b656187c None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:38.058041 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874bc6e-26e5-46c9-8cd0-48e1b656187c None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:38.062858 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2586d-5eef-4fc4-9233-14f97663fca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:38.063733 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2586d-5eef-4fc4-9233-14f97663fca1 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:38.064090 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2586d-5eef-4fc4-9233-14f97663fca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:38.064511 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2586d-5eef-4fc4-9233-14f97663fca1 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:38.065375 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2586d-5eef-4fc4-9233-14f97663fca1 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:38.067066 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2586d-5eef-4fc4-9233-14f97663fca1 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:38.080376 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-f3b2586d-5eef-4fc4-9233-14f97663fca1 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 23 19:16:38.087566 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 454/915] 10.222.0.62 () {56 vars in 1147 bytes} [Tue Nov 23 19:16:38 2021] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:38.088959 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2115f93-68a8-46d0-8c01-f2291c36b1c8 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:38.098868 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2115f93-68a8-46d0-8c01-f2291c36b1c8 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:38.103662 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685b339-df5e-41ca-9da0-ea5f8b3ddfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:38.104370 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685b339-df5e-41ca-9da0-ea5f8b3ddfa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:38.104658 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685b339-df5e-41ca-9da0-ea5f8b3ddfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:38.104933 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685b339-df5e-41ca-9da0-ea5f8b3ddfa2 admin admin] PATH_INFO: `/v3/services` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:38.105711 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685b339-df5e-41ca-9da0-ea5f8b3ddfa2 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:38.106019 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685b339-df5e-41ca-9da0-ea5f8b3ddfa2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:38.107700 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685b339-df5e-41ca-9da0-ea5f8b3ddfa2 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:38.112877 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 462/916] 10.222.0.62 () {56 vars in 1143 bytes} [Tue Nov 23 19:16:38 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:38.118978 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2586d-5eef-4fc4-9233-14f97663fca1 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:38.129302 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2586d-5eef-4fc4-9233-14f97663fca1 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:38.134240 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23739688-d40d-47bf-a7f4-f23fa6f18c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:38.135081 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23739688-d40d-47bf-a7f4-f23fa6f18c88 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:38.135544 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23739688-d40d-47bf-a7f4-f23fa6f18c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:38.135968 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23739688-d40d-47bf-a7f4-f23fa6f18c88 admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:38.136872 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23739688-d40d-47bf-a7f4-f23fa6f18c88 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:38.137323 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23739688-d40d-47bf-a7f4-f23fa6f18c88 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:38.139637 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23739688-d40d-47bf-a7f4-f23fa6f18c88 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:38.149557 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 455/917] 10.222.0.62 () {56 vars in 1143 bytes} [Tue Nov 23 19:16:38 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:39.114929 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1027f69-3f58-46b6-9264-711fb427a976 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:39.115437 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1027f69-3f58-46b6-9264-711fb427a976 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:39.115437 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1027f69-3f58-46b6-9264-711fb427a976 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:39.117452 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 463/918] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:39.123775 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc674032-fc07-4d54-bc4d-f2e8153254c4 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:39.124629 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc674032-fc07-4d54-bc4d-f2e8153254c4 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:39.124921 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc674032-fc07-4d54-bc4d-f2e8153254c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:39.143748 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-cc674032-fc07-4d54-bc4d-f2e8153254c4 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:39.144935 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-cc674032-fc07-4d54-bc4d-f2e8153254c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:39.152912 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 456/919] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:39 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:16:39.178053 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1027f69-3f58-46b6-9264-711fb427a976 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:39.191067 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1027f69-3f58-46b6-9264-711fb427a976 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:39.195540 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae936bc-fd41-4cfa-b190-1d6eb38fb7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:39.196342 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae936bc-fd41-4cfa-b190-1d6eb38fb7e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:39.196625 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae936bc-fd41-4cfa-b190-1d6eb38fb7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:39.197167 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae936bc-fd41-4cfa-b190-1d6eb38fb7e1 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:39.197875 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae936bc-fd41-4cfa-b190-1d6eb38fb7e1 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:39.199456 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae936bc-fd41-4cfa-b190-1d6eb38fb7e1 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:39.211878 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-9ae936bc-fd41-4cfa-b190-1d6eb38fb7e1 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 23 19:16:39.213338 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 464/920] 10.222.0.62 () {56 vars in 1153 bytes} [Tue Nov 23 19:16:39 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:39.220013 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc674032-fc07-4d54-bc4d-f2e8153254c4 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:39.228455 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545e38f-c7b5-470c-b341-df5c2679b966 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:39.228741 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545e38f-c7b5-470c-b341-df5c2679b966 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:39.229022 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545e38f-c7b5-470c-b341-df5c2679b966 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:39.229229 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc674032-fc07-4d54-bc4d-f2e8153254c4 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:39.231410 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 465/921] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:39.236155 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19851dfc-0195-4b45-97f2-bc2d113de9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:39.236823 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19851dfc-0195-4b45-97f2-bc2d113de9bf admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:39.237107 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19851dfc-0195-4b45-97f2-bc2d113de9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:39.237289 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c195fe4-afdd-480e-bc1d-5390b0a13042 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:39.237479 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19851dfc-0195-4b45-97f2-bc2d113de9bf admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:39.237632 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c195fe4-afdd-480e-bc1d-5390b0a13042 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:39.237869 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c195fe4-afdd-480e-bc1d-5390b0a13042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:39.238123 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19851dfc-0195-4b45-97f2-bc2d113de9bf admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:39.238439 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19851dfc-0195-4b45-97f2-bc2d113de9bf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:39.240132 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19851dfc-0195-4b45-97f2-bc2d113de9bf admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:39.245562 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 457/922] 10.222.0.62 () {56 vars in 1147 bytes} [Tue Nov 23 19:16:39 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:39.252140 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19851dfc-0195-4b45-97f2-bc2d113de9bf admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:39.258894 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-3c195fe4-afdd-480e-bc1d-5390b0a13042 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:39.260587 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-3c195fe4-afdd-480e-bc1d-5390b0a13042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:39.261612 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19851dfc-0195-4b45-97f2-bc2d113de9bf admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:39.267096 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e305df-b1b9-4b5d-9516-381a59c05a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:39.267837 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e305df-b1b9-4b5d-9516-381a59c05a3e admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:39.268125 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e305df-b1b9-4b5d-9516-381a59c05a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:39.268401 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e305df-b1b9-4b5d-9516-381a59c05a3e admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:39.269228 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e305df-b1b9-4b5d-9516-381a59c05a3e admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:39.269609 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e305df-b1b9-4b5d-9516-381a59c05a3e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:39.271112 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 466/923] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:39 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:16:39.271219 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e305df-b1b9-4b5d-9516-381a59c05a3e admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:39.277751 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 458/924] 10.222.0.62 () {56 vars in 1147 bytes} [Tue Nov 23 19:16:39 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:39.284324 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c195fe4-afdd-480e-bc1d-5390b0a13042 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:39.294197 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c195fe4-afdd-480e-bc1d-5390b0a13042 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:39.295721 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e305df-b1b9-4b5d-9516-381a59c05a3e admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:39.299141 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09853e6-16ba-4b24-8ef8-fbd9aef6969a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:39.299823 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09853e6-16ba-4b24-8ef8-fbd9aef6969a admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:39.300105 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09853e6-16ba-4b24-8ef8-fbd9aef6969a admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:39.300383 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09853e6-16ba-4b24-8ef8-fbd9aef6969a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:39.301212 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09853e6-16ba-4b24-8ef8-fbd9aef6969a admin admin] RBAC: Adding query filter params (interface=public, service_id=8e70ac2e56864212bf28e168e4f7bbfe, region_id=RegionOne) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:39.301579 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09853e6-16ba-4b24-8ef8-fbd9aef6969a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:39.303600 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09853e6-16ba-4b24-8ef8-fbd9aef6969a admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:39.307877 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e305df-b1b9-4b5d-9516-381a59c05a3e admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:39.310200 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 467/925] 10.222.0.62 () {56 vars in 1272 bytes} [Tue Nov 23 19:16:39 2021] GET /identity/v3/endpoints?service_id=8e70ac2e56864212bf28e168e4f7bbfe&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:39.313925 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871f333-e802-419d-b20a-18fbec26407a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:39.314730 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871f333-e802-419d-b20a-18fbec26407a admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:39.315009 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871f333-e802-419d-b20a-18fbec26407a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:39.315281 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871f333-e802-419d-b20a-18fbec26407a admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:39.316646 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09853e6-16ba-4b24-8ef8-fbd9aef6969a admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:39.326243 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09853e6-16ba-4b24-8ef8-fbd9aef6969a admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:39.327828 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7871f333-e802-419d-b20a-18fbec26407a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:39.331565 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3516f32-2e45-4a32-b034-7954cf4d561e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:39.332209 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3516f32-2e45-4a32-b034-7954cf4d561e admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:39.332490 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3516f32-2e45-4a32-b034-7954cf4d561e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:39.332766 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3516f32-2e45-4a32-b034-7954cf4d561e admin admin] PATH_INFO: `/v3/services` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:39.335818 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-7871f333-e802-419d-b20a-18fbec26407a admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 23 19:16:39.337366 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 459/926] 10.222.0.62 () {56 vars in 1141 bytes} [Tue Nov 23 19:16:39 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:39.340302 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3516f32-2e45-4a32-b034-7954cf4d561e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:39.343199 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3516f32-2e45-4a32-b034-7954cf4d561e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:39.344539 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871f333-e802-419d-b20a-18fbec26407a admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:39.349651 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 468/927] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Nov 23 19:16:39 2021] GET /identity/v3/services => generated 1268 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:16:39.356174 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871f333-e802-419d-b20a-18fbec26407a admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:39.362113 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83add58-0131-4b7c-995b-243685b0690d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:39.363194 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83add58-0131-4b7c-995b-243685b0690d admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:39.363674 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83add58-0131-4b7c-995b-243685b0690d admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:39.364166 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83add58-0131-4b7c-995b-243685b0690d admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:39.365231 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83add58-0131-4b7c-995b-243685b0690d admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:39.365815 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83add58-0131-4b7c-995b-243685b0690d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:39.367662 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83add58-0131-4b7c-995b-243685b0690d admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:39.377309 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 460/928] 10.222.0.62 () {56 vars in 1136 bytes} [Tue Nov 23 19:16:39 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:39.384382 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3516f32-2e45-4a32-b034-7954cf4d561e admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:39.399588 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3516f32-2e45-4a32-b034-7954cf4d561e admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:39.404470 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d568b68-342b-4ba0-8be4-21fb2a32a85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:39.406663 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d568b68-342b-4ba0-8be4-21fb2a32a85d admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:39.406996 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d568b68-342b-4ba0-8be4-21fb2a32a85d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:39.407274 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d568b68-342b-4ba0-8be4-21fb2a32a85d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:39.418998 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d568b68-342b-4ba0-8be4-21fb2a32a85d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:39.421650 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d568b68-342b-4ba0-8be4-21fb2a32a85d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:39.440247 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-0d568b68-342b-4ba0-8be4-21fb2a32a85d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:39.442205 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 469/929] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:39.449020 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83add58-0131-4b7c-995b-243685b0690d admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:39.460035 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83add58-0131-4b7c-995b-243685b0690d admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:39.465099 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87565cee-6130-4671-a25f-08f73dab9b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:39.466075 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87565cee-6130-4671-a25f-08f73dab9b60 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:39.466582 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87565cee-6130-4671-a25f-08f73dab9b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:39.467138 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87565cee-6130-4671-a25f-08f73dab9b60 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:39.468576 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87565cee-6130-4671-a25f-08f73dab9b60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:39.469084 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87565cee-6130-4671-a25f-08f73dab9b60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:39.470921 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87565cee-6130-4671-a25f-08f73dab9b60 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:39.484506 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 461/930] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:39.491196 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d568b68-342b-4ba0-8be4-21fb2a32a85d admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:39.502755 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d568b68-342b-4ba0-8be4-21fb2a32a85d admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:39.507861 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ce029-fb5b-45f8-a25b-de865d50cad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:39.508987 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ce029-fb5b-45f8-a25b-de865d50cad4 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:39.509516 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ce029-fb5b-45f8-a25b-de865d50cad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:39.510017 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ce029-fb5b-45f8-a25b-de865d50cad4 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:39.518854 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ce029-fb5b-45f8-a25b-de865d50cad4 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:39.521288 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ce029-fb5b-45f8-a25b-de865d50cad4 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:39.537306 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-3e1ce029-fb5b-45f8-a25b-de865d50cad4 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 23 19:16:39.539261 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 470/931] 10.222.0.62 () {56 vars in 1138 bytes} [Tue Nov 23 19:16:39 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:39.546294 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87565cee-6130-4671-a25f-08f73dab9b60 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:39.556658 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87565cee-6130-4671-a25f-08f73dab9b60 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:39.562508 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d30e4-f173-4d57-9fe0-05526cfaa0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:39.563484 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d30e4-f173-4d57-9fe0-05526cfaa0de admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:39.563968 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d30e4-f173-4d57-9fe0-05526cfaa0de admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:39.564463 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d30e4-f173-4d57-9fe0-05526cfaa0de admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:39.565548 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d30e4-f173-4d57-9fe0-05526cfaa0de admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:39.566061 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d30e4-f173-4d57-9fe0-05526cfaa0de admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:39.568109 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d30e4-f173-4d57-9fe0-05526cfaa0de admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:39.587297 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 462/932] 10.222.0.62 () {56 vars in 1170 bytes} [Tue Nov 23 19:16:39 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:39.593568 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ce029-fb5b-45f8-a25b-de865d50cad4 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:39.603997 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ce029-fb5b-45f8-a25b-de865d50cad4 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:39.609053 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e114971-9b4b-43f2-a13f-6847dcab3bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:39.609860 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e114971-9b4b-43f2-a13f-6847dcab3bda admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:39.610141 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e114971-9b4b-43f2-a13f-6847dcab3bda admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:39.610415 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e114971-9b4b-43f2-a13f-6847dcab3bda admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:39.620830 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e114971-9b4b-43f2-a13f-6847dcab3bda admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:39.622616 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e114971-9b4b-43f2-a13f-6847dcab3bda admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:39.640444 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-2e114971-9b4b-43f2-a13f-6847dcab3bda admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:39.641959 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 471/933] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:39.648029 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d30e4-f173-4d57-9fe0-05526cfaa0de admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:39.657868 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d30e4-f173-4d57-9fe0-05526cfaa0de admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:39.662417 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847f7d2-cc10-44c3-84c0-e79623d5975b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:39.663064 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847f7d2-cc10-44c3-84c0-e79623d5975b admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:39.663350 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847f7d2-cc10-44c3-84c0-e79623d5975b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:39.663622 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847f7d2-cc10-44c3-84c0-e79623d5975b admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:39.664357 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847f7d2-cc10-44c3-84c0-e79623d5975b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:39.664660 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847f7d2-cc10-44c3-84c0-e79623d5975b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:39.666251 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847f7d2-cc10-44c3-84c0-e79623d5975b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:39.678502 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 463/934] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:39.684449 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e114971-9b4b-43f2-a13f-6847dcab3bda admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:39.694734 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e114971-9b4b-43f2-a13f-6847dcab3bda admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:39.699575 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526938f-ee5d-48ba-b709-848f02b3982f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:39.700353 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526938f-ee5d-48ba-b709-848f02b3982f admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:39.700637 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526938f-ee5d-48ba-b709-848f02b3982f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:39.700911 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526938f-ee5d-48ba-b709-848f02b3982f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:39.708608 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526938f-ee5d-48ba-b709-848f02b3982f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:39.710574 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526938f-ee5d-48ba-b709-848f02b3982f admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:39.724347 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-7526938f-ee5d-48ba-b709-848f02b3982f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:16:39.725838 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 472/935] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:39.731975 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847f7d2-cc10-44c3-84c0-e79623d5975b admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:39.743002 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847f7d2-cc10-44c3-84c0-e79623d5975b admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:39.747665 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c0f66-f953-45dc-a0a8-be9443a049b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:39.748946 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c0f66-f953-45dc-a0a8-be9443a049b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:39.749234 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c0f66-f953-45dc-a0a8-be9443a049b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:39.749861 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c0f66-f953-45dc-a0a8-be9443a049b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:39.750324 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c0f66-f953-45dc-a0a8-be9443a049b5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:39.750635 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c0f66-f953-45dc-a0a8-be9443a049b5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:39.752612 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c0f66-f953-45dc-a0a8-be9443a049b5 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:39.765127 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 464/936] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:16:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:39.771466 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526938f-ee5d-48ba-b709-848f02b3982f admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:39.783055 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526938f-ee5d-48ba-b709-848f02b3982f admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:39.792894 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1859e-e7bd-43d0-aad1-c2a25569b30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:39.794111 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1859e-e7bd-43d0-aad1-c2a25569b30c admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:39.794710 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1859e-e7bd-43d0-aad1-c2a25569b30c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:39.795289 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1859e-e7bd-43d0-aad1-c2a25569b30c admin admin] PATH_INFO: `/v3/projects/2955b3037801465c9eec5d78fe2e3ae9/users/abc393885c6c4cf6bd4dd52f698fc38c/roles/9a70e349a52a474991d2d74cbacad01a` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:39.799118 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1859e-e7bd-43d0-aad1-c2a25569b30c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2955b3037801465c9eec5d78fe2e3ae9, user_id=abc393885c6c4cf6bd4dd52f698fc38c, role_id=9a70e349a52a474991d2d74cbacad01a)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:39.808204 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1859e-e7bd-43d0-aad1-c2a25569b30c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:39.907747 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 473/937] 10.222.0.62 () {58 vars in 1460 bytes} [Tue Nov 23 19:16:39 2021] PUT /identity/v3/projects/2955b3037801465c9eec5d78fe2e3ae9/users/abc393885c6c4cf6bd4dd52f698fc38c/roles/9a70e349a52a474991d2d74cbacad01a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:16:39.993704 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df0118-a2cc-4a02-9dae-cbdbd2a9d5bc None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:39.994037 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df0118-a2cc-4a02-9dae-cbdbd2a9d5bc None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:39.994270 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df0118-a2cc-4a02-9dae-cbdbd2a9d5bc None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:39.996176 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 465/938] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:40.003175 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7bf15-5aa1-4f64-b61a-143e404b65b6 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:40.003503 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7bf15-5aa1-4f64-b61a-143e404b65b6 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:40.003716 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7bf15-5aa1-4f64-b61a-143e404b65b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:40.023207 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-00b7bf15-5aa1-4f64-b61a-143e404b65b6 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:40.024413 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-00b7bf15-5aa1-4f64-b61a-143e404b65b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:40.092502 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 474/939] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:40 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:16:40.117760 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df0118-a2cc-4a02-9dae-cbdbd2a9d5bc None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:40.131105 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df0118-a2cc-4a02-9dae-cbdbd2a9d5bc None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:40.135834 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35137610-b1c0-4051-9365-34c516396e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:40.136684 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35137610-b1c0-4051-9365-34c516396e60 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:40.137004 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35137610-b1c0-4051-9365-34c516396e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:40.137292 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35137610-b1c0-4051-9365-34c516396e60 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:40.138067 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35137610-b1c0-4051-9365-34c516396e60 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:40.140818 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35137610-b1c0-4051-9365-34c516396e60 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:40.152595 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-35137610-b1c0-4051-9365-34c516396e60 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 23 19:16:40.154109 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 466/940] 10.222.0.62 () {56 vars in 1135 bytes} [Tue Nov 23 19:16:40 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:40.161758 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7bf15-5aa1-4f64-b61a-143e404b65b6 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:40.172135 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7bf15-5aa1-4f64-b61a-143e404b65b6 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:40.176731 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2e94e-4d3d-4821-8c46-e14e3b49cc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:40.177395 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2e94e-4d3d-4821-8c46-e14e3b49cc7d admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:40.177708 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2e94e-4d3d-4821-8c46-e14e3b49cc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:40.177984 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2e94e-4d3d-4821-8c46-e14e3b49cc7d admin admin] PATH_INFO: `/v3/services` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:40.178710 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2e94e-4d3d-4821-8c46-e14e3b49cc7d admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:40.179015 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2e94e-4d3d-4821-8c46-e14e3b49cc7d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:40.180594 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2e94e-4d3d-4821-8c46-e14e3b49cc7d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:40.187352 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 475/941] 10.222.0.62 () {56 vars in 1135 bytes} [Tue Nov 23 19:16:40 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:40.192746 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35137610-b1c0-4051-9365-34c516396e60 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:40.203488 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35137610-b1c0-4051-9365-34c516396e60 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:40.208540 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c08fa-f834-43c4-902d-810ed2cff15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:40.209507 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c08fa-f834-43c4-902d-810ed2cff15c admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:40.210012 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c08fa-f834-43c4-902d-810ed2cff15c admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:40.210481 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c08fa-f834-43c4-902d-810ed2cff15c admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:40.211421 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c08fa-f834-43c4-902d-810ed2cff15c admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:40.211922 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c08fa-f834-43c4-902d-810ed2cff15c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:40.213810 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c08fa-f834-43c4-902d-810ed2cff15c admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:40.219955 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 467/942] 10.222.0.62 () {56 vars in 1135 bytes} [Tue Nov 23 19:16:40 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:40.226497 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2e94e-4d3d-4821-8c46-e14e3b49cc7d admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:40.237890 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2e94e-4d3d-4821-8c46-e14e3b49cc7d admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:40.242936 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25e942-96cc-40c5-bfb6-00c7bba3d2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:40.243856 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25e942-96cc-40c5-bfb6-00c7bba3d2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:40.244354 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25e942-96cc-40c5-bfb6-00c7bba3d2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:40.244871 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25e942-96cc-40c5-bfb6-00c7bba3d2c9 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:40.245901 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef25e942-96cc-40c5-bfb6-00c7bba3d2c9 admin admin] RBAC: Adding query filter params (interface=public, service_id=e2dea0bc951b44509603557b7cd22c98, region_id=RegionOne) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:40.246456 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef25e942-96cc-40c5-bfb6-00c7bba3d2c9 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:40.248355 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef25e942-96cc-40c5-bfb6-00c7bba3d2c9 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:40.255046 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 476/943] 10.222.0.62 () {56 vars in 1272 bytes} [Tue Nov 23 19:16:40 2021] GET /identity/v3/endpoints?service_id=e2dea0bc951b44509603557b7cd22c98&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:40.261153 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c08fa-f834-43c4-902d-810ed2cff15c admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:40.271851 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c08fa-f834-43c4-902d-810ed2cff15c admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:40.276968 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ca160-7e77-4cc6-a512-794307550fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:40.277934 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ca160-7e77-4cc6-a512-794307550fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:40.278442 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ca160-7e77-4cc6-a512-794307550fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:40.278997 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ca160-7e77-4cc6-a512-794307550fe9 admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:40.279949 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ca160-7e77-4cc6-a512-794307550fe9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:40.281908 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ca160-7e77-4cc6-a512-794307550fe9 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:40.289032 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 468/944] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Nov 23 19:16:40 2021] GET /identity/v3/services => generated 1268 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:16:40.487281 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b601cd4-2943-4d11-be3d-08e079bfbac0 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:40.487727 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b601cd4-2943-4d11-be3d-08e079bfbac0 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:40.488121 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b601cd4-2943-4d11-be3d-08e079bfbac0 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:40.490307 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 477/945] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:40.497059 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da497add-80b0-4bdf-acfa-2fc4f314c58d None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:40.497059 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da497add-80b0-4bdf-acfa-2fc4f314c58d None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:40.497059 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da497add-80b0-4bdf-acfa-2fc4f314c58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:40.517071 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-da497add-80b0-4bdf-acfa-2fc4f314c58d None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:40.518548 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-da497add-80b0-4bdf-acfa-2fc4f314c58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:40.526783 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 469/946] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:40 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:16:40.550991 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b601cd4-2943-4d11-be3d-08e079bfbac0 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:40.564142 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b601cd4-2943-4d11-be3d-08e079bfbac0 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:40.568761 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b032d-d21d-433b-8166-197effe390d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:40.569607 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b032d-d21d-433b-8166-197effe390d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:40.570033 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b032d-d21d-433b-8166-197effe390d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:40.570475 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b032d-d21d-433b-8166-197effe390d4 admin admin] PATH_INFO: `/v3/services` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:40.571371 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b032d-d21d-433b-8166-197effe390d4 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:40.573352 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b032d-d21d-433b-8166-197effe390d4 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:40.673821 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 478/947] 10.222.0.62 () {60 vars in 1162 bytes} [Tue Nov 23 19:16:40 2021] POST /identity/v3/services => generated 241 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:16:42.283952 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3a85d-4df0-430a-ab68-7e4e30c84a88 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:42.284772 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3a85d-4df0-430a-ab68-7e4e30c84a88 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:42.284922 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3a85d-4df0-430a-ab68-7e4e30c84a88 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:42.288632 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 470/948] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:42 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 19:16:42.299215 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd70099-c0c3-4228-8726-423837ab3cfb None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:42.299991 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd70099-c0c3-4228-8726-423837ab3cfb None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:42.300140 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd70099-c0c3-4228-8726-423837ab3cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:42.329802 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-0cd70099-c0c3-4228-8726-423837ab3cfb None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:42.331754 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-0cd70099-c0c3-4228-8726-423837ab3cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:42.334643 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d4cfb-5cb9-47ab-804a-944cd231e5ab None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:42.335027 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d4cfb-5cb9-47ab-804a-944cd231e5ab None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:42.335265 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d4cfb-5cb9-47ab-804a-944cd231e5ab None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:42.337107 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 471/949] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:42.343473 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b88ee-578e-4e3a-a0d9-6f166e05ef14 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:42.343762 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b88ee-578e-4e3a-a0d9-6f166e05ef14 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:42.344043 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b88ee-578e-4e3a-a0d9-6f166e05ef14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:42.364250 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-dd4b88ee-578e-4e3a-a0d9-6f166e05ef14 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:42.365448 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-dd4b88ee-578e-4e3a-a0d9-6f166e05ef14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:42.365691 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 479/950] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:42 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:16:42.373464 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 472/951] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:42 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:16:42.400116 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd70099-c0c3-4228-8726-423837ab3cfb None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:42.406052 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b88ee-578e-4e3a-a0d9-6f166e05ef14 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:42.412040 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd70099-c0c3-4228-8726-423837ab3cfb None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:42.416917 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa395e-23d3-4c3a-a662-0cb46a955950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:42.417801 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa395e-23d3-4c3a-a662-0cb46a955950 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:42.418098 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa395e-23d3-4c3a-a662-0cb46a955950 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:42.418325 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa395e-23d3-4c3a-a662-0cb46a955950 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:42.423451 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b88ee-578e-4e3a-a0d9-6f166e05ef14 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:42.431916 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa395e-23d3-4c3a-a662-0cb46a955950 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:42.432271 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c16c8-4d24-4fd1-a981-2cb6845ebede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:42.433639 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c16c8-4d24-4fd1-a981-2cb6845ebede admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:42.434209 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c16c8-4d24-4fd1-a981-2cb6845ebede admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:42.434748 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c16c8-4d24-4fd1-a981-2cb6845ebede admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:42.436696 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c16c8-4d24-4fd1-a981-2cb6845ebede admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:42.439864 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c16c8-4d24-4fd1-a981-2cb6845ebede admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:42.440552 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-50fa395e-23d3-4c3a-a662-0cb46a955950 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 23 19:16:42.442316 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 480/952] 10.222.0.62 () {56 vars in 1141 bytes} [Tue Nov 23 19:16:42 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:42.448976 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa395e-23d3-4c3a-a662-0cb46a955950 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:42.459276 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa395e-23d3-4c3a-a662-0cb46a955950 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:42.462935 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-ea4c16c8-4d24-4fd1-a981-2cb6845ebede admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 23 19:16:42.463862 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0575c7-0b4a-4641-a07b-a4372aa4b0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:42.464494 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0575c7-0b4a-4641-a07b-a4372aa4b0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:42.464773 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0575c7-0b4a-4641-a07b-a4372aa4b0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:42.465047 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0575c7-0b4a-4641-a07b-a4372aa4b0d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:42.465841 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0575c7-0b4a-4641-a07b-a4372aa4b0d0 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:42.466146 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0575c7-0b4a-4641-a07b-a4372aa4b0d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:42.467805 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0575c7-0b4a-4641-a07b-a4372aa4b0d0 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:42.473521 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 473/953] 10.222.0.62 () {56 vars in 1153 bytes} [Tue Nov 23 19:16:42 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:42.476406 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c16c8-4d24-4fd1-a981-2cb6845ebede admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:42.476888 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 481/954] 10.222.0.62 () {56 vars in 1136 bytes} [Tue Nov 23 19:16:42 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:42.483325 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0575c7-0b4a-4641-a07b-a4372aa4b0d0 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:42.491341 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c16c8-4d24-4fd1-a981-2cb6845ebede admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:42.493244 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0575c7-0b4a-4641-a07b-a4372aa4b0d0 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:42.497300 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea4c1c-ae02-482c-994d-9122b2d2db73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:42.498151 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea4c1c-ae02-482c-994d-9122b2d2db73 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:42.498436 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792a7ce-8e02-400d-92ea-b0fb443defaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:42.499124 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea4c1c-ae02-482c-994d-9122b2d2db73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:42.499385 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea4c1c-ae02-482c-994d-9122b2d2db73 admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:42.499744 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792a7ce-8e02-400d-92ea-b0fb443defaf admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:42.500028 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792a7ce-8e02-400d-92ea-b0fb443defaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:42.500182 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea4c1c-ae02-482c-994d-9122b2d2db73 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:42.500322 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792a7ce-8e02-400d-92ea-b0fb443defaf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:42.500467 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea4c1c-ae02-482c-994d-9122b2d2db73 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:42.502249 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea4c1c-ae02-482c-994d-9122b2d2db73 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:42.512174 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792a7ce-8e02-400d-92ea-b0fb443defaf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:42.512978 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 474/955] 10.222.0.62 () {56 vars in 1147 bytes} [Tue Nov 23 19:16:42 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:42.514238 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792a7ce-8e02-400d-92ea-b0fb443defaf admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:42.514432 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea4c1c-ae02-482c-994d-9122b2d2db73 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:42.524173 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea4c1c-ae02-482c-994d-9122b2d2db73 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:42.528751 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbef4a-00e3-4aeb-ac86-8abfe058ef73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:42.529400 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbef4a-00e3-4aeb-ac86-8abfe058ef73 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:42.530078 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbef4a-00e3-4aeb-ac86-8abfe058ef73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:42.530391 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbef4a-00e3-4aeb-ac86-8abfe058ef73 admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:42.531080 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbef4a-00e3-4aeb-ac86-8abfe058ef73 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:42.531386 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbef4a-00e3-4aeb-ac86-8abfe058ef73 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:42.532725 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-1792a7ce-8e02-400d-92ea-b0fb443defaf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:42.532951 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbef4a-00e3-4aeb-ac86-8abfe058ef73 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:42.534252 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 482/956] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:42.540218 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792a7ce-8e02-400d-92ea-b0fb443defaf admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:42.543355 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 475/957] 10.222.0.62 () {56 vars in 1147 bytes} [Tue Nov 23 19:16:42 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:42.544479 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbef4a-00e3-4aeb-ac86-8abfe058ef73 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:42.551066 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792a7ce-8e02-400d-92ea-b0fb443defaf admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:42.554976 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbef4a-00e3-4aeb-ac86-8abfe058ef73 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:42.555734 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152c141-ffc3-442d-b23f-a59630c64154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:42.556424 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152c141-ffc3-442d-b23f-a59630c64154 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:42.556656 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152c141-ffc3-442d-b23f-a59630c64154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:42.556935 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152c141-ffc3-442d-b23f-a59630c64154 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:42.557813 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152c141-ffc3-442d-b23f-a59630c64154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:42.558130 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152c141-ffc3-442d-b23f-a59630c64154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:42.559924 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152c141-ffc3-442d-b23f-a59630c64154 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:42.561795 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda2204-42af-4e0f-bc2a-18b243726d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:42.562795 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda2204-42af-4e0f-bc2a-18b243726d1b admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:42.563255 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda2204-42af-4e0f-bc2a-18b243726d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:42.563711 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda2204-42af-4e0f-bc2a-18b243726d1b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:42.564654 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda2204-42af-4e0f-bc2a-18b243726d1b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:42.566422 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda2204-42af-4e0f-bc2a-18b243726d1b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:42.578214 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 483/958] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:42.579793 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152c141-ffc3-442d-b23f-a59630c64154 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:42.589764 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152c141-ffc3-442d-b23f-a59630c64154 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:42.594487 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580a8d4-a54a-4b65-9a9e-0e7debbb3a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:42.596544 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580a8d4-a54a-4b65-9a9e-0e7debbb3a7e admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:42.596544 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580a8d4-a54a-4b65-9a9e-0e7debbb3a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:42.596544 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580a8d4-a54a-4b65-9a9e-0e7debbb3a7e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:42.604285 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580a8d4-a54a-4b65-9a9e-0e7debbb3a7e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:42.606317 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580a8d4-a54a-4b65-9a9e-0e7debbb3a7e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:42.620879 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-4580a8d4-a54a-4b65-9a9e-0e7debbb3a7e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 23 19:16:42.622170 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 484/959] 10.222.0.62 () {56 vars in 1138 bytes} [Tue Nov 23 19:16:42 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:42.623401 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eadaeb-86e7-4852-befa-e074ff5e9e3a None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:42.625208 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eadaeb-86e7-4852-befa-e074ff5e9e3a None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:42.625208 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eadaeb-86e7-4852-befa-e074ff5e9e3a None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:42.626346 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 485/960] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:42.631220 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eadaeb-86e7-4852-befa-e074ff5e9e3a None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:42.643337 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eadaeb-86e7-4852-befa-e074ff5e9e3a None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:42.647801 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7eb2e-38fb-4c3f-82b4-e09100a7b7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:42.648429 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7eb2e-38fb-4c3f-82b4-e09100a7b7d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:42.648709 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7eb2e-38fb-4c3f-82b4-e09100a7b7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:42.648995 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7eb2e-38fb-4c3f-82b4-e09100a7b7d9 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:42.649856 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7eb2e-38fb-4c3f-82b4-e09100a7b7d9 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:42.650166 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7eb2e-38fb-4c3f-82b4-e09100a7b7d9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:42.651237 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 476/961] 10.222.0.62 () {60 vars in 1165 bytes} [Tue Nov 23 19:16:42 2021] POST /identity/v3/endpoints => generated 347 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:16:42.652801 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee32cb4-f841-44f4-ac97-fa06a3107e0d None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:42.653327 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee32cb4-f841-44f4-ac97-fa06a3107e0d None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:42.653854 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7eb2e-38fb-4c3f-82b4-e09100a7b7d9 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:42.653979 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee32cb4-f841-44f4-ac97-fa06a3107e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:42.681452 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 486/962] 10.222.0.62 () {56 vars in 1170 bytes} [Tue Nov 23 19:16:42 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:42.684898 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7eb2e-38fb-4c3f-82b4-e09100a7b7d9 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:42.687330 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-6ee32cb4-f841-44f4-ac97-fa06a3107e0d None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:42.689140 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-6ee32cb4-f841-44f4-ac97-fa06a3107e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:42.699793 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7eb2e-38fb-4c3f-82b4-e09100a7b7d9 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:42.709782 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 477/963] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:42 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:16:42.716897 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a328be-fb98-4989-a19a-a01ab93226e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:42.717895 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a328be-fb98-4989-a19a-a01ab93226e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:42.718325 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a328be-fb98-4989-a19a-a01ab93226e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:42.718777 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a328be-fb98-4989-a19a-a01ab93226e4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:42.728459 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a328be-fb98-4989-a19a-a01ab93226e4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:42.730759 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a328be-fb98-4989-a19a-a01ab93226e4 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:42.736947 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee32cb4-f841-44f4-ac97-fa06a3107e0d None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:42.742724 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 487/964] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:16:42 2021] GET /identity/v3/auth/tokens => generated 1952 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:16:42.747281 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee32cb4-f841-44f4-ac97-fa06a3107e0d None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:42.751054 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a328be-fb98-4989-a19a-a01ab93226e4 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:42.753399 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92595b27-1af5-49f9-afe1-4f1a60aea235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:42.754479 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92595b27-1af5-49f9-afe1-4f1a60aea235 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:42.754862 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92595b27-1af5-49f9-afe1-4f1a60aea235 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:42.755272 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92595b27-1af5-49f9-afe1-4f1a60aea235 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:42.756048 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92595b27-1af5-49f9-afe1-4f1a60aea235 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:42.757954 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92595b27-1af5-49f9-afe1-4f1a60aea235 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:42.762684 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a328be-fb98-4989-a19a-a01ab93226e4 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:42.767686 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0f9c6-8d62-41c1-84a6-8e08907bc0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:42.768713 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0f9c6-8d62-41c1-84a6-8e08907bc0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:42.769193 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0f9c6-8d62-41c1-84a6-8e08907bc0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:42.769677 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0f9c6-8d62-41c1-84a6-8e08907bc0e4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:42.771488 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-92595b27-1af5-49f9-afe1-4f1a60aea235 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 23 19:16:42.773190 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 478/965] 10.222.0.62 () {56 vars in 1135 bytes} [Tue Nov 23 19:16:42 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:42.780705 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92595b27-1af5-49f9-afe1-4f1a60aea235 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:42.782894 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0f9c6-8d62-41c1-84a6-8e08907bc0e4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:42.785286 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0f9c6-8d62-41c1-84a6-8e08907bc0e4 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:42.791851 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92595b27-1af5-49f9-afe1-4f1a60aea235 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:42.797597 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e294c3-1d92-455c-a293-5f22fdcb3fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:42.798403 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e294c3-1d92-455c-a293-5f22fdcb3fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:42.798871 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e294c3-1d92-455c-a293-5f22fdcb3fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:42.799234 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e294c3-1d92-455c-a293-5f22fdcb3fb4 admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:42.800061 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e294c3-1d92-455c-a293-5f22fdcb3fb4 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:42.800467 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e294c3-1d92-455c-a293-5f22fdcb3fb4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:42.802345 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e294c3-1d92-455c-a293-5f22fdcb3fb4 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:42.808523 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 479/966] 10.222.0.62 () {56 vars in 1135 bytes} [Tue Nov 23 19:16:42 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:42.810634 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-fcf0f9c6-8d62-41c1-84a6-8e08907bc0e4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:42.812923 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 488/967] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:42.817554 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e294c3-1d92-455c-a293-5f22fdcb3fb4 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:42.822994 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0f9c6-8d62-41c1-84a6-8e08907bc0e4 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:42.828322 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e294c3-1d92-455c-a293-5f22fdcb3fb4 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:42.833333 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700c854-03ae-419e-99a0-bfe2a443402e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:42.834053 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700c854-03ae-419e-99a0-bfe2a443402e admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:42.834337 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700c854-03ae-419e-99a0-bfe2a443402e admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:42.834669 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700c854-03ae-419e-99a0-bfe2a443402e admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:42.835410 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700c854-03ae-419e-99a0-bfe2a443402e admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:42.835704 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700c854-03ae-419e-99a0-bfe2a443402e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:42.836630 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0f9c6-8d62-41c1-84a6-8e08907bc0e4 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:42.837298 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700c854-03ae-419e-99a0-bfe2a443402e admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:42.842725 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a870b-f2c6-4828-9a19-719d2f5db6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:42.843713 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a870b-f2c6-4828-9a19-719d2f5db6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:42.844146 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 480/968] 10.222.0.62 () {56 vars in 1135 bytes} [Tue Nov 23 19:16:42 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:42.844456 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a870b-f2c6-4828-9a19-719d2f5db6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:42.844971 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a870b-f2c6-4828-9a19-719d2f5db6b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:42.845994 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5a870b-f2c6-4828-9a19-719d2f5db6b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:42.846539 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5a870b-f2c6-4828-9a19-719d2f5db6b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:42.848402 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5a870b-f2c6-4828-9a19-719d2f5db6b5 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:42.850575 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700c854-03ae-419e-99a0-bfe2a443402e admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:42.860441 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700c854-03ae-419e-99a0-bfe2a443402e admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:42.868965 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 489/969] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:42.870627 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a870b-f2c6-4828-9a19-719d2f5db6b5 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:42.871481 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d014842a-7db1-41ed-b7bf-2aae3265865f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:42.872156 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014842a-7db1-41ed-b7bf-2aae3265865f admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:42.872441 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014842a-7db1-41ed-b7bf-2aae3265865f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:42.872715 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014842a-7db1-41ed-b7bf-2aae3265865f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:42.874787 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d014842a-7db1-41ed-b7bf-2aae3265865f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:42.876373 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d014842a-7db1-41ed-b7bf-2aae3265865f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:42.881559 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a870b-f2c6-4828-9a19-719d2f5db6b5 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:42.886325 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3a1f5-86ac-4cf6-a5d8-a00c28eeab63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:42.887104 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3a1f5-86ac-4cf6-a5d8-a00c28eeab63 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:42.887392 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3a1f5-86ac-4cf6-a5d8-a00c28eeab63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:42.887673 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3a1f5-86ac-4cf6-a5d8-a00c28eeab63 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:42.894663 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3a1f5-86ac-4cf6-a5d8-a00c28eeab63 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:42.896593 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3a1f5-86ac-4cf6-a5d8-a00c28eeab63 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:42.911178 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-80b3a1f5-86ac-4cf6-a5d8-a00c28eeab63 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:16:42.912496 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 490/970] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:42.918722 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3a1f5-86ac-4cf6-a5d8-a00c28eeab63 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:42.929123 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3a1f5-86ac-4cf6-a5d8-a00c28eeab63 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:42.933829 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c8a19-3d8d-429c-aa41-f59d3808e8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:42.934466 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c8a19-3d8d-429c-aa41-f59d3808e8ed admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:42.934751 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c8a19-3d8d-429c-aa41-f59d3808e8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:42.935026 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c8a19-3d8d-429c-aa41-f59d3808e8ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:42.935843 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c8a19-3d8d-429c-aa41-f59d3808e8ed admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:42.936167 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c8a19-3d8d-429c-aa41-f59d3808e8ed admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:42.938237 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c8a19-3d8d-429c-aa41-f59d3808e8ed admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:42.950398 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 491/971] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:16:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:42.957139 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c8a19-3d8d-429c-aa41-f59d3808e8ed admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:42.966617 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c8a19-3d8d-429c-aa41-f59d3808e8ed admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:42.971943 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa2c35-7070-4e18-90e0-b70db4f1dea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:42.972577 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa2c35-7070-4e18-90e0-b70db4f1dea4 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:42.972896 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa2c35-7070-4e18-90e0-b70db4f1dea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:42.973173 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa2c35-7070-4e18-90e0-b70db4f1dea4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:42.974038 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa2c35-7070-4e18-90e0-b70db4f1dea4 admin admin] RBAC: Adding query filter params (role.id=9a70e349a52a474991d2d74cbacad01a, scope.project.id=2955b3037801465c9eec5d78fe2e3ae9, user.id=abc393885c6c4cf6bd4dd52f698fc38c) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:42.974353 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa2c35-7070-4e18-90e0-b70db4f1dea4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:42.976166 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa2c35-7070-4e18-90e0-b70db4f1dea4 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:42.981944 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 481/972] 10.222.0.62 () {60 vars in 1165 bytes} [Tue Nov 23 19:16:42 2021] POST /identity/v3/endpoints => generated 346 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:16:42.985969 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 492/973] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:16:42 2021] GET /identity/v3/role_assignments?user.id=abc393885c6c4cf6bd4dd52f698fc38c&scope.project.id=2955b3037801465c9eec5d78fe2e3ae9&role.id=9a70e349a52a474991d2d74cbacad01a => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:43.665401 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd0dc9-7b80-4b30-84d4-3d310ac8b378 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:43.666122 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd0dc9-7b80-4b30-84d4-3d310ac8b378 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:43.666122 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd0dc9-7b80-4b30-84d4-3d310ac8b378 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:43.667985 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 482/974] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:43.674342 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf32ff-5ec5-479b-9c29-2eadc7343b17 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:43.674856 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf32ff-5ec5-479b-9c29-2eadc7343b17 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:43.675011 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf32ff-5ec5-479b-9c29-2eadc7343b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:43.692301 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-0aaf32ff-5ec5-479b-9c29-2eadc7343b17 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:43.693489 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-0aaf32ff-5ec5-479b-9c29-2eadc7343b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:43.713725 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 493/975] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:43 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:16:43.733923 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd0dc9-7b80-4b30-84d4-3d310ac8b378 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:43.746089 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd0dc9-7b80-4b30-84d4-3d310ac8b378 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:43.751093 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ac29a-6912-47f0-a271-68b596948b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:43.752025 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ac29a-6912-47f0-a271-68b596948b5f admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:43.752299 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ac29a-6912-47f0-a271-68b596948b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:43.752564 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ac29a-6912-47f0-a271-68b596948b5f admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:43.753222 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ac29a-6912-47f0-a271-68b596948b5f admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:43.754814 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ac29a-6912-47f0-a271-68b596948b5f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:43.766353 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-c85ac29a-6912-47f0-a271-68b596948b5f admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 23 19:16:43.767831 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 483/976] 10.222.0.62 () {56 vars in 1147 bytes} [Tue Nov 23 19:16:43 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:43.774366 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf32ff-5ec5-479b-9c29-2eadc7343b17 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:43.789261 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf32ff-5ec5-479b-9c29-2eadc7343b17 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:43.793930 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f280a79-97da-4159-b4f4-8b9f9858e308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:43.794588 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f280a79-97da-4159-b4f4-8b9f9858e308 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:43.794863 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f280a79-97da-4159-b4f4-8b9f9858e308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:43.795132 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f280a79-97da-4159-b4f4-8b9f9858e308 admin admin] PATH_INFO: `/v3/services` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:43.796067 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f280a79-97da-4159-b4f4-8b9f9858e308 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:43.796359 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f280a79-97da-4159-b4f4-8b9f9858e308 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:43.797962 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f280a79-97da-4159-b4f4-8b9f9858e308 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:43.804622 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 494/977] 10.222.0.62 () {56 vars in 1143 bytes} [Tue Nov 23 19:16:43 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:43.809747 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ac29a-6912-47f0-a271-68b596948b5f admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:43.820908 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ac29a-6912-47f0-a271-68b596948b5f admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:43.825789 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1fe63-f95f-4f81-a3eb-bda00bd75f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:43.826428 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1fe63-f95f-4f81-a3eb-bda00bd75f2f admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:43.827307 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1fe63-f95f-4f81-a3eb-bda00bd75f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:43.827591 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1fe63-f95f-4f81-a3eb-bda00bd75f2f admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:43.828308 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d1fe63-f95f-4f81-a3eb-bda00bd75f2f admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:43.828610 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d1fe63-f95f-4f81-a3eb-bda00bd75f2f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:43.830192 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d1fe63-f95f-4f81-a3eb-bda00bd75f2f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:43.835599 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 484/978] 10.222.0.62 () {56 vars in 1143 bytes} [Tue Nov 23 19:16:43 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:43.842842 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f280a79-97da-4159-b4f4-8b9f9858e308 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:43.852477 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f280a79-97da-4159-b4f4-8b9f9858e308 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:43.856989 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca6f55-7d70-400d-9838-dc8fd5cea0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:43.857815 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca6f55-7d70-400d-9838-dc8fd5cea0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:43.858368 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca6f55-7d70-400d-9838-dc8fd5cea0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:43.858648 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca6f55-7d70-400d-9838-dc8fd5cea0c8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:43.859443 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca6f55-7d70-400d-9838-dc8fd5cea0c8 admin admin] RBAC: Adding query filter params (interface=public, service_id=785cc16cbd6b4079890732db8b96d306, region_id=RegionOne) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:43.859748 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca6f55-7d70-400d-9838-dc8fd5cea0c8 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:43.861321 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca6f55-7d70-400d-9838-dc8fd5cea0c8 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:43.867020 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 495/979] 10.222.0.62 () {56 vars in 1272 bytes} [Tue Nov 23 19:16:43 2021] GET /identity/v3/endpoints?service_id=785cc16cbd6b4079890732db8b96d306&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:43.873256 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1fe63-f95f-4f81-a3eb-bda00bd75f2f admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:43.884067 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1fe63-f95f-4f81-a3eb-bda00bd75f2f admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:43.889529 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee017a-8b63-43ed-a60a-deaf80ae8f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:43.890262 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee017a-8b63-43ed-a60a-deaf80ae8f84 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:43.890540 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee017a-8b63-43ed-a60a-deaf80ae8f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:43.890812 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee017a-8b63-43ed-a60a-deaf80ae8f84 admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:43.891549 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee017a-8b63-43ed-a60a-deaf80ae8f84 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:43.893173 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee017a-8b63-43ed-a60a-deaf80ae8f84 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:43.900181 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 485/980] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Nov 23 19:16:43 2021] GET /identity/v3/services => generated 1497 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:16:45.024655 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c330f17-0e7d-497f-819b-45523c5ca2c6 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:45.025379 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c330f17-0e7d-497f-819b-45523c5ca2c6 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:45.025379 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c330f17-0e7d-497f-819b-45523c5ca2c6 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:45.027255 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 496/981] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:45.034087 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f0da3-53fc-466b-860a-a5ce34674ce8 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:45.034636 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f0da3-53fc-466b-860a-a5ce34674ce8 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:45.034636 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f0da3-53fc-466b-860a-a5ce34674ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:45.052742 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-112f0da3-53fc-466b-860a-a5ce34674ce8 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:45.053995 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-112f0da3-53fc-466b-860a-a5ce34674ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:45.069611 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 486/982] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:45 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:16:45.087105 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c330f17-0e7d-497f-819b-45523c5ca2c6 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:45.099294 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c330f17-0e7d-497f-819b-45523c5ca2c6 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:45.103760 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6cd863-b0df-4c2f-bb81-2cadfd6668cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:45.104535 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cd863-b0df-4c2f-bb81-2cadfd6668cc admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:45.104811 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cd863-b0df-4c2f-bb81-2cadfd6668cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:45.105085 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6cd863-b0df-4c2f-bb81-2cadfd6668cc admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:45.105772 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6cd863-b0df-4c2f-bb81-2cadfd6668cc admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:45.107347 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6cd863-b0df-4c2f-bb81-2cadfd6668cc admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:45.118401 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-8a6cd863-b0df-4c2f-bb81-2cadfd6668cc admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 23 19:16:45.125521 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 497/983] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:45 2021] GET /identity/v3/services/compute => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:45.127421 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f0da3-53fc-466b-860a-a5ce34674ce8 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:45.136387 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f0da3-53fc-466b-860a-a5ce34674ce8 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:45.141120 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef07ec-d432-407d-bb9e-728825376662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:45.141814 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef07ec-d432-407d-bb9e-728825376662 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:45.142093 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef07ec-d432-407d-bb9e-728825376662 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:45.142366 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef07ec-d432-407d-bb9e-728825376662 admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:45.143086 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef07ec-d432-407d-bb9e-728825376662 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:45.143389 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef07ec-d432-407d-bb9e-728825376662 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:45.144953 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef07ec-d432-407d-bb9e-728825376662 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:45.155631 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 487/984] 10.222.0.62 () {56 vars in 1133 bytes} [Tue Nov 23 19:16:45 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:45.157087 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6cd863-b0df-4c2f-bb81-2cadfd6668cc admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:45.166742 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6cd863-b0df-4c2f-bb81-2cadfd6668cc admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:45.171549 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3330b1-fabd-4bf0-ab3a-8d1ae16a4b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:45.172192 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3330b1-fabd-4bf0-ab3a-8d1ae16a4b8c admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:45.172473 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3330b1-fabd-4bf0-ab3a-8d1ae16a4b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:45.172750 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3330b1-fabd-4bf0-ab3a-8d1ae16a4b8c admin admin] PATH_INFO: `/v3/services` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:45.173490 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3330b1-fabd-4bf0-ab3a-8d1ae16a4b8c admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:45.173796 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3330b1-fabd-4bf0-ab3a-8d1ae16a4b8c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:45.175354 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3330b1-fabd-4bf0-ab3a-8d1ae16a4b8c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:45.185546 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 498/985] 10.222.0.62 () {56 vars in 1133 bytes} [Tue Nov 23 19:16:45 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:45.421170 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46ce20-8cc0-4fe2-bb47-fd4a8e6522b7 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:45.421170 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46ce20-8cc0-4fe2-bb47-fd4a8e6522b7 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:45.421170 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46ce20-8cc0-4fe2-bb47-fd4a8e6522b7 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:45.421170 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 488/986] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:45.428749 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237c94e-c557-4114-ae51-b908f39e6140 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:45.428749 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237c94e-c557-4114-ae51-b908f39e6140 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:45.428749 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237c94e-c557-4114-ae51-b908f39e6140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:45.434041 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa1d45-3b9b-4757-9508-f7331505c6fb None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:45.434244 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa1d45-3b9b-4757-9508-f7331505c6fb None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:45.436620 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa1d45-3b9b-4757-9508-f7331505c6fb None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:45.438461 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 489/987] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:45.443281 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9ae72-941f-422d-9cc6-b74a9f4b89e5 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:45.443570 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9ae72-941f-422d-9cc6-b74a9f4b89e5 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:45.443847 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9ae72-941f-422d-9cc6-b74a9f4b89e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:45.450370 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-e237c94e-c557-4114-ae51-b908f39e6140 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:45.451884 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-e237c94e-c557-4114-ae51-b908f39e6140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:45.460137 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 499/988] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:45 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:16:45.466396 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-0eb9ae72-941f-422d-9cc6-b74a9f4b89e5 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:45.468130 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-0eb9ae72-941f-422d-9cc6-b74a9f4b89e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:45.476143 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 490/989] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:45 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:16:45.486089 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237c94e-c557-4114-ae51-b908f39e6140 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:45.495476 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237c94e-c557-4114-ae51-b908f39e6140 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:45.500994 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714eb68-1275-49fc-9312-4ca2f4b798e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:45.502343 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714eb68-1275-49fc-9312-4ca2f4b798e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:45.502453 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9ae72-941f-422d-9cc6-b74a9f4b89e5 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:45.502951 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714eb68-1275-49fc-9312-4ca2f4b798e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:45.503423 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714eb68-1275-49fc-9312-4ca2f4b798e3 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:45.504330 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714eb68-1275-49fc-9312-4ca2f4b798e3 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:45.506155 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714eb68-1275-49fc-9312-4ca2f4b798e3 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:45.511781 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9ae72-941f-422d-9cc6-b74a9f4b89e5 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:45.516588 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5dadb6-14b1-417c-a29b-98199115c995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:45.517240 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5dadb6-14b1-417c-a29b-98199115c995 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:45.517567 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5dadb6-14b1-417c-a29b-98199115c995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:45.517843 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5dadb6-14b1-417c-a29b-98199115c995 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:45.518564 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5dadb6-14b1-417c-a29b-98199115c995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:45.519478 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-a714eb68-1275-49fc-9312-4ca2f4b798e3 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 23 19:16:45.520407 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5dadb6-14b1-417c-a29b-98199115c995 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:45.521381 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 500/990] 10.222.0.62 () {56 vars in 1126 bytes} [Tue Nov 23 19:16:45 2021] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:45.525654 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.common [None req-9e5dadb6-14b1-417c-a29b-98199115c995 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Nov 23 19:16:45.528215 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714eb68-1275-49fc-9312-4ca2f4b798e3 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:45.538484 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714eb68-1275-49fc-9312-4ca2f4b798e3 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:45.543417 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d20dd2-ebbd-471e-a0fb-c0ac0c2983bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:45.544287 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d20dd2-ebbd-471e-a0fb-c0ac0c2983bf admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:45.544769 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d20dd2-ebbd-471e-a0fb-c0ac0c2983bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:45.545956 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d20dd2-ebbd-471e-a0fb-c0ac0c2983bf admin admin] PATH_INFO: `/v3/services` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:45.546880 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d20dd2-ebbd-471e-a0fb-c0ac0c2983bf admin admin] RBAC: Adding query filter params (name=image) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:45.547396 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d20dd2-ebbd-471e-a0fb-c0ac0c2983bf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:45.549164 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d20dd2-ebbd-471e-a0fb-c0ac0c2983bf admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:45.554667 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 501/991] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:45 2021] GET /identity/v3/services?name=image => generated 122 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:45.560715 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d20dd2-ebbd-471e-a0fb-c0ac0c2983bf admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:45.571240 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d20dd2-ebbd-471e-a0fb-c0ac0c2983bf admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:45.575973 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39040800-fa06-43d0-8592-7eefc8113abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:45.576679 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39040800-fa06-43d0-8592-7eefc8113abc admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:45.576965 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39040800-fa06-43d0-8592-7eefc8113abc admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:45.577246 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39040800-fa06-43d0-8592-7eefc8113abc admin admin] PATH_INFO: `/v3/services` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:45.577990 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39040800-fa06-43d0-8592-7eefc8113abc admin admin] RBAC: Adding query filter params (type=image) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:45.578305 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39040800-fa06-43d0-8592-7eefc8113abc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:45.579976 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39040800-fa06-43d0-8592-7eefc8113abc admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:45.580581 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.sql.core [None req-9e5dadb6-14b1-417c-a29b-98199115c995 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 23 19:16:45.580581 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 23 19:16:45.580581 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [parameters: {'id': 'd36b23058b8e4b13b62a9fb9a26744e2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 23 19:16:45.580581 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79232) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 23 19:16:45.585017 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 502/992] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:45 2021] GET /identity/v3/services?type=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:45.588385 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-9e5dadb6-14b1-417c-a29b-98199115c995 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d36b23058b8e4b13b62a9fb9a26744e2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d36b23058b8e4b13b62a9fb9a26744e2. Nov 23 19:16:45.597521 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 491/993] 10.222.0.62 () {60 vars in 1161 bytes} [Tue Nov 23 19:16:45 2021] POST /identity/v3/projects => generated 262 bytes in 88 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:45.597664 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39040800-fa06-43d0-8592-7eefc8113abc admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:45.607377 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39040800-fa06-43d0-8592-7eefc8113abc admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:45.612996 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00beb3f8-85e1-4ee4-8e3f-e4ad192dae39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:45.614016 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00beb3f8-85e1-4ee4-8e3f-e4ad192dae39 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:45.614270 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00beb3f8-85e1-4ee4-8e3f-e4ad192dae39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:45.614545 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00beb3f8-85e1-4ee4-8e3f-e4ad192dae39 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:45.622509 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00beb3f8-85e1-4ee4-8e3f-e4ad192dae39 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:45.625343 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00beb3f8-85e1-4ee4-8e3f-e4ad192dae39 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:45.640936 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-00beb3f8-85e1-4ee4-8e3f-e4ad192dae39 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:16:45.642532 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 503/994] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:45.649088 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5dadb6-14b1-417c-a29b-98199115c995 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:45.663187 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5dadb6-14b1-417c-a29b-98199115c995 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:45.668570 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5cfca-4834-4714-9b09-0b77526ac015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:45.669666 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5cfca-4834-4714-9b09-0b77526ac015 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:45.670212 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5cfca-4834-4714-9b09-0b77526ac015 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:45.671552 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5cfca-4834-4714-9b09-0b77526ac015 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:45.672612 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5cfca-4834-4714-9b09-0b77526ac015 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:45.673127 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5cfca-4834-4714-9b09-0b77526ac015 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:45.675692 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5cfca-4834-4714-9b09-0b77526ac015 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:45.700189 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 492/995] 10.222.0.62 () {56 vars in 1133 bytes} [Tue Nov 23 19:16:45 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:46.219637 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247628e-3259-41d2-a3c9-54d5cd953363 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:46.220169 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247628e-3259-41d2-a3c9-54d5cd953363 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:46.220169 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247628e-3259-41d2-a3c9-54d5cd953363 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:46.222190 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 504/996] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:46.228248 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457bae4-ad77-4d79-8d8b-9a468531e981 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:46.228821 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457bae4-ad77-4d79-8d8b-9a468531e981 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:46.228821 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457bae4-ad77-4d79-8d8b-9a468531e981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:46.247338 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-a457bae4-ad77-4d79-8d8b-9a468531e981 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:46.249201 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-a457bae4-ad77-4d79-8d8b-9a468531e981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:46.257176 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 493/997] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:46 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:16:46.281163 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247628e-3259-41d2-a3c9-54d5cd953363 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:46.293278 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247628e-3259-41d2-a3c9-54d5cd953363 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:46.298825 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba44a3-9c3f-41b1-8478-5baa14606557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:46.299615 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba44a3-9c3f-41b1-8478-5baa14606557 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:46.299893 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba44a3-9c3f-41b1-8478-5baa14606557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:46.300165 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba44a3-9c3f-41b1-8478-5baa14606557 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:46.300825 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba44a3-9c3f-41b1-8478-5baa14606557 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:46.302411 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba44a3-9c3f-41b1-8478-5baa14606557 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:46.314396 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-69ba44a3-9c3f-41b1-8478-5baa14606557 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 23 19:16:46.315842 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 505/998] 10.222.0.62 () {56 vars in 1147 bytes} [Tue Nov 23 19:16:46 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:46.322535 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457bae4-ad77-4d79-8d8b-9a468531e981 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:46.332077 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457bae4-ad77-4d79-8d8b-9a468531e981 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:46.336599 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e260b-f795-41fa-8138-21245eb2f407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:46.337246 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e260b-f795-41fa-8138-21245eb2f407 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:46.337562 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e260b-f795-41fa-8138-21245eb2f407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:46.337837 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e260b-f795-41fa-8138-21245eb2f407 admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:46.338551 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e260b-f795-41fa-8138-21245eb2f407 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:46.338855 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e260b-f795-41fa-8138-21245eb2f407 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:46.340429 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e260b-f795-41fa-8138-21245eb2f407 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:46.346954 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 494/999] 10.222.0.62 () {56 vars in 1143 bytes} [Tue Nov 23 19:16:46 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:46.353314 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba44a3-9c3f-41b1-8478-5baa14606557 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:46.363714 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba44a3-9c3f-41b1-8478-5baa14606557 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:46.368375 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e96a2-3c51-4bbc-9701-c6e0232fef81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:46.369019 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e96a2-3c51-4bbc-9701-c6e0232fef81 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:46.369296 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e96a2-3c51-4bbc-9701-c6e0232fef81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:46.369599 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e96a2-3c51-4bbc-9701-c6e0232fef81 admin admin] PATH_INFO: `/v3/services` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:46.370302 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e96a2-3c51-4bbc-9701-c6e0232fef81 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:46.370598 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e96a2-3c51-4bbc-9701-c6e0232fef81 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:46.372263 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e96a2-3c51-4bbc-9701-c6e0232fef81 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:46.378124 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 506/1000] 10.222.0.62 () {56 vars in 1143 bytes} [Tue Nov 23 19:16:46 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:46.384323 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e260b-f795-41fa-8138-21245eb2f407 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:46.394701 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e260b-f795-41fa-8138-21245eb2f407 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:46.399362 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32b683-ce5c-4f52-bb0b-4fea7059dbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:46.399993 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32b683-ce5c-4f52-bb0b-4fea7059dbbc admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:46.400273 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32b683-ce5c-4f52-bb0b-4fea7059dbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:46.400586 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32b683-ce5c-4f52-bb0b-4fea7059dbbc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:46.401341 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32b683-ce5c-4f52-bb0b-4fea7059dbbc admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:46.403065 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32b683-ce5c-4f52-bb0b-4fea7059dbbc admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:46.485248 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 495/1001] 10.222.0.62 () {60 vars in 1165 bytes} [Tue Nov 23 19:16:46 2021] POST /identity/v3/endpoints => generated 349 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:16:47.487467 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3fa04-433e-4b95-a95d-b45608b1f15b None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:47.487988 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3fa04-433e-4b95-a95d-b45608b1f15b None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:47.487988 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3fa04-433e-4b95-a95d-b45608b1f15b None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:47.490055 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 507/1002] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:47.496097 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fa026-3474-4830-8707-83eac68ad4c6 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:47.496848 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fa026-3474-4830-8707-83eac68ad4c6 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:47.497289 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fa026-3474-4830-8707-83eac68ad4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:47.516615 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-720fa026-3474-4830-8707-83eac68ad4c6 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:47.518068 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-720fa026-3474-4830-8707-83eac68ad4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:47.541507 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 496/1003] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:47 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:16:47.558754 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3fa04-433e-4b95-a95d-b45608b1f15b None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:47.572542 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3fa04-433e-4b95-a95d-b45608b1f15b None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:47.577750 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31880db1-3a1f-4325-9bfa-c1c9d1142885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:47.578640 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31880db1-3a1f-4325-9bfa-c1c9d1142885 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:47.579121 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31880db1-3a1f-4325-9bfa-c1c9d1142885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:47.579586 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31880db1-3a1f-4325-9bfa-c1c9d1142885 admin admin] PATH_INFO: `/v3/services` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:47.580501 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31880db1-3a1f-4325-9bfa-c1c9d1142885 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:47.582272 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31880db1-3a1f-4325-9bfa-c1c9d1142885 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:47.673660 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 508/1004] 10.222.0.62 () {60 vars in 1162 bytes} [Tue Nov 23 19:16:47 2021] POST /identity/v3/services => generated 242 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:16:47.944519 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd8265-6a30-4e50-a1a0-08d5044b7de8 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:47.944796 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd8265-6a30-4e50-a1a0-08d5044b7de8 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:47.945080 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd8265-6a30-4e50-a1a0-08d5044b7de8 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:47.947476 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 497/1005] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:47.954389 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda13cc-9756-4e52-82d9-5121a3db8dba None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:47.954697 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda13cc-9756-4e52-82d9-5121a3db8dba None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:47.954954 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda13cc-9756-4e52-82d9-5121a3db8dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:47.974306 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-6cda13cc-9756-4e52-82d9-5121a3db8dba None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:47.975527 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-6cda13cc-9756-4e52-82d9-5121a3db8dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:47.994219 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 509/1006] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:47 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:16:48.019111 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd8265-6a30-4e50-a1a0-08d5044b7de8 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:48.032441 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd8265-6a30-4e50-a1a0-08d5044b7de8 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:48.036909 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447baae-a966-44f2-8b6c-e179d59e0c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:48.037600 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447baae-a966-44f2-8b6c-e179d59e0c86 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:48.037883 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447baae-a966-44f2-8b6c-e179d59e0c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:48.038156 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447baae-a966-44f2-8b6c-e179d59e0c86 admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:48.038905 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447baae-a966-44f2-8b6c-e179d59e0c86 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:48.040477 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447baae-a966-44f2-8b6c-e179d59e0c86 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:48.114457 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 498/1007] 10.222.0.62 () {60 vars in 1162 bytes} [Tue Nov 23 19:16:48 2021] POST /identity/v3/services => generated 242 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:16:48.142360 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8a749-f912-4af6-8632-bcb0d3ea9fbb None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:48.142689 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8a749-f912-4af6-8632-bcb0d3ea9fbb None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:48.142922 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8a749-f912-4af6-8632-bcb0d3ea9fbb None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:48.145099 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 510/1008] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:48.151312 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113c3b5-9fc5-433a-95f4-154d814c52f7 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:48.151612 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113c3b5-9fc5-433a-95f4-154d814c52f7 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:48.151884 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113c3b5-9fc5-433a-95f4-154d814c52f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:48.172674 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-8113c3b5-9fc5-433a-95f4-154d814c52f7 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:48.173953 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-8113c3b5-9fc5-433a-95f4-154d814c52f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:48.193184 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 499/1009] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:48 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:16:48.221563 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8a749-f912-4af6-8632-bcb0d3ea9fbb None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:48.235105 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8a749-f912-4af6-8632-bcb0d3ea9fbb None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:48.240044 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b5dfd-f599-40b6-87e5-4bb732fc59fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:48.240806 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b5dfd-f599-40b6-87e5-4bb732fc59fe admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:48.241097 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b5dfd-f599-40b6-87e5-4bb732fc59fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:48.241369 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b5dfd-f599-40b6-87e5-4bb732fc59fe admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:48.242290 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b5dfd-f599-40b6-87e5-4bb732fc59fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:48.244108 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b5dfd-f599-40b6-87e5-4bb732fc59fe admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:48.245525 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.common [None req-8e0b5dfd-f599-40b6-87e5-4bb732fc59fe admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Nov 23 19:16:48.289096 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.sql.core [None req-8e0b5dfd-f599-40b6-87e5-4bb732fc59fe admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 23 19:16:48.289096 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Nov 23 19:16:48.289096 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [parameters: {'user_id': '61f977e64ec4473bb9a19c64cac041c9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Nov 23 19:16:48.289096 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79233) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 23 19:16:48.306053 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-8e0b5dfd-f599-40b6-87e5-4bb732fc59fe admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Nov 23 19:16:48.307897 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 511/1010] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:16:48 2021] POST /identity/v3/users => generated 160 bytes in 87 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:48.315756 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113c3b5-9fc5-433a-95f4-154d814c52f7 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:48.325823 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113c3b5-9fc5-433a-95f4-154d814c52f7 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:48.331461 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9578a04-3cf8-45d7-bf3d-37daf8d58d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:48.332435 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9578a04-3cf8-45d7-bf3d-37daf8d58d83 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:48.332718 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9578a04-3cf8-45d7-bf3d-37daf8d58d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:48.332991 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9578a04-3cf8-45d7-bf3d-37daf8d58d83 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:48.340993 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9578a04-3cf8-45d7-bf3d-37daf8d58d83 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:48.344346 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9578a04-3cf8-45d7-bf3d-37daf8d58d83 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:48.359742 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-c9578a04-3cf8-45d7-bf3d-37daf8d58d83 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 23 19:16:48.361397 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 500/1011] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:16:48 2021] GET /identity/v3/users/cinder => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:48.368468 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b5dfd-f599-40b6-87e5-4bb732fc59fe admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:48.379827 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b5dfd-f599-40b6-87e5-4bb732fc59fe admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:48.384803 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6bad0-1b04-4c44-a46e-3e175690bf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:48.385607 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6bad0-1b04-4c44-a46e-3e175690bf2e admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:48.385889 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6bad0-1b04-4c44-a46e-3e175690bf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:48.386163 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6bad0-1b04-4c44-a46e-3e175690bf2e admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:48.387038 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6bad0-1b04-4c44-a46e-3e175690bf2e admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:48.387342 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6bad0-1b04-4c44-a46e-3e175690bf2e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:48.390698 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6bad0-1b04-4c44-a46e-3e175690bf2e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:48.432914 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 512/1012] 10.222.0.62 () {56 vars in 1122 bytes} [Tue Nov 23 19:16:48 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:48.819552 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058d788-9147-477a-be2e-a96e5a435606 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:48.820018 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058d788-9147-477a-be2e-a96e5a435606 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:48.820094 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058d788-9147-477a-be2e-a96e5a435606 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:48.822047 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 501/1013] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:48.827900 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83bb5a-5d7c-4e60-aadf-9202091838d6 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:48.828290 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83bb5a-5d7c-4e60-aadf-9202091838d6 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:48.828472 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83bb5a-5d7c-4e60-aadf-9202091838d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:48.846774 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-9a83bb5a-5d7c-4e60-aadf-9202091838d6 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:48.848260 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-9a83bb5a-5d7c-4e60-aadf-9202091838d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:48.855904 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 513/1014] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:48 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:16:48.879690 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058d788-9147-477a-be2e-a96e5a435606 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:48.891663 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058d788-9147-477a-be2e-a96e5a435606 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:48.896140 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10235c-2263-4279-951c-0ea948621e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:48.896935 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10235c-2263-4279-951c-0ea948621e17 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:48.897210 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10235c-2263-4279-951c-0ea948621e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:48.897506 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10235c-2263-4279-951c-0ea948621e17 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:48.898175 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da10235c-2263-4279-951c-0ea948621e17 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:48.899784 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da10235c-2263-4279-951c-0ea948621e17 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:48.912324 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-da10235c-2263-4279-951c-0ea948621e17 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 23 19:16:48.913817 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 502/1015] 10.222.0.62 () {56 vars in 1147 bytes} [Tue Nov 23 19:16:48 2021] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:48.920063 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83bb5a-5d7c-4e60-aadf-9202091838d6 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:48.929775 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83bb5a-5d7c-4e60-aadf-9202091838d6 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:48.934179 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73811164-3c97-4ed0-9ef5-3aaf3bb249b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:48.934820 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73811164-3c97-4ed0-9ef5-3aaf3bb249b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:48.935095 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73811164-3c97-4ed0-9ef5-3aaf3bb249b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:48.935365 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73811164-3c97-4ed0-9ef5-3aaf3bb249b6 admin admin] PATH_INFO: `/v3/services` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:48.936130 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73811164-3c97-4ed0-9ef5-3aaf3bb249b6 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:48.936682 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73811164-3c97-4ed0-9ef5-3aaf3bb249b6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:48.938337 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73811164-3c97-4ed0-9ef5-3aaf3bb249b6 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:48.943374 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 514/1016] 10.222.0.62 () {56 vars in 1143 bytes} [Tue Nov 23 19:16:48 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:48.949602 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10235c-2263-4279-951c-0ea948621e17 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:48.959150 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10235c-2263-4279-951c-0ea948621e17 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:48.963495 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60532b85-c136-4ef5-912d-61b09f4b8255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:48.964132 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60532b85-c136-4ef5-912d-61b09f4b8255 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:48.964408 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60532b85-c136-4ef5-912d-61b09f4b8255 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:48.964679 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60532b85-c136-4ef5-912d-61b09f4b8255 admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:48.965388 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60532b85-c136-4ef5-912d-61b09f4b8255 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:48.965714 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60532b85-c136-4ef5-912d-61b09f4b8255 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:48.967777 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60532b85-c136-4ef5-912d-61b09f4b8255 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:48.972787 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 503/1017] 10.222.0.62 () {56 vars in 1143 bytes} [Tue Nov 23 19:16:48 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:48.978819 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73811164-3c97-4ed0-9ef5-3aaf3bb249b6 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:48.988933 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73811164-3c97-4ed0-9ef5-3aaf3bb249b6 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:48.993278 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2da88-96d4-4c6b-88d2-320c938f655b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:48.993963 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2da88-96d4-4c6b-88d2-320c938f655b admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:48.994242 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2da88-96d4-4c6b-88d2-320c938f655b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:49.002602 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2da88-96d4-4c6b-88d2-320c938f655b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:49.002602 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2da88-96d4-4c6b-88d2-320c938f655b admin admin] RBAC: Adding query filter params (interface=admin, service_id=785cc16cbd6b4079890732db8b96d306, region_id=RegionOne) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:49.002602 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2da88-96d4-4c6b-88d2-320c938f655b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:49.002602 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2da88-96d4-4c6b-88d2-320c938f655b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:49.003372 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 515/1018] 10.222.0.62 () {56 vars in 1270 bytes} [Tue Nov 23 19:16:48 2021] GET /identity/v3/endpoints?service_id=785cc16cbd6b4079890732db8b96d306&interface=admin®ion_id=RegionOne => generated 193 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:49.008862 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60532b85-c136-4ef5-912d-61b09f4b8255 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:49.019358 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60532b85-c136-4ef5-912d-61b09f4b8255 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:49.023806 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246031bd-7235-4eec-8ee9-16c0e39af941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:49.024459 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246031bd-7235-4eec-8ee9-16c0e39af941 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:49.024741 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246031bd-7235-4eec-8ee9-16c0e39af941 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:49.025019 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246031bd-7235-4eec-8ee9-16c0e39af941 admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:49.025736 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246031bd-7235-4eec-8ee9-16c0e39af941 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:49.027286 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246031bd-7235-4eec-8ee9-16c0e39af941 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:49.034786 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 504/1019] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Nov 23 19:16:49 2021] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:16:50.102404 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd456996-9672-423a-8816-59163cde983e None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:50.102903 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd456996-9672-423a-8816-59163cde983e None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:50.102903 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd456996-9672-423a-8816-59163cde983e None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:50.104800 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 516/1020] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:50.110889 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d3acf-070a-4142-b21e-f903c6296a91 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:50.111354 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d3acf-070a-4142-b21e-f903c6296a91 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:50.111541 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d3acf-070a-4142-b21e-f903c6296a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:50.130490 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-c98d3acf-070a-4142-b21e-f903c6296a91 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:50.131691 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-c98d3acf-070a-4142-b21e-f903c6296a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:50.140452 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 505/1021] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:50 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:16:50.166384 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd456996-9672-423a-8816-59163cde983e None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:50.179629 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd456996-9672-423a-8816-59163cde983e None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:50.183963 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae60f6-ccdb-4daf-aefe-a6ae5203b6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:50.184757 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae60f6-ccdb-4daf-aefe-a6ae5203b6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:50.185040 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae60f6-ccdb-4daf-aefe-a6ae5203b6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:50.185312 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae60f6-ccdb-4daf-aefe-a6ae5203b6f4 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:50.186014 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae60f6-ccdb-4daf-aefe-a6ae5203b6f4 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:50.187642 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae60f6-ccdb-4daf-aefe-a6ae5203b6f4 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:50.200292 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-1bae60f6-ccdb-4daf-aefe-a6ae5203b6f4 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 23 19:16:50.202268 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 517/1022] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:50 2021] GET /identity/v3/services/compute => generated 88 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:50.208643 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d3acf-070a-4142-b21e-f903c6296a91 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:50.219337 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d3acf-070a-4142-b21e-f903c6296a91 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:50.223861 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a0742-78db-4808-8671-5967975bdcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:50.224524 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a0742-78db-4808-8671-5967975bdcb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:50.224807 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a0742-78db-4808-8671-5967975bdcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:50.225081 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a0742-78db-4808-8671-5967975bdcb7 admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:50.226654 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a0742-78db-4808-8671-5967975bdcb7 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:50.226654 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a0742-78db-4808-8671-5967975bdcb7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:50.228418 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a0742-78db-4808-8671-5967975bdcb7 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:50.233705 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 506/1023] 10.222.0.62 () {56 vars in 1133 bytes} [Tue Nov 23 19:16:50 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:50.239873 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae60f6-ccdb-4daf-aefe-a6ae5203b6f4 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:50.250713 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae60f6-ccdb-4daf-aefe-a6ae5203b6f4 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:50.255392 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92863641-8eb9-4c07-b683-5975bf81fa22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:50.256054 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92863641-8eb9-4c07-b683-5975bf81fa22 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:50.256342 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92863641-8eb9-4c07-b683-5975bf81fa22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:50.256619 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92863641-8eb9-4c07-b683-5975bf81fa22 admin admin] PATH_INFO: `/v3/services` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:50.257339 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92863641-8eb9-4c07-b683-5975bf81fa22 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:50.257688 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92863641-8eb9-4c07-b683-5975bf81fa22 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:50.259286 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92863641-8eb9-4c07-b683-5975bf81fa22 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:50.266919 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 518/1024] 10.222.0.62 () {56 vars in 1133 bytes} [Tue Nov 23 19:16:50 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:50.273053 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a0742-78db-4808-8671-5967975bdcb7 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:50.283015 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a0742-78db-4808-8671-5967975bdcb7 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:50.287660 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe82ef-8e02-4364-a57a-c123dcc27853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:50.288389 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe82ef-8e02-4364-a57a-c123dcc27853 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:50.288746 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe82ef-8e02-4364-a57a-c123dcc27853 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:50.289100 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe82ef-8e02-4364-a57a-c123dcc27853 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:50.290022 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe82ef-8e02-4364-a57a-c123dcc27853 admin admin] RBAC: Adding query filter params (interface=public, service_id=108e65998f1e4552aca60f73c16a5272, region_id=RegionOne) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:50.290340 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe82ef-8e02-4364-a57a-c123dcc27853 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:50.291936 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe82ef-8e02-4364-a57a-c123dcc27853 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:50.298930 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 507/1025] 10.222.0.62 () {56 vars in 1272 bytes} [Tue Nov 23 19:16:50 2021] GET /identity/v3/endpoints?service_id=108e65998f1e4552aca60f73c16a5272&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:50.305240 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92863641-8eb9-4c07-b683-5975bf81fa22 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:50.315806 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92863641-8eb9-4c07-b683-5975bf81fa22 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:50.321312 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695e2e6-7cf1-41f0-9fb5-a1cbe5079c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:50.322003 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695e2e6-7cf1-41f0-9fb5-a1cbe5079c90 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:50.322554 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695e2e6-7cf1-41f0-9fb5-a1cbe5079c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:50.322832 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695e2e6-7cf1-41f0-9fb5-a1cbe5079c90 admin admin] PATH_INFO: `/v3/services` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:50.323526 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b695e2e6-7cf1-41f0-9fb5-a1cbe5079c90 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:50.325109 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b695e2e6-7cf1-41f0-9fb5-a1cbe5079c90 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:50.332785 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 519/1026] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Nov 23 19:16:50 2021] GET /identity/v3/services => generated 1957 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:16:50.552420 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6fbdb-1992-4bcf-83af-2d124c40f49e None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:50.552773 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6fbdb-1992-4bcf-83af-2d124c40f49e None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:50.552988 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6fbdb-1992-4bcf-83af-2d124c40f49e None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:50.554872 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 508/1027] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:50.562377 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00a496-25a5-463c-bbc9-5753cc99f0ba None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:50.562668 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00a496-25a5-463c-bbc9-5753cc99f0ba None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:50.562946 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00a496-25a5-463c-bbc9-5753cc99f0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:50.581729 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-2a00a496-25a5-463c-bbc9-5753cc99f0ba None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:50.582922 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-2a00a496-25a5-463c-bbc9-5753cc99f0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:50.590706 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 520/1028] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:50 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:16:50.615624 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6fbdb-1992-4bcf-83af-2d124c40f49e None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:50.628089 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6fbdb-1992-4bcf-83af-2d124c40f49e None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:50.632390 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe645556-8703-470d-94c5-5792a04072de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:50.633162 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe645556-8703-470d-94c5-5792a04072de admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:50.633470 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe645556-8703-470d-94c5-5792a04072de admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:50.633752 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe645556-8703-470d-94c5-5792a04072de admin admin] PATH_INFO: `/v3/services/image` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:50.634411 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe645556-8703-470d-94c5-5792a04072de admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:50.635963 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe645556-8703-470d-94c5-5792a04072de admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:50.647504 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-fe645556-8703-470d-94c5-5792a04072de admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 23 19:16:50.648824 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 509/1029] 10.222.0.62 () {56 vars in 1126 bytes} [Tue Nov 23 19:16:50 2021] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:50.655778 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00a496-25a5-463c-bbc9-5753cc99f0ba None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:50.664864 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00a496-25a5-463c-bbc9-5753cc99f0ba None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:50.669323 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46717ff0-383f-42ef-bc20-d9ddc96c58f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:50.670008 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46717ff0-383f-42ef-bc20-d9ddc96c58f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:50.670290 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46717ff0-383f-42ef-bc20-d9ddc96c58f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:50.670623 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46717ff0-383f-42ef-bc20-d9ddc96c58f9 admin admin] PATH_INFO: `/v3/services` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:50.671478 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46717ff0-383f-42ef-bc20-d9ddc96c58f9 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:50.671788 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46717ff0-383f-42ef-bc20-d9ddc96c58f9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:50.673378 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46717ff0-383f-42ef-bc20-d9ddc96c58f9 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:50.678514 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 521/1030] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:50 2021] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:50.684511 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe645556-8703-470d-94c5-5792a04072de admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:50.694218 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe645556-8703-470d-94c5-5792a04072de admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:50.698969 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5e01d-0b0c-4356-b6cc-ab63b66f9d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:50.699615 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5e01d-0b0c-4356-b6cc-ab63b66f9d51 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:50.699916 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5e01d-0b0c-4356-b6cc-ab63b66f9d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:50.700170 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5e01d-0b0c-4356-b6cc-ab63b66f9d51 admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:50.700883 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5e01d-0b0c-4356-b6cc-ab63b66f9d51 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:50.701188 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5e01d-0b0c-4356-b6cc-ab63b66f9d51 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:50.703350 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5e01d-0b0c-4356-b6cc-ab63b66f9d51 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:50.708348 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 510/1031] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:50 2021] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:50.714598 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46717ff0-383f-42ef-bc20-d9ddc96c58f9 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:50.725232 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46717ff0-383f-42ef-bc20-d9ddc96c58f9 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:50.729782 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf23466-91e8-407f-8466-20a04f46537c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:50.730521 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf23466-91e8-407f-8466-20a04f46537c admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:50.730808 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf23466-91e8-407f-8466-20a04f46537c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:50.731084 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf23466-91e8-407f-8466-20a04f46537c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:50.731877 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf23466-91e8-407f-8466-20a04f46537c admin admin] RBAC: Adding query filter params (interface=public, service_id=d297e33904594b6fabeb3c8c6d2ecf69, region_id=RegionOne) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:50.732188 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf23466-91e8-407f-8466-20a04f46537c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:50.734464 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf23466-91e8-407f-8466-20a04f46537c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:50.741059 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 522/1032] 10.222.0.62 () {56 vars in 1272 bytes} [Tue Nov 23 19:16:50 2021] GET /identity/v3/endpoints?service_id=d297e33904594b6fabeb3c8c6d2ecf69&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:50.746350 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5e01d-0b0c-4356-b6cc-ab63b66f9d51 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:50.757018 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5e01d-0b0c-4356-b6cc-ab63b66f9d51 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:50.761569 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f8316-a5a7-4888-8c09-efa3af86eaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:50.762218 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f8316-a5a7-4888-8c09-efa3af86eaae admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:50.762499 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f8316-a5a7-4888-8c09-efa3af86eaae admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:50.762777 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f8316-a5a7-4888-8c09-efa3af86eaae admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:50.763461 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1f8316-a5a7-4888-8c09-efa3af86eaae admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:50.765093 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1f8316-a5a7-4888-8c09-efa3af86eaae admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:50.771817 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 511/1033] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Nov 23 19:16:50 2021] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:16:51.449213 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589abd0-08b2-4d8c-912b-0d6703ea88c0 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:51.449814 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589abd0-08b2-4d8c-912b-0d6703ea88c0 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:51.449814 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589abd0-08b2-4d8c-912b-0d6703ea88c0 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:51.452278 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 523/1034] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:51.458110 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d42aa-a462-4f02-9bc2-3f82d999d123 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:51.458562 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d42aa-a462-4f02-9bc2-3f82d999d123 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:51.458652 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d42aa-a462-4f02-9bc2-3f82d999d123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:51.477676 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-ef9d42aa-a462-4f02-9bc2-3f82d999d123 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:51.478910 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-ef9d42aa-a462-4f02-9bc2-3f82d999d123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:51.487051 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 512/1035] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:51 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:16:51.510812 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589abd0-08b2-4d8c-912b-0d6703ea88c0 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:51.523492 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589abd0-08b2-4d8c-912b-0d6703ea88c0 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:51.527825 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213fa67-44bf-491b-8337-4e77948f419d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:51.528612 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213fa67-44bf-491b-8337-4e77948f419d admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:51.528892 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213fa67-44bf-491b-8337-4e77948f419d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:51.529163 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213fa67-44bf-491b-8337-4e77948f419d admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:51.529913 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213fa67-44bf-491b-8337-4e77948f419d admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:51.532312 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213fa67-44bf-491b-8337-4e77948f419d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:51.543374 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-8213fa67-44bf-491b-8337-4e77948f419d admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 23 19:16:51.544692 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 524/1036] 10.222.0.62 () {56 vars in 1147 bytes} [Tue Nov 23 19:16:51 2021] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:51.551149 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d42aa-a462-4f02-9bc2-3f82d999d123 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:51.560235 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d42aa-a462-4f02-9bc2-3f82d999d123 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:51.565138 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fd0e3-6e5b-43f9-bf8c-67097f890760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:51.565898 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fd0e3-6e5b-43f9-bf8c-67097f890760 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:51.566253 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fd0e3-6e5b-43f9-bf8c-67097f890760 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:51.566597 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fd0e3-6e5b-43f9-bf8c-67097f890760 admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:51.567387 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58fd0e3-6e5b-43f9-bf8c-67097f890760 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:51.567781 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58fd0e3-6e5b-43f9-bf8c-67097f890760 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:51.569652 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58fd0e3-6e5b-43f9-bf8c-67097f890760 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:51.577429 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 513/1037] 10.222.0.62 () {56 vars in 1143 bytes} [Tue Nov 23 19:16:51 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:51.581906 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213fa67-44bf-491b-8337-4e77948f419d admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:51.591477 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213fa67-44bf-491b-8337-4e77948f419d admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:51.596832 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2068ec7-ad19-43b4-b758-9305eaccbfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:51.597502 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2068ec7-ad19-43b4-b758-9305eaccbfd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:51.597788 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2068ec7-ad19-43b4-b758-9305eaccbfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:51.598061 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2068ec7-ad19-43b4-b758-9305eaccbfd4 admin admin] PATH_INFO: `/v3/services` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:51.598775 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2068ec7-ad19-43b4-b758-9305eaccbfd4 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:51.599082 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2068ec7-ad19-43b4-b758-9305eaccbfd4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:51.600646 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2068ec7-ad19-43b4-b758-9305eaccbfd4 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:51.605645 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 525/1038] 10.222.0.62 () {56 vars in 1143 bytes} [Tue Nov 23 19:16:51 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:51.611747 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fd0e3-6e5b-43f9-bf8c-67097f890760 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:51.621717 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fd0e3-6e5b-43f9-bf8c-67097f890760 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:51.626786 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651f50e-ddec-4f02-b49b-56af1cb486eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:51.627433 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651f50e-ddec-4f02-b49b-56af1cb486eb admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:51.627716 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651f50e-ddec-4f02-b49b-56af1cb486eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:51.627992 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651f50e-ddec-4f02-b49b-56af1cb486eb admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:51.628756 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651f50e-ddec-4f02-b49b-56af1cb486eb admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:51.630376 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651f50e-ddec-4f02-b49b-56af1cb486eb admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:51.725496 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 514/1039] 10.222.0.62 () {60 vars in 1165 bytes} [Tue Nov 23 19:16:51 2021] POST /identity/v3/endpoints => generated 325 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:16:52.615039 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119f0a4-9d61-40f4-8bdb-5043fc58baf2 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:52.615636 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119f0a4-9d61-40f4-8bdb-5043fc58baf2 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:52.615636 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119f0a4-9d61-40f4-8bdb-5043fc58baf2 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:52.617533 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 526/1040] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:52.623045 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04d493-9596-4aa1-95ea-597738b2deb1 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:52.623494 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04d493-9596-4aa1-95ea-597738b2deb1 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:52.623589 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04d493-9596-4aa1-95ea-597738b2deb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:52.643155 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-cb04d493-9596-4aa1-95ea-597738b2deb1 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:52.644339 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-cb04d493-9596-4aa1-95ea-597738b2deb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:52.661449 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 515/1041] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:52 2021] POST /identity/v3/auth/tokens => generated 2668 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:16:52.685018 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119f0a4-9d61-40f4-8bdb-5043fc58baf2 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:52.697841 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119f0a4-9d61-40f4-8bdb-5043fc58baf2 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:52.702788 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf16be0-d2b6-45ee-8da4-0f4fff1d22a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:52.703589 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf16be0-d2b6-45ee-8da4-0f4fff1d22a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:52.703871 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf16be0-d2b6-45ee-8da4-0f4fff1d22a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:52.704199 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf16be0-d2b6-45ee-8da4-0f4fff1d22a3 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:52.704865 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf16be0-d2b6-45ee-8da4-0f4fff1d22a3 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:52.706468 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf16be0-d2b6-45ee-8da4-0f4fff1d22a3 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:52.717213 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-ecf16be0-d2b6-45ee-8da4-0f4fff1d22a3 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 23 19:16:52.718564 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 527/1042] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:52 2021] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:52.724771 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04d493-9596-4aa1-95ea-597738b2deb1 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:52.733842 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04d493-9596-4aa1-95ea-597738b2deb1 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:52.738301 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e934e-3340-4c40-8c22-54faa026634f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:52.738952 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e934e-3340-4c40-8c22-54faa026634f admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:52.739240 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e934e-3340-4c40-8c22-54faa026634f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:52.739521 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e934e-3340-4c40-8c22-54faa026634f admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:52.740238 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e934e-3340-4c40-8c22-54faa026634f admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:52.740550 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e934e-3340-4c40-8c22-54faa026634f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:52.742175 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e934e-3340-4c40-8c22-54faa026634f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:52.747237 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 516/1043] 10.222.0.62 () {56 vars in 1133 bytes} [Tue Nov 23 19:16:52 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:52.753626 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf16be0-d2b6-45ee-8da4-0f4fff1d22a3 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:52.763573 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf16be0-d2b6-45ee-8da4-0f4fff1d22a3 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:52.768753 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbd2ad-ccd7-4fd9-a2ba-c8b9d737d942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:52.769395 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbd2ad-ccd7-4fd9-a2ba-c8b9d737d942 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:52.769708 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbd2ad-ccd7-4fd9-a2ba-c8b9d737d942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:52.769989 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbd2ad-ccd7-4fd9-a2ba-c8b9d737d942 admin admin] PATH_INFO: `/v3/services` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:52.770699 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdbd2ad-ccd7-4fd9-a2ba-c8b9d737d942 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:52.771008 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdbd2ad-ccd7-4fd9-a2ba-c8b9d737d942 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:52.772579 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdbd2ad-ccd7-4fd9-a2ba-c8b9d737d942 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:52.777763 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 528/1044] 10.222.0.62 () {56 vars in 1133 bytes} [Tue Nov 23 19:16:52 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:52.786774 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e934e-3340-4c40-8c22-54faa026634f admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:52.796828 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e934e-3340-4c40-8c22-54faa026634f admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:52.801303 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74db7ce-32e4-4b1f-bde5-88ddac4c18bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:52.804566 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74db7ce-32e4-4b1f-bde5-88ddac4c18bc admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:52.804566 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74db7ce-32e4-4b1f-bde5-88ddac4c18bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:52.804566 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74db7ce-32e4-4b1f-bde5-88ddac4c18bc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:52.804566 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74db7ce-32e4-4b1f-bde5-88ddac4c18bc admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:52.804884 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74db7ce-32e4-4b1f-bde5-88ddac4c18bc admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:52.918637 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 517/1045] 10.222.0.62 () {60 vars in 1165 bytes} [Tue Nov 23 19:16:52 2021] POST /identity/v3/endpoints => generated 334 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:16:53.063837 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51abe0-612f-447c-9b6e-33dd6bb4f944 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:53.064259 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51abe0-612f-447c-9b6e-33dd6bb4f944 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:53.064438 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51abe0-612f-447c-9b6e-33dd6bb4f944 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:53.066289 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 529/1046] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:53.073279 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a01441-9312-48f4-a998-3f520b676a1c None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:53.073632 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a01441-9312-48f4-a998-3f520b676a1c None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:53.073847 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a01441-9312-48f4-a998-3f520b676a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:53.093296 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-82a01441-9312-48f4-a998-3f520b676a1c None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:53.094552 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-82a01441-9312-48f4-a998-3f520b676a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:53.113015 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 518/1047] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:53 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:16:53.137597 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51abe0-612f-447c-9b6e-33dd6bb4f944 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:53.150551 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51abe0-612f-447c-9b6e-33dd6bb4f944 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:53.154929 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2247a0-7eed-49bc-b710-bd780d8c27c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:53.156238 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2247a0-7eed-49bc-b710-bd780d8c27c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:53.156521 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2247a0-7eed-49bc-b710-bd780d8c27c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:53.156793 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2247a0-7eed-49bc-b710-bd780d8c27c8 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:53.157480 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2247a0-7eed-49bc-b710-bd780d8c27c8 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:53.159036 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2247a0-7eed-49bc-b710-bd780d8c27c8 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:53.169924 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-8a2247a0-7eed-49bc-b710-bd780d8c27c8 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 23 19:16:53.172245 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 530/1048] 10.222.0.62 () {56 vars in 1126 bytes} [Tue Nov 23 19:16:53 2021] GET /identity/v3/services/image => generated 86 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:53.178696 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a01441-9312-48f4-a998-3f520b676a1c None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:53.188422 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a01441-9312-48f4-a998-3f520b676a1c None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:53.193001 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb7a6c-4643-4be3-b149-5fd99ddb296c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:53.193668 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb7a6c-4643-4be3-b149-5fd99ddb296c admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:53.193949 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb7a6c-4643-4be3-b149-5fd99ddb296c admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:53.194225 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb7a6c-4643-4be3-b149-5fd99ddb296c admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:53.194939 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb7a6c-4643-4be3-b149-5fd99ddb296c admin admin] RBAC: Adding query filter params (name=image) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:53.195244 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb7a6c-4643-4be3-b149-5fd99ddb296c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:53.196813 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb7a6c-4643-4be3-b149-5fd99ddb296c admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:53.203034 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 519/1049] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:53 2021] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:53.208971 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2247a0-7eed-49bc-b710-bd780d8c27c8 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:53.219545 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2247a0-7eed-49bc-b710-bd780d8c27c8 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:53.224185 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1795c-3009-4941-8722-38c8a1fc56c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:53.224851 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1795c-3009-4941-8722-38c8a1fc56c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:53.225127 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1795c-3009-4941-8722-38c8a1fc56c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:53.225395 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1795c-3009-4941-8722-38c8a1fc56c7 admin admin] PATH_INFO: `/v3/services` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:53.226124 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1795c-3009-4941-8722-38c8a1fc56c7 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:53.226424 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1795c-3009-4941-8722-38c8a1fc56c7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:53.227979 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1795c-3009-4941-8722-38c8a1fc56c7 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:53.233669 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 531/1050] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:53 2021] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:53.239605 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb7a6c-4643-4be3-b149-5fd99ddb296c admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:53.250360 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb7a6c-4643-4be3-b149-5fd99ddb296c admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:53.255017 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f606ab-75d5-42ef-8745-91f32f5f76b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:53.255666 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f606ab-75d5-42ef-8745-91f32f5f76b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:53.255975 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f606ab-75d5-42ef-8745-91f32f5f76b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:53.256277 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f606ab-75d5-42ef-8745-91f32f5f76b8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:53.257040 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f606ab-75d5-42ef-8745-91f32f5f76b8 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:53.258642 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f606ab-75d5-42ef-8745-91f32f5f76b8 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:53.335668 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 520/1051] 10.222.0.62 () {60 vars in 1165 bytes} [Tue Nov 23 19:16:53 2021] POST /identity/v3/endpoints => generated 327 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:16:54.027532 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f3671-b9eb-4d54-bfad-0546adfb641c None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:54.028077 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f3671-b9eb-4d54-bfad-0546adfb641c None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:54.028077 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f3671-b9eb-4d54-bfad-0546adfb641c None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:54.030447 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 532/1052] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:54.036408 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77cf4e-2501-4367-9bca-040b631042b8 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:54.036840 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77cf4e-2501-4367-9bca-040b631042b8 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:54.037036 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77cf4e-2501-4367-9bca-040b631042b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:54.054749 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-bc77cf4e-2501-4367-9bca-040b631042b8 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:54.055940 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-bc77cf4e-2501-4367-9bca-040b631042b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:54.074582 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 521/1053] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:54 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:16:54.099976 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f3671-b9eb-4d54-bfad-0546adfb641c None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:54.112397 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f3671-b9eb-4d54-bfad-0546adfb641c None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:54.116736 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ede0b-f8c5-4752-92c2-06bf434237f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:54.117548 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ede0b-f8c5-4752-92c2-06bf434237f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:54.117834 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ede0b-f8c5-4752-92c2-06bf434237f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:54.118108 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ede0b-f8c5-4752-92c2-06bf434237f9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:54.119294 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7ede0b-f8c5-4752-92c2-06bf434237f9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:54.120967 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7ede0b-f8c5-4752-92c2-06bf434237f9 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:54.122658 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 533/1054] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:54 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:54.129509 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77cf4e-2501-4367-9bca-040b631042b8 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:54.138499 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77cf4e-2501-4367-9bca-040b631042b8 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:54.143197 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e892e-9fb4-42dd-8054-8a8e6cd2add2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:54.143847 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e892e-9fb4-42dd-8054-8a8e6cd2add2 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:54.144134 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e892e-9fb4-42dd-8054-8a8e6cd2add2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:54.144411 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e892e-9fb4-42dd-8054-8a8e6cd2add2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:54.145143 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e892e-9fb4-42dd-8054-8a8e6cd2add2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:54.147063 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e892e-9fb4-42dd-8054-8a8e6cd2add2 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:54.239322 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 522/1055] 10.222.0.62 () {60 vars in 1162 bytes} [Tue Nov 23 19:16:54 2021] POST /identity/v3/projects => generated 311 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:16:55.297281 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f5ea7-75ec-4613-8065-708e0ce223fd None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:55.297871 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f5ea7-75ec-4613-8065-708e0ce223fd None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:55.297871 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f5ea7-75ec-4613-8065-708e0ce223fd None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:55.299662 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 534/1056] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:55.305207 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64246e-a6db-4d51-9cc3-ac7d0e798bb2 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:55.305637 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64246e-a6db-4d51-9cc3-ac7d0e798bb2 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:55.305809 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64246e-a6db-4d51-9cc3-ac7d0e798bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:55.323533 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-5a64246e-a6db-4d51-9cc3-ac7d0e798bb2 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:55.324956 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-5a64246e-a6db-4d51-9cc3-ac7d0e798bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:55.381650 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 523/1057] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:55 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:16:55.406898 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f5ea7-75ec-4613-8065-708e0ce223fd None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:55.418924 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f5ea7-75ec-4613-8065-708e0ce223fd None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:55.423745 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1075e7-6dae-4aa6-b265-320fa54fcd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:55.424547 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1075e7-6dae-4aa6-b265-320fa54fcd8b admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:55.424834 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1075e7-6dae-4aa6-b265-320fa54fcd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:55.425105 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1075e7-6dae-4aa6-b265-320fa54fcd8b admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:55.437135 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1075e7-6dae-4aa6-b265-320fa54fcd8b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:55.454497 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-bc1075e7-6dae-4aa6-b265-320fa54fcd8b admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 23 19:16:55.455962 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 535/1058] 10.222.0.62 () {56 vars in 1141 bytes} [Tue Nov 23 19:16:55 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:55.462532 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64246e-a6db-4d51-9cc3-ac7d0e798bb2 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:55.472599 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64246e-a6db-4d51-9cc3-ac7d0e798bb2 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:55.477381 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1609d9a-0620-4681-8383-c4873c79a55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:55.478095 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1609d9a-0620-4681-8383-c4873c79a55b admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:55.478378 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1609d9a-0620-4681-8383-c4873c79a55b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:55.478650 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1609d9a-0620-4681-8383-c4873c79a55b admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:55.479425 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1609d9a-0620-4681-8383-c4873c79a55b admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:55.479733 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1609d9a-0620-4681-8383-c4873c79a55b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:55.481331 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1609d9a-0620-4681-8383-c4873c79a55b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:55.496604 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 524/1059] 10.222.0.62 () {56 vars in 1136 bytes} [Tue Nov 23 19:16:55 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:55.503169 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1075e7-6dae-4aa6-b265-320fa54fcd8b admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:55.512919 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1075e7-6dae-4aa6-b265-320fa54fcd8b admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:55.518287 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbc09f-7b0d-429f-a8a4-3048fdeaf2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:55.519057 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbc09f-7b0d-429f-a8a4-3048fdeaf2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:55.519335 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbc09f-7b0d-429f-a8a4-3048fdeaf2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:55.519629 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbc09f-7b0d-429f-a8a4-3048fdeaf2d8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:55.529686 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bbc09f-7b0d-429f-a8a4-3048fdeaf2d8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:55.531609 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bbc09f-7b0d-429f-a8a4-3048fdeaf2d8 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:55.550298 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-20bbc09f-7b0d-429f-a8a4-3048fdeaf2d8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:55.551556 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 536/1060] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:55.557728 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1609d9a-0620-4681-8383-c4873c79a55b admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:55.568221 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1609d9a-0620-4681-8383-c4873c79a55b admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:55.573070 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e22f1-ace6-4ecc-8dc2-5f9e7ca3a33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:55.573820 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e22f1-ace6-4ecc-8dc2-5f9e7ca3a33c admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:55.574176 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e22f1-ace6-4ecc-8dc2-5f9e7ca3a33c admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:55.574526 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e22f1-ace6-4ecc-8dc2-5f9e7ca3a33c admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:55.575476 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e22f1-ace6-4ecc-8dc2-5f9e7ca3a33c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:55.575875 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e22f1-ace6-4ecc-8dc2-5f9e7ca3a33c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:55.578469 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e22f1-ace6-4ecc-8dc2-5f9e7ca3a33c admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:55.590521 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 525/1061] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:55.596802 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbc09f-7b0d-429f-a8a4-3048fdeaf2d8 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:55.606342 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbc09f-7b0d-429f-a8a4-3048fdeaf2d8 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:55.610814 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9f41d-5ccb-48fd-9d30-9e8db7a9c42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:55.611583 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9f41d-5ccb-48fd-9d30-9e8db7a9c42f admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:55.611860 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9f41d-5ccb-48fd-9d30-9e8db7a9c42f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:55.612128 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9f41d-5ccb-48fd-9d30-9e8db7a9c42f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:55.619303 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9f41d-5ccb-48fd-9d30-9e8db7a9c42f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:55.621269 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9f41d-5ccb-48fd-9d30-9e8db7a9c42f admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:55.628789 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36730fe6-9598-4bcd-839c-319bf4189faf None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:55.629193 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36730fe6-9598-4bcd-839c-319bf4189faf None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:55.629614 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36730fe6-9598-4bcd-839c-319bf4189faf None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:55.631615 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 526/1062] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 19:16:55.635484 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-64e9f41d-5ccb-48fd-9d30-9e8db7a9c42f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 23 19:16:55.636731 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 537/1063] 10.222.0.62 () {56 vars in 1114 bytes} [Tue Nov 23 19:16:55 2021] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:55.637246 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93b224-7eef-4bb9-bb2a-5c162334b1b2 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:55.637587 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93b224-7eef-4bb9-bb2a-5c162334b1b2 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:55.637869 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93b224-7eef-4bb9-bb2a-5c162334b1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:55.643161 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9f41d-5ccb-48fd-9d30-9e8db7a9c42f admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:55.652948 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9f41d-5ccb-48fd-9d30-9e8db7a9c42f admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:55.656499 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-9d93b224-7eef-4bb9-bb2a-5c162334b1b2 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:55.657808 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-9d93b224-7eef-4bb9-bb2a-5c162334b1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:55.657930 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48081c34-9933-4ec9-ae71-e3c6a83095db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:55.658485 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48081c34-9933-4ec9-ae71-e3c6a83095db admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:55.658768 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48081c34-9933-4ec9-ae71-e3c6a83095db admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:55.659050 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48081c34-9933-4ec9-ae71-e3c6a83095db admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:55.659924 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48081c34-9933-4ec9-ae71-e3c6a83095db admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:55.660180 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48081c34-9933-4ec9-ae71-e3c6a83095db admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:55.662025 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48081c34-9933-4ec9-ae71-e3c6a83095db admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:55.666414 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 527/1064] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:55 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:16:55.684334 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 538/1065] 10.222.0.62 () {56 vars in 1154 bytes} [Tue Nov 23 19:16:55 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:55.685484 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93b224-7eef-4bb9-bb2a-5c162334b1b2 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:55.690773 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48081c34-9933-4ec9-ae71-e3c6a83095db admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:55.695221 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93b224-7eef-4bb9-bb2a-5c162334b1b2 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:55.700080 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca97f86-499d-48eb-9ded-e1e1b3faaf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:55.700382 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48081c34-9933-4ec9-ae71-e3c6a83095db admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:55.700711 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca97f86-499d-48eb-9ded-e1e1b3faaf1b admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:55.700989 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca97f86-499d-48eb-9ded-e1e1b3faaf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:55.701264 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca97f86-499d-48eb-9ded-e1e1b3faaf1b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:55.705794 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f67fd-1385-49ba-bff2-6d3bed760557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:55.706415 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f67fd-1385-49ba-bff2-6d3bed760557 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:55.706696 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f67fd-1385-49ba-bff2-6d3bed760557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:55.706972 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f67fd-1385-49ba-bff2-6d3bed760557 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:55.709513 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca97f86-499d-48eb-9ded-e1e1b3faaf1b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:55.711226 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca97f86-499d-48eb-9ded-e1e1b3faaf1b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:55.714773 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f67fd-1385-49ba-bff2-6d3bed760557 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:55.716466 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f67fd-1385-49ba-bff2-6d3bed760557 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:55.720127 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 528/1066] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:16:55 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:16:55.726258 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca97f86-499d-48eb-9ded-e1e1b3faaf1b admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:55.730876 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 539/1067] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:16:55 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:16:55.734727 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca97f86-499d-48eb-9ded-e1e1b3faaf1b admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:55.736968 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f67fd-1385-49ba-bff2-6d3bed760557 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:55.739197 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0d8db-ec20-40da-9a6e-e10991f070a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:55.739949 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0d8db-ec20-40da-9a6e-e10991f070a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:55.740233 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0d8db-ec20-40da-9a6e-e10991f070a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:55.740502 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0d8db-ec20-40da-9a6e-e10991f070a7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:55.745497 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f67fd-1385-49ba-bff2-6d3bed760557 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:55.750631 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cdfb9-f9b8-4db0-a00d-248467ffc792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:55.751401 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cdfb9-f9b8-4db0-a00d-248467ffc792 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:55.751669 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cdfb9-f9b8-4db0-a00d-248467ffc792 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:55.751939 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cdfb9-f9b8-4db0-a00d-248467ffc792 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:55.752641 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0d8db-ec20-40da-9a6e-e10991f070a7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:55.753103 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53cdfb9-f9b8-4db0-a00d-248467ffc792 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:55.754449 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0d8db-ec20-40da-9a6e-e10991f070a7 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:55.754814 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53cdfb9-f9b8-4db0-a00d-248467ffc792 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:55.756456 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 540/1068] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:55 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:55.772077 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-b3a0d8db-ec20-40da-9a6e-e10991f070a7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:55.773557 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 529/1069] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:55.780631 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cdfb9-f9b8-4db0-a00d-248467ffc792 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:55.794644 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cdfb9-f9b8-4db0-a00d-248467ffc792 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:55.800000 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0e510-4981-4373-891b-0e62f7487365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:55.800722 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0e510-4981-4373-891b-0e62f7487365 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:55.800950 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0e510-4981-4373-891b-0e62f7487365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:55.801219 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0e510-4981-4373-891b-0e62f7487365 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:55.804589 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0e510-4981-4373-891b-0e62f7487365 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:55.804589 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0e510-4981-4373-891b-0e62f7487365 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:55.804589 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0e510-4981-4373-891b-0e62f7487365 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:55.816697 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 541/1070] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:55.823269 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0d8db-ec20-40da-9a6e-e10991f070a7 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:55.833537 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0d8db-ec20-40da-9a6e-e10991f070a7 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:55.838156 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a91b4-3f8b-4c63-bfdd-43d4dd04092a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:55.838968 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a91b4-3f8b-4c63-bfdd-43d4dd04092a admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:55.839257 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a91b4-3f8b-4c63-bfdd-43d4dd04092a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:55.839530 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a91b4-3f8b-4c63-bfdd-43d4dd04092a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:55.847686 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a91b4-3f8b-4c63-bfdd-43d4dd04092a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:55.849678 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a91b4-3f8b-4c63-bfdd-43d4dd04092a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:55.864224 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-643a91b4-3f8b-4c63-bfdd-43d4dd04092a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:16:55.865637 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 530/1071] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:55.872016 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0e510-4981-4373-891b-0e62f7487365 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:55.882801 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0e510-4981-4373-891b-0e62f7487365 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:55.888033 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21beeca4-7b24-4b18-9ee5-7af6e218f002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:55.889086 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21beeca4-7b24-4b18-9ee5-7af6e218f002 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:55.890098 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21beeca4-7b24-4b18-9ee5-7af6e218f002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:55.890594 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21beeca4-7b24-4b18-9ee5-7af6e218f002 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:55.891602 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21beeca4-7b24-4b18-9ee5-7af6e218f002 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:55.892105 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21beeca4-7b24-4b18-9ee5-7af6e218f002 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:55.894184 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21beeca4-7b24-4b18-9ee5-7af6e218f002 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:55.908938 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 542/1072] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:16:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:55.915375 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a91b4-3f8b-4c63-bfdd-43d4dd04092a admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:55.926250 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a91b4-3f8b-4c63-bfdd-43d4dd04092a admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:55.930872 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1d39c-a20c-423f-91ea-189ebadeccf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:55.931528 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1d39c-a20c-423f-91ea-189ebadeccf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:55.931811 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1d39c-a20c-423f-91ea-189ebadeccf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:55.932082 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1d39c-a20c-423f-91ea-189ebadeccf0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:55.932938 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae1d39c-a20c-423f-91ea-189ebadeccf0 admin admin] RBAC: Adding query filter params (role.id=9a70e349a52a474991d2d74cbacad01a, scope.project.id=2955b3037801465c9eec5d78fe2e3ae9, user.id=6d91fe7f996b48b0bc28e1eadc4f8869) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:55.933246 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae1d39c-a20c-423f-91ea-189ebadeccf0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:55.935117 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae1d39c-a20c-423f-91ea-189ebadeccf0 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:55.941599 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 531/1073] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:16:55 2021] GET /identity/v3/role_assignments?user.id=6d91fe7f996b48b0bc28e1eadc4f8869&scope.project.id=2955b3037801465c9eec5d78fe2e3ae9&role.id=9a70e349a52a474991d2d74cbacad01a => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:56.618025 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323e5d0-3289-4855-94a9-0483cf7b50f3 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:56.618559 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323e5d0-3289-4855-94a9-0483cf7b50f3 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:56.618559 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323e5d0-3289-4855-94a9-0483cf7b50f3 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:56.620339 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 543/1074] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:56.626783 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f89dfc-1bd3-45cb-b163-63f139a99799 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:56.627237 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f89dfc-1bd3-45cb-b163-63f139a99799 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:56.627464 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f89dfc-1bd3-45cb-b163-63f139a99799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:56.644993 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-04f89dfc-1bd3-45cb-b163-63f139a99799 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:56.646203 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-04f89dfc-1bd3-45cb-b163-63f139a99799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:56.653717 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 532/1075] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:56 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:16:56.680460 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323e5d0-3289-4855-94a9-0483cf7b50f3 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:56.693432 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323e5d0-3289-4855-94a9-0483cf7b50f3 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:56.697960 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57396ac3-cd3d-4882-923d-4d22da66dbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:56.698727 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57396ac3-cd3d-4882-923d-4d22da66dbc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:56.699005 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57396ac3-cd3d-4882-923d-4d22da66dbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:56.699273 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57396ac3-cd3d-4882-923d-4d22da66dbc9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:56.700441 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57396ac3-cd3d-4882-923d-4d22da66dbc9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:56.702742 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57396ac3-cd3d-4882-923d-4d22da66dbc9 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:56.704476 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 544/1076] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:56 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:56.710447 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f89dfc-1bd3-45cb-b163-63f139a99799 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:56.719349 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f89dfc-1bd3-45cb-b163-63f139a99799 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:56.723713 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95f8c6-68c3-4cc4-b559-a85ffa1d4c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:56.724360 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95f8c6-68c3-4cc4-b559-a85ffa1d4c57 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:56.724640 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95f8c6-68c3-4cc4-b559-a85ffa1d4c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:56.724913 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95f8c6-68c3-4cc4-b559-a85ffa1d4c57 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:56.725665 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95f8c6-68c3-4cc4-b559-a85ffa1d4c57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:56.727540 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95f8c6-68c3-4cc4-b559-a85ffa1d4c57 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:56.831023 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 533/1077] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Nov 23 19:16:56 2021] POST /identity/v3/users => generated 285 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:16:58.183957 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf2989-5498-4017-8ad0-41f785551883 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:58.184473 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf2989-5498-4017-8ad0-41f785551883 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:58.184473 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf2989-5498-4017-8ad0-41f785551883 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:58.186203 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 545/1078] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:58.192306 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d4e09-819f-4a9e-941c-cacac47fd2be None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:58.192746 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d4e09-819f-4a9e-941c-cacac47fd2be None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:58.192853 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d4e09-819f-4a9e-941c-cacac47fd2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:58.211245 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-aa6d4e09-819f-4a9e-941c-cacac47fd2be None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:58.212435 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-aa6d4e09-819f-4a9e-941c-cacac47fd2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:58.220657 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 534/1079] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:58 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:16:58.244112 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf2989-5498-4017-8ad0-41f785551883 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:58.256047 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf2989-5498-4017-8ad0-41f785551883 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:58.260253 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f4baf-2d23-41b9-90ca-155193dca417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:58.261030 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f4baf-2d23-41b9-90ca-155193dca417 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:58.261304 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f4baf-2d23-41b9-90ca-155193dca417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:58.261599 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f4baf-2d23-41b9-90ca-155193dca417 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:58.271917 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f4baf-2d23-41b9-90ca-155193dca417 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:58.279173 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-db4f4baf-2d23-41b9-90ca-155193dca417 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 23 19:16:58.280961 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 546/1080] 10.222.0.62 () {56 vars in 1141 bytes} [Tue Nov 23 19:16:58 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:58.287542 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d4e09-819f-4a9e-941c-cacac47fd2be None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:58.296311 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d4e09-819f-4a9e-941c-cacac47fd2be None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:58.300739 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec03e01-d251-478d-ac84-0c36c8024afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:58.301381 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec03e01-d251-478d-ac84-0c36c8024afc admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:58.301696 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec03e01-d251-478d-ac84-0c36c8024afc admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:58.301971 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec03e01-d251-478d-ac84-0c36c8024afc admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:58.302724 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec03e01-d251-478d-ac84-0c36c8024afc admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:58.303030 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec03e01-d251-478d-ac84-0c36c8024afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:58.304592 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec03e01-d251-478d-ac84-0c36c8024afc admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:58.312468 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 535/1081] 10.222.0.62 () {56 vars in 1136 bytes} [Tue Nov 23 19:16:58 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:58.318174 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f4baf-2d23-41b9-90ca-155193dca417 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:58.328726 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f4baf-2d23-41b9-90ca-155193dca417 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:58.333065 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714303fa-1315-44f4-b802-2cee23fca022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:58.333842 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714303fa-1315-44f4-b802-2cee23fca022 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:58.334115 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714303fa-1315-44f4-b802-2cee23fca022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:58.334379 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714303fa-1315-44f4-b802-2cee23fca022 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:58.344683 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714303fa-1315-44f4-b802-2cee23fca022 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:58.346500 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714303fa-1315-44f4-b802-2cee23fca022 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:58.362410 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-714303fa-1315-44f4-b802-2cee23fca022 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:58.363523 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 547/1082] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:58.369635 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec03e01-d251-478d-ac84-0c36c8024afc admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:58.379135 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec03e01-d251-478d-ac84-0c36c8024afc admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:58.383663 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0c2fb-0c32-4803-b4a5-4ec788d814ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:58.384366 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0c2fb-0c32-4803-b4a5-4ec788d814ac admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:58.384731 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0c2fb-0c32-4803-b4a5-4ec788d814ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:58.385075 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0c2fb-0c32-4803-b4a5-4ec788d814ac admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:58.385923 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0c2fb-0c32-4803-b4a5-4ec788d814ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:58.386301 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0c2fb-0c32-4803-b4a5-4ec788d814ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:58.387916 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0c2fb-0c32-4803-b4a5-4ec788d814ac admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:58.399941 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 536/1083] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:58.406065 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714303fa-1315-44f4-b802-2cee23fca022 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:58.415317 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714303fa-1315-44f4-b802-2cee23fca022 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:58.419710 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165674ce-d1bc-46b3-9c4c-3094ed339b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:58.420453 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165674ce-d1bc-46b3-9c4c-3094ed339b86 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:58.421312 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165674ce-d1bc-46b3-9c4c-3094ed339b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:58.421610 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165674ce-d1bc-46b3-9c4c-3094ed339b86 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:58.428615 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165674ce-d1bc-46b3-9c4c-3094ed339b86 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:58.430587 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165674ce-d1bc-46b3-9c4c-3094ed339b86 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:58.444537 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-165674ce-d1bc-46b3-9c4c-3094ed339b86 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 23 19:16:58.445663 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 548/1084] 10.222.0.62 () {56 vars in 1114 bytes} [Tue Nov 23 19:16:58 2021] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:58.452028 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0c2fb-0c32-4803-b4a5-4ec788d814ac admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:58.461632 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0c2fb-0c32-4803-b4a5-4ec788d814ac admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:58.466079 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1964d1f-17ce-4aaf-976e-4b1b0d90ee81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:58.466728 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1964d1f-17ce-4aaf-976e-4b1b0d90ee81 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:58.467010 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1964d1f-17ce-4aaf-976e-4b1b0d90ee81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:58.467283 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1964d1f-17ce-4aaf-976e-4b1b0d90ee81 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:58.468398 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1964d1f-17ce-4aaf-976e-4b1b0d90ee81 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:58.468710 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1964d1f-17ce-4aaf-976e-4b1b0d90ee81 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:58.470546 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1964d1f-17ce-4aaf-976e-4b1b0d90ee81 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:58.489086 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 537/1085] 10.222.0.62 () {56 vars in 1154 bytes} [Tue Nov 23 19:16:58 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:58.495295 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165674ce-d1bc-46b3-9c4c-3094ed339b86 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:58.505706 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165674ce-d1bc-46b3-9c4c-3094ed339b86 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:58.510100 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd0d20-2a62-4e46-8308-546786b7687b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:58.510872 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd0d20-2a62-4e46-8308-546786b7687b admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:58.511148 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd0d20-2a62-4e46-8308-546786b7687b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:58.511416 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd0d20-2a62-4e46-8308-546786b7687b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:58.521686 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd0d20-2a62-4e46-8308-546786b7687b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:58.523490 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd0d20-2a62-4e46-8308-546786b7687b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:58.540453 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-92fd0d20-2a62-4e46-8308-546786b7687b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:16:58.541611 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 549/1086] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:16:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:58.548551 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1964d1f-17ce-4aaf-976e-4b1b0d90ee81 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:58.558159 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1964d1f-17ce-4aaf-976e-4b1b0d90ee81 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:58.563034 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84fe89-777e-430a-b7f5-9e5019041e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:58.563679 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84fe89-777e-430a-b7f5-9e5019041e87 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:58.563965 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84fe89-777e-430a-b7f5-9e5019041e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:58.564242 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84fe89-777e-430a-b7f5-9e5019041e87 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:58.564973 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf84fe89-777e-430a-b7f5-9e5019041e87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:58.565281 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf84fe89-777e-430a-b7f5-9e5019041e87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:58.566879 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf84fe89-777e-430a-b7f5-9e5019041e87 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:58.578217 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 538/1087] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:16:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:58.584290 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd0d20-2a62-4e46-8308-546786b7687b admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:58.594389 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd0d20-2a62-4e46-8308-546786b7687b admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:58.598755 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbfdb3-1045-4750-9a20-1e3be15dc3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:58.599518 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbfdb3-1045-4750-9a20-1e3be15dc3b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:58.599790 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbfdb3-1045-4750-9a20-1e3be15dc3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:58.600055 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbfdb3-1045-4750-9a20-1e3be15dc3b4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:58.606607 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbfdb3-1045-4750-9a20-1e3be15dc3b4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:58.609090 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbfdb3-1045-4750-9a20-1e3be15dc3b4 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:58.621534 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-8dbbfdb3-1045-4750-9a20-1e3be15dc3b4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:16:58.623323 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 550/1088] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:16:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:16:58.629703 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84fe89-777e-430a-b7f5-9e5019041e87 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:58.639274 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84fe89-777e-430a-b7f5-9e5019041e87 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:58.643782 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68227a06-4d40-4be4-aa95-a0bc36071c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:58.644449 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68227a06-4d40-4be4-aa95-a0bc36071c9d admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:58.644733 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68227a06-4d40-4be4-aa95-a0bc36071c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:58.645012 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68227a06-4d40-4be4-aa95-a0bc36071c9d admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:58.645843 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68227a06-4d40-4be4-aa95-a0bc36071c9d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:58.646159 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68227a06-4d40-4be4-aa95-a0bc36071c9d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:58.647969 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68227a06-4d40-4be4-aa95-a0bc36071c9d admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:58.660261 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 539/1089] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:16:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:58.666782 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbfdb3-1045-4750-9a20-1e3be15dc3b4 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:58.677522 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbfdb3-1045-4750-9a20-1e3be15dc3b4 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:58.681909 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa08b2-c10e-495e-8afc-bd4cf8114d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:58.682769 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa08b2-c10e-495e-8afc-bd4cf8114d70 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:58.683045 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa08b2-c10e-495e-8afc-bd4cf8114d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:58.683312 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa08b2-c10e-495e-8afc-bd4cf8114d70 admin admin] PATH_INFO: `/v3/projects/2955b3037801465c9eec5d78fe2e3ae9/users/6d91fe7f996b48b0bc28e1eadc4f8869/roles/9a70e349a52a474991d2d74cbacad01a` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:58.685499 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa08b2-c10e-495e-8afc-bd4cf8114d70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2955b3037801465c9eec5d78fe2e3ae9, user_id=6d91fe7f996b48b0bc28e1eadc4f8869, role_id=9a70e349a52a474991d2d74cbacad01a)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:58.688079 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa08b2-c10e-495e-8afc-bd4cf8114d70 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:58.792377 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 551/1090] 10.222.0.62 () {58 vars in 1460 bytes} [Tue Nov 23 19:16:58 2021] PUT /identity/v3/projects/2955b3037801465c9eec5d78fe2e3ae9/users/6d91fe7f996b48b0bc28e1eadc4f8869/roles/9a70e349a52a474991d2d74cbacad01a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:16:59.120498 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502764f4-01e9-44a0-905e-ee9d9cf08639 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:59.120709 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502764f4-01e9-44a0-905e-ee9d9cf08639 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:59.120990 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502764f4-01e9-44a0-905e-ee9d9cf08639 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:59.122810 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 540/1091] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:16:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:16:59.128969 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacee42-03cb-4c07-a9bf-53ec9a42dcd0 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:59.129259 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacee42-03cb-4c07-a9bf-53ec9a42dcd0 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:59.129571 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacee42-03cb-4c07-a9bf-53ec9a42dcd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:59.147387 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-0dacee42-03cb-4c07-a9bf-53ec9a42dcd0 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:16:59.148560 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-0dacee42-03cb-4c07-a9bf-53ec9a42dcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:16:59.205434 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 552/1092] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:16:59 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:16:59.230752 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502764f4-01e9-44a0-905e-ee9d9cf08639 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:59.242588 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502764f4-01e9-44a0-905e-ee9d9cf08639 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:59.246893 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce196da-5adf-49f9-8892-055784bd341b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:59.247664 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce196da-5adf-49f9-8892-055784bd341b admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:59.247940 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce196da-5adf-49f9-8892-055784bd341b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:59.248208 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce196da-5adf-49f9-8892-055784bd341b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:59.258670 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce196da-5adf-49f9-8892-055784bd341b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:16:59.266073 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-fce196da-5adf-49f9-8892-055784bd341b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 19:16:59.267206 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 541/1093] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:16:59 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:16:59.273618 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dacee42-03cb-4c07-a9bf-53ec9a42dcd0 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:59.282442 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dacee42-03cb-4c07-a9bf-53ec9a42dcd0 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:59.286888 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2a2a7-fd2d-4e1d-8304-c07f4b231894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:59.287533 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2a2a7-fd2d-4e1d-8304-c07f4b231894 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:59.287810 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2a2a7-fd2d-4e1d-8304-c07f4b231894 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:59.288076 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2a2a7-fd2d-4e1d-8304-c07f4b231894 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:59.288819 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2a2a7-fd2d-4e1d-8304-c07f4b231894 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:59.289119 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2a2a7-fd2d-4e1d-8304-c07f4b231894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:59.290703 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2a2a7-fd2d-4e1d-8304-c07f4b231894 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:59.298724 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 553/1094] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:16:59 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:59.304789 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce196da-5adf-49f9-8892-055784bd341b admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:59.315371 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce196da-5adf-49f9-8892-055784bd341b admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:59.319824 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c3961-2a60-43e5-bac2-f467251afc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:59.320677 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c3961-2a60-43e5-bac2-f467251afc31 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:59.320941 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c3961-2a60-43e5-bac2-f467251afc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:59.321218 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c3961-2a60-43e5-bac2-f467251afc31 admin admin] PATH_INFO: `/v3/users/c17634d9b27d42329596146fb6acdc15` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:59.334900 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c3961-2a60-43e5-bac2-f467251afc31 admin admin] RBAC: Authorizing `identity:get_user(user_id=c17634d9b27d42329596146fb6acdc15)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:59.336980 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c3961-2a60-43e5-bac2-f467251afc31 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:59.338617 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 542/1095] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:16:59 2021] GET /identity/v3/users/c17634d9b27d42329596146fb6acdc15 => generated 285 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:16:59.345392 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2a2a7-fd2d-4e1d-8304-c07f4b231894 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:59.354618 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2a2a7-fd2d-4e1d-8304-c07f4b231894 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:59.359277 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9382ca-d82c-4870-ad41-e9fe1feac399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:59.359893 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9382ca-d82c-4870-ad41-e9fe1feac399 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:59.360171 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9382ca-d82c-4870-ad41-e9fe1feac399 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:59.360441 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9382ca-d82c-4870-ad41-e9fe1feac399 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:59.367783 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9382ca-d82c-4870-ad41-e9fe1feac399 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:59.369504 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9382ca-d82c-4870-ad41-e9fe1feac399 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:59.378598 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 554/1096] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:16:59 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:16:59.384847 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c3961-2a60-43e5-bac2-f467251afc31 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:59.394581 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c3961-2a60-43e5-bac2-f467251afc31 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:59.398928 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7376d-3e8c-4da2-8f72-2ceee763cdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:59.399749 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7376d-3e8c-4da2-8f72-2ceee763cdf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:59.400024 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7376d-3e8c-4da2-8f72-2ceee763cdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:59.400293 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7376d-3e8c-4da2-8f72-2ceee763cdf2 admin admin] PATH_INFO: `/v3/projects/9b36694724054cc58cec97736dec98cd` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:59.401466 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7376d-3e8c-4da2-8f72-2ceee763cdf2 admin admin] RBAC: Authorizing `identity:get_project(project_id=9b36694724054cc58cec97736dec98cd)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:59.403415 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7376d-3e8c-4da2-8f72-2ceee763cdf2 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:59.405018 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 543/1097] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:16:59 2021] GET /identity/v3/projects/9b36694724054cc58cec97736dec98cd => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:16:59.412593 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9382ca-d82c-4870-ad41-e9fe1feac399 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:16:59.421962 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9382ca-d82c-4870-ad41-e9fe1feac399 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:16:59.426521 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a925b3-7a44-47dc-ba19-7f77c6937e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:16:59.427140 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a925b3-7a44-47dc-ba19-7f77c6937e4b admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:16:59.427423 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a925b3-7a44-47dc-ba19-7f77c6937e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:16:59.427698 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a925b3-7a44-47dc-ba19-7f77c6937e4b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:16:59.428519 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a925b3-7a44-47dc-ba19-7f77c6937e4b admin admin] RBAC: Adding query filter params (role.id=6d9a8878ffeb49fea19d854657c6b767, scope.project.id=9b36694724054cc58cec97736dec98cd, user.id=c17634d9b27d42329596146fb6acdc15) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:16:59.428835 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a925b3-7a44-47dc-ba19-7f77c6937e4b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:16:59.430727 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a925b3-7a44-47dc-ba19-7f77c6937e4b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:16:59.435926 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 555/1098] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:16:59 2021] GET /identity/v3/role_assignments?user.id=c17634d9b27d42329596146fb6acdc15&scope.project.id=9b36694724054cc58cec97736dec98cd&role.id=6d9a8878ffeb49fea19d854657c6b767 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:01.071692 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137b77e-a569-42db-9d86-6203a8401016 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:01.072235 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137b77e-a569-42db-9d86-6203a8401016 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:01.072235 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137b77e-a569-42db-9d86-6203a8401016 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:01.074241 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 544/1099] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:17:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:17:01.080656 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8394be-c468-49da-a74d-4d8e34b02f42 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:01.081069 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8394be-c468-49da-a74d-4d8e34b02f42 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:01.081338 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8394be-c468-49da-a74d-4d8e34b02f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:01.098804 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-6a8394be-c468-49da-a74d-4d8e34b02f42 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:17:01.100064 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-6a8394be-c468-49da-a74d-4d8e34b02f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:17:01.107679 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 556/1100] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:17:01 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:17:01.132650 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137b77e-a569-42db-9d86-6203a8401016 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:01.144625 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137b77e-a569-42db-9d86-6203a8401016 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:01.148978 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e3831-caa9-4dde-b3cf-4a5f10f8394a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:01.149794 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e3831-caa9-4dde-b3cf-4a5f10f8394a admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:01.150079 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e3831-caa9-4dde-b3cf-4a5f10f8394a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:01.150353 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e3831-caa9-4dde-b3cf-4a5f10f8394a admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:01.160290 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e3831-caa9-4dde-b3cf-4a5f10f8394a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:17:01.167653 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-f48e3831-caa9-4dde-b3cf-4a5f10f8394a admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 23 19:17:01.168945 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 545/1101] 10.222.0.62 () {56 vars in 1141 bytes} [Tue Nov 23 19:17:01 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:17:01.176021 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8394be-c468-49da-a74d-4d8e34b02f42 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:01.185024 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8394be-c468-49da-a74d-4d8e34b02f42 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:01.190341 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a3259-f474-49a1-b81a-726e63679055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:01.191087 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a3259-f474-49a1-b81a-726e63679055 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:01.191435 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a3259-f474-49a1-b81a-726e63679055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:01.191712 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a3259-f474-49a1-b81a-726e63679055 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:01.192468 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a3259-f474-49a1-b81a-726e63679055 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:17:01.192776 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a3259-f474-49a1-b81a-726e63679055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:01.194397 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a3259-f474-49a1-b81a-726e63679055 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:01.202862 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 557/1102] 10.222.0.62 () {56 vars in 1136 bytes} [Tue Nov 23 19:17:01 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:01.209206 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e3831-caa9-4dde-b3cf-4a5f10f8394a admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:01.219659 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e3831-caa9-4dde-b3cf-4a5f10f8394a admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:01.224155 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbaaff1-d263-47c2-bbd2-6d47de556ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:01.224927 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbaaff1-d263-47c2-bbd2-6d47de556ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:01.225212 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbaaff1-d263-47c2-bbd2-6d47de556ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:01.225521 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbaaff1-d263-47c2-bbd2-6d47de556ff3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:01.236346 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbaaff1-d263-47c2-bbd2-6d47de556ff3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:01.238171 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbaaff1-d263-47c2-bbd2-6d47de556ff3 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:01.254606 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-3cbaaff1-d263-47c2-bbd2-6d47de556ff3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:17:01.255760 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 546/1103] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:17:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:17:01.262025 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a3259-f474-49a1-b81a-726e63679055 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:01.272262 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a3259-f474-49a1-b81a-726e63679055 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:01.276776 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d4b3c-fc30-4cde-81ff-e24b7f6165b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:01.277531 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d4b3c-fc30-4cde-81ff-e24b7f6165b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:01.277881 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d4b3c-fc30-4cde-81ff-e24b7f6165b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:01.278224 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d4b3c-fc30-4cde-81ff-e24b7f6165b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:01.279028 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d4b3c-fc30-4cde-81ff-e24b7f6165b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:17:01.279402 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d4b3c-fc30-4cde-81ff-e24b7f6165b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:01.281851 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d4b3c-fc30-4cde-81ff-e24b7f6165b7 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:01.294226 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 558/1104] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:17:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:01.300505 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbaaff1-d263-47c2-bbd2-6d47de556ff3 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:01.310100 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbaaff1-d263-47c2-bbd2-6d47de556ff3 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:01.314595 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609b172-abc0-4354-a2c4-9ff9d0129688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:01.315373 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609b172-abc0-4354-a2c4-9ff9d0129688 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:01.315656 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609b172-abc0-4354-a2c4-9ff9d0129688 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:01.315929 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609b172-abc0-4354-a2c4-9ff9d0129688 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:01.323526 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609b172-abc0-4354-a2c4-9ff9d0129688 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:01.325487 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609b172-abc0-4354-a2c4-9ff9d0129688 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:01.340580 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-6609b172-abc0-4354-a2c4-9ff9d0129688 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 23 19:17:01.341742 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 547/1105] 10.222.0.62 () {56 vars in 1114 bytes} [Tue Nov 23 19:17:01 2021] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:17:01.348094 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d4b3c-fc30-4cde-81ff-e24b7f6165b7 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:01.357574 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d4b3c-fc30-4cde-81ff-e24b7f6165b7 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:01.362742 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b2f34-30da-4b59-8cc1-f6ddd5b6a731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:01.363389 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b2f34-30da-4b59-8cc1-f6ddd5b6a731 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:01.363671 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b2f34-30da-4b59-8cc1-f6ddd5b6a731 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:01.363948 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b2f34-30da-4b59-8cc1-f6ddd5b6a731 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:01.364787 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b2f34-30da-4b59-8cc1-f6ddd5b6a731 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:17:01.365095 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b2f34-30da-4b59-8cc1-f6ddd5b6a731 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:01.366939 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b2f34-30da-4b59-8cc1-f6ddd5b6a731 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:01.384113 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 559/1106] 10.222.0.62 () {56 vars in 1154 bytes} [Tue Nov 23 19:17:01 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:01.390825 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609b172-abc0-4354-a2c4-9ff9d0129688 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:01.400283 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609b172-abc0-4354-a2c4-9ff9d0129688 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:01.404698 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba35685-99f0-4f23-99cb-51f6e536e545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:01.405970 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba35685-99f0-4f23-99cb-51f6e536e545 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:01.406253 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba35685-99f0-4f23-99cb-51f6e536e545 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:01.406523 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba35685-99f0-4f23-99cb-51f6e536e545 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:01.414053 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba35685-99f0-4f23-99cb-51f6e536e545 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:01.415758 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba35685-99f0-4f23-99cb-51f6e536e545 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:01.424359 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 548/1107] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:17:01 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:17:01.430418 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b2f34-30da-4b59-8cc1-f6ddd5b6a731 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:01.439898 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b2f34-30da-4b59-8cc1-f6ddd5b6a731 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:01.444371 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507a597-dde6-4076-b5f9-55038267fb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:01.445146 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507a597-dde6-4076-b5f9-55038267fb7b admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:01.445449 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507a597-dde6-4076-b5f9-55038267fb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:01.445732 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507a597-dde6-4076-b5f9-55038267fb7b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:01.456400 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507a597-dde6-4076-b5f9-55038267fb7b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:01.458226 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507a597-dde6-4076-b5f9-55038267fb7b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:01.475384 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-1507a597-dde6-4076-b5f9-55038267fb7b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:17:01.476660 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 560/1108] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:17:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:17:01.484046 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba35685-99f0-4f23-99cb-51f6e536e545 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:01.493587 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba35685-99f0-4f23-99cb-51f6e536e545 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:01.498318 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2cea97-7562-4aba-9518-c6a59b6ddb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:01.499842 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cea97-7562-4aba-9518-c6a59b6ddb57 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:01.500185 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cea97-7562-4aba-9518-c6a59b6ddb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:01.500288 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cea97-7562-4aba-9518-c6a59b6ddb57 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:01.501027 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2cea97-7562-4aba-9518-c6a59b6ddb57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:17:01.501331 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2cea97-7562-4aba-9518-c6a59b6ddb57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:01.502966 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2cea97-7562-4aba-9518-c6a59b6ddb57 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:01.516019 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 549/1109] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:17:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:17:01.522451 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507a597-dde6-4076-b5f9-55038267fb7b admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:01.537763 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507a597-dde6-4076-b5f9-55038267fb7b admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:01.542257 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e36de-2daa-412f-a493-25a6fe064f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:01.543035 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e36de-2daa-412f-a493-25a6fe064f85 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:01.543314 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e36de-2daa-412f-a493-25a6fe064f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:01.543584 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e36de-2daa-412f-a493-25a6fe064f85 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:01.551008 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e36de-2daa-412f-a493-25a6fe064f85 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:01.552895 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e36de-2daa-412f-a493-25a6fe064f85 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:01.565708 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-618e36de-2daa-412f-a493-25a6fe064f85 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:17:01.566851 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 561/1110] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:17:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:17:01.573772 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2cea97-7562-4aba-9518-c6a59b6ddb57 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:01.583416 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2cea97-7562-4aba-9518-c6a59b6ddb57 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:01.588025 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda7b12-f23e-417b-a97a-b95b2a27b1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:01.588664 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda7b12-f23e-417b-a97a-b95b2a27b1fb admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:01.588944 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda7b12-f23e-417b-a97a-b95b2a27b1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:01.589215 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda7b12-f23e-417b-a97a-b95b2a27b1fb admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:01.590034 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda7b12-f23e-417b-a97a-b95b2a27b1fb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:17:01.590342 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda7b12-f23e-417b-a97a-b95b2a27b1fb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:01.592137 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda7b12-f23e-417b-a97a-b95b2a27b1fb admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:01.604622 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 550/1111] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:17:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:01.612426 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e36de-2daa-412f-a493-25a6fe064f85 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:01.622566 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e36de-2daa-412f-a493-25a6fe064f85 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:01.627535 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a5598-a7bd-4b89-b4e0-dcc7a116a832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:01.628163 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a5598-a7bd-4b89-b4e0-dcc7a116a832 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:01.628442 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a5598-a7bd-4b89-b4e0-dcc7a116a832 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:01.628713 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a5598-a7bd-4b89-b4e0-dcc7a116a832 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:01.629581 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a5598-a7bd-4b89-b4e0-dcc7a116a832 admin admin] RBAC: Adding query filter params (role.id=9a70e349a52a474991d2d74cbacad01a, scope.project.id=2955b3037801465c9eec5d78fe2e3ae9, user.id=6d91fe7f996b48b0bc28e1eadc4f8869) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:17:01.629893 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a5598-a7bd-4b89-b4e0-dcc7a116a832 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:01.631689 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a5598-a7bd-4b89-b4e0-dcc7a116a832 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:01.637386 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 562/1112] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:17:01 2021] GET /identity/v3/role_assignments?user.id=6d91fe7f996b48b0bc28e1eadc4f8869&scope.project.id=2955b3037801465c9eec5d78fe2e3ae9&role.id=9a70e349a52a474991d2d74cbacad01a => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:01.654397 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4929708-78a5-42cd-aefa-e4cc7e31d5bb None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:01.654688 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4929708-78a5-42cd-aefa-e4cc7e31d5bb None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:01.654989 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4929708-78a5-42cd-aefa-e4cc7e31d5bb None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:01.657453 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 551/1113] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:17:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:17:01.664043 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba536a15-4a38-428f-8a18-dd34d619f3f6 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:01.664331 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba536a15-4a38-428f-8a18-dd34d619f3f6 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:01.664609 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba536a15-4a38-428f-8a18-dd34d619f3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:01.683154 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-ba536a15-4a38-428f-8a18-dd34d619f3f6 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:17:01.684376 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-ba536a15-4a38-428f-8a18-dd34d619f3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:17:01.692553 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 563/1114] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:17:01 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:17:01.717036 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4929708-78a5-42cd-aefa-e4cc7e31d5bb None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:01.730173 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4929708-78a5-42cd-aefa-e4cc7e31d5bb None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:01.735437 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff28c1c-f7a2-450e-aa9b-dc912d060d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:01.736238 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff28c1c-f7a2-450e-aa9b-dc912d060d23 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:01.736514 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff28c1c-f7a2-450e-aa9b-dc912d060d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:01.736782 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff28c1c-f7a2-450e-aa9b-dc912d060d23 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:01.747440 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff28c1c-f7a2-450e-aa9b-dc912d060d23 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:17:01.754460 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-6ff28c1c-f7a2-450e-aa9b-dc912d060d23 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 19:17:01.755890 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 552/1115] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:17:01 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:17:01.762710 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba536a15-4a38-428f-8a18-dd34d619f3f6 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:01.773289 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba536a15-4a38-428f-8a18-dd34d619f3f6 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:01.778051 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f31e02-2ac1-4897-90a4-9ab67cf9da2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:01.778814 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f31e02-2ac1-4897-90a4-9ab67cf9da2a admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:01.779099 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f31e02-2ac1-4897-90a4-9ab67cf9da2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:01.779375 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f31e02-2ac1-4897-90a4-9ab67cf9da2a admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:01.780718 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f31e02-2ac1-4897-90a4-9ab67cf9da2a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:17:01.781073 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f31e02-2ac1-4897-90a4-9ab67cf9da2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:01.782725 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f31e02-2ac1-4897-90a4-9ab67cf9da2a admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:01.798163 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 564/1116] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:17:01 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:01.799477 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff28c1c-f7a2-450e-aa9b-dc912d060d23 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:01.809781 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff28c1c-f7a2-450e-aa9b-dc912d060d23 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:01.814566 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f91a1b-f96b-4bcb-9aaa-205e121d90fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:01.815556 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f91a1b-f96b-4bcb-9aaa-205e121d90fb admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:01.815847 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f91a1b-f96b-4bcb-9aaa-205e121d90fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:01.816123 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f91a1b-f96b-4bcb-9aaa-205e121d90fb admin admin] PATH_INFO: `/v3/users/c17634d9b27d42329596146fb6acdc15` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:01.817374 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f91a1b-f96b-4bcb-9aaa-205e121d90fb admin admin] RBAC: Authorizing `identity:get_user(user_id=c17634d9b27d42329596146fb6acdc15)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:01.819547 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f91a1b-f96b-4bcb-9aaa-205e121d90fb admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:01.829300 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 553/1117] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:17:01 2021] GET /identity/v3/users/c17634d9b27d42329596146fb6acdc15 => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:01.832406 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f31e02-2ac1-4897-90a4-9ab67cf9da2a admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:01.881499 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f31e02-2ac1-4897-90a4-9ab67cf9da2a admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:01.881499 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45c311-8bc5-4d33-91da-0a7b878a6c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:01.881499 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45c311-8bc5-4d33-91da-0a7b878a6c8f admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:01.881499 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45c311-8bc5-4d33-91da-0a7b878a6c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:01.881921 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45c311-8bc5-4d33-91da-0a7b878a6c8f admin admin] PATH_INFO: `/v3/projects/9b36694724054cc58cec97736dec98cd` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:01.881921 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45c311-8bc5-4d33-91da-0a7b878a6c8f admin admin] RBAC: Authorizing `identity:get_project(project_id=9b36694724054cc58cec97736dec98cd)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:01.881921 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45c311-8bc5-4d33-91da-0a7b878a6c8f admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:01.881921 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 565/1118] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:17:01 2021] GET /identity/v3/projects/9b36694724054cc58cec97736dec98cd => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:01.882238 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f91a1b-f96b-4bcb-9aaa-205e121d90fb admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:01.882238 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f91a1b-f96b-4bcb-9aaa-205e121d90fb admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:01.882238 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85cf36-89e0-4358-b800-20ca6f6ccfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:01.882238 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85cf36-89e0-4358-b800-20ca6f6ccfce admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:01.882501 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85cf36-89e0-4358-b800-20ca6f6ccfce admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:01.882501 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85cf36-89e0-4358-b800-20ca6f6ccfce admin admin] PATH_INFO: `/v3/projects/9b36694724054cc58cec97736dec98cd/users/c17634d9b27d42329596146fb6acdc15/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:01.882501 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85cf36-89e0-4358-b800-20ca6f6ccfce admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b36694724054cc58cec97736dec98cd, user_id=c17634d9b27d42329596146fb6acdc15, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:01.883672 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85cf36-89e0-4358-b800-20ca6f6ccfce admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:01.955864 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 554/1119] 10.222.0.62 () {58 vars in 1460 bytes} [Tue Nov 23 19:17:01 2021] PUT /identity/v3/projects/9b36694724054cc58cec97736dec98cd/users/c17634d9b27d42329596146fb6acdc15/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:17:04.171180 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228f54f-4402-4edc-962a-39d2360f8e28 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:04.171685 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228f54f-4402-4edc-962a-39d2360f8e28 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:04.171685 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228f54f-4402-4edc-962a-39d2360f8e28 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:04.173490 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 566/1120] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:17:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:17:04.179382 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a3524-4849-4d8e-92d1-110d17e1c38e None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:04.179799 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a3524-4849-4d8e-92d1-110d17e1c38e None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:04.179937 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a3524-4849-4d8e-92d1-110d17e1c38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:04.196894 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-9b6a3524-4849-4d8e-92d1-110d17e1c38e None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:17:04.198380 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-9b6a3524-4849-4d8e-92d1-110d17e1c38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:17:04.253777 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 555/1121] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:17:04 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:17:04.278513 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228f54f-4402-4edc-962a-39d2360f8e28 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:04.290964 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228f54f-4402-4edc-962a-39d2360f8e28 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:04.295239 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70462219-4648-4bde-aee9-00194c09eec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:04.296064 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70462219-4648-4bde-aee9-00194c09eec7 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:04.296407 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70462219-4648-4bde-aee9-00194c09eec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:04.296682 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70462219-4648-4bde-aee9-00194c09eec7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:04.306860 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70462219-4648-4bde-aee9-00194c09eec7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:17:04.313852 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-70462219-4648-4bde-aee9-00194c09eec7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 19:17:04.314965 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 567/1122] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:17:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:17:04.321144 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a3524-4849-4d8e-92d1-110d17e1c38e None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:04.330717 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a3524-4849-4d8e-92d1-110d17e1c38e None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:04.335139 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65107456-83d7-4192-aefb-e78436ab3045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:04.335785 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65107456-83d7-4192-aefb-e78436ab3045 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:04.336068 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65107456-83d7-4192-aefb-e78436ab3045 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:04.336342 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65107456-83d7-4192-aefb-e78436ab3045 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:04.337092 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65107456-83d7-4192-aefb-e78436ab3045 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:17:04.337397 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65107456-83d7-4192-aefb-e78436ab3045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:04.338973 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65107456-83d7-4192-aefb-e78436ab3045 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:04.347760 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 556/1123] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:17:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:04.353626 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70462219-4648-4bde-aee9-00194c09eec7 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:04.363035 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70462219-4648-4bde-aee9-00194c09eec7 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:04.367475 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d6649-a609-489e-8984-79b065369f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:04.368293 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d6649-a609-489e-8984-79b065369f2e admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:04.368574 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d6649-a609-489e-8984-79b065369f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:04.368846 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d6649-a609-489e-8984-79b065369f2e admin admin] PATH_INFO: `/v3/users/c17634d9b27d42329596146fb6acdc15` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:04.370042 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d6649-a609-489e-8984-79b065369f2e admin admin] RBAC: Authorizing `identity:get_user(user_id=c17634d9b27d42329596146fb6acdc15)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:04.372110 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d6649-a609-489e-8984-79b065369f2e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:04.373835 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 568/1124] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:17:04 2021] GET /identity/v3/users/c17634d9b27d42329596146fb6acdc15 => generated 285 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:04.379573 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65107456-83d7-4192-aefb-e78436ab3045 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:04.388706 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65107456-83d7-4192-aefb-e78436ab3045 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:04.393904 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650fe759-851c-4fcb-b86e-2b30c04371e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:04.394509 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fe759-851c-4fcb-b86e-2b30c04371e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:04.394794 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fe759-851c-4fcb-b86e-2b30c04371e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:04.395071 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fe759-851c-4fcb-b86e-2b30c04371e7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:04.402578 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650fe759-851c-4fcb-b86e-2b30c04371e7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:04.404256 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650fe759-851c-4fcb-b86e-2b30c04371e7 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:04.413656 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 557/1125] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:17:04 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:17:04.419656 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d6649-a609-489e-8984-79b065369f2e admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:04.428793 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d6649-a609-489e-8984-79b065369f2e admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:04.433119 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9e329-200f-41ff-ae43-28784c81fec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:04.433947 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9e329-200f-41ff-ae43-28784c81fec0 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:04.434227 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9e329-200f-41ff-ae43-28784c81fec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:04.434498 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9e329-200f-41ff-ae43-28784c81fec0 admin admin] PATH_INFO: `/v3/projects/9b36694724054cc58cec97736dec98cd` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:04.435658 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9e329-200f-41ff-ae43-28784c81fec0 admin admin] RBAC: Authorizing `identity:get_project(project_id=9b36694724054cc58cec97736dec98cd)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:04.437656 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9e329-200f-41ff-ae43-28784c81fec0 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:04.439252 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 569/1126] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:17:04 2021] GET /identity/v3/projects/9b36694724054cc58cec97736dec98cd => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:04.446306 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650fe759-851c-4fcb-b86e-2b30c04371e7 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:04.455613 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650fe759-851c-4fcb-b86e-2b30c04371e7 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:04.460075 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78518b5-463a-43ca-b239-6192221e15ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:04.460684 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78518b5-463a-43ca-b239-6192221e15ac admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:04.460966 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78518b5-463a-43ca-b239-6192221e15ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:04.461241 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78518b5-463a-43ca-b239-6192221e15ac admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:04.462102 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78518b5-463a-43ca-b239-6192221e15ac admin admin] RBAC: Adding query filter params (role.id=6d9a8878ffeb49fea19d854657c6b767, scope.project.id=9b36694724054cc58cec97736dec98cd, user.id=c17634d9b27d42329596146fb6acdc15) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:17:04.462416 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78518b5-463a-43ca-b239-6192221e15ac admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:04.464167 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78518b5-463a-43ca-b239-6192221e15ac admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:04.470487 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 558/1127] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:17:04 2021] GET /identity/v3/role_assignments?user.id=c17634d9b27d42329596146fb6acdc15&scope.project.id=9b36694724054cc58cec97736dec98cd&role.id=6d9a8878ffeb49fea19d854657c6b767 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:06.738413 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4e95f-d0f1-424f-8f67-fe67efe6dbd2 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:06.738949 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4e95f-d0f1-424f-8f67-fe67efe6dbd2 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:06.738949 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4e95f-d0f1-424f-8f67-fe67efe6dbd2 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:06.740731 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 570/1128] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:17:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:17:06.746392 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374f2c2-d563-47d8-9b9d-a66d259c8949 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:06.746788 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374f2c2-d563-47d8-9b9d-a66d259c8949 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:06.746957 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374f2c2-d563-47d8-9b9d-a66d259c8949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:06.765003 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-9374f2c2-d563-47d8-9b9d-a66d259c8949 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:17:06.766305 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-9374f2c2-d563-47d8-9b9d-a66d259c8949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:17:06.773814 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 559/1129] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:17:06 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:17:06.800534 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4e95f-d0f1-424f-8f67-fe67efe6dbd2 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:06.812531 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4e95f-d0f1-424f-8f67-fe67efe6dbd2 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:06.816826 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685aac3-5620-4497-b647-760ce16619db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:06.817622 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685aac3-5620-4497-b647-760ce16619db admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:06.817906 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685aac3-5620-4497-b647-760ce16619db admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:06.818183 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685aac3-5620-4497-b647-760ce16619db admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:06.819355 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685aac3-5620-4497-b647-760ce16619db admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:06.821009 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685aac3-5620-4497-b647-760ce16619db admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:06.822616 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 571/1130] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:17:06 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:06.828879 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374f2c2-d563-47d8-9b9d-a66d259c8949 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:06.837636 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374f2c2-d563-47d8-9b9d-a66d259c8949 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:06.842118 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f91c44-0397-4e91-beb6-749ac2d3fbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:06.843351 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f91c44-0397-4e91-beb6-749ac2d3fbbc admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:06.843676 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f91c44-0397-4e91-beb6-749ac2d3fbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:06.843957 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f91c44-0397-4e91-beb6-749ac2d3fbbc admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:06.844672 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f91c44-0397-4e91-beb6-749ac2d3fbbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:06.846569 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f91c44-0397-4e91-beb6-749ac2d3fbbc admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:06.957186 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 560/1131] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Nov 23 19:17:06 2021] POST /identity/v3/users => generated 286 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:17:09.257942 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd31036-9c20-41b1-bc12-6402b58d9951 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:09.258464 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd31036-9c20-41b1-bc12-6402b58d9951 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:09.258573 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd31036-9c20-41b1-bc12-6402b58d9951 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:09.260269 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 572/1132] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:17:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:17:09.266090 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7daff8-b36f-4d54-8cc3-b284762ed8fd None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:09.267773 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7daff8-b36f-4d54-8cc3-b284762ed8fd None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:09.267773 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7daff8-b36f-4d54-8cc3-b284762ed8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:09.284784 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-2d7daff8-b36f-4d54-8cc3-b284762ed8fd None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:17:09.285997 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-2d7daff8-b36f-4d54-8cc3-b284762ed8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:17:09.293541 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 561/1133] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:17:09 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:17:09.318270 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd31036-9c20-41b1-bc12-6402b58d9951 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:09.330508 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd31036-9c20-41b1-bc12-6402b58d9951 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:09.334823 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cebe8b-e264-48be-b35f-e2244ac25123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:09.335651 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cebe8b-e264-48be-b35f-e2244ac25123 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:09.335933 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cebe8b-e264-48be-b35f-e2244ac25123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:09.336207 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cebe8b-e264-48be-b35f-e2244ac25123 admin admin] PATH_INFO: `/v3/roles/bc8a8682d8f748788fb70d235f9978dc` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:09.337693 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cebe8b-e264-48be-b35f-e2244ac25123 admin admin] RBAC: Authorizing `identity:get_role(role_id=bc8a8682d8f748788fb70d235f9978dc)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:09.338697 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING py.warnings [None req-28cebe8b-e264-48be-b35f-e2244ac25123 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:17:09.338697 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: warnings.warn(msg) Nov 23 19:17:09.338697 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: Nov 23 19:17:09.339560 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cebe8b-e264-48be-b35f-e2244ac25123 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:09.340858 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 573/1134] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:17:09 2021] GET /identity/v3/roles/bc8a8682d8f748788fb70d235f9978dc => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:09.347531 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7daff8-b36f-4d54-8cc3-b284762ed8fd None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:09.356288 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7daff8-b36f-4d54-8cc3-b284762ed8fd None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:09.361445 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a99841-58b9-4ee2-bab6-67123916e736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:09.362295 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a99841-58b9-4ee2-bab6-67123916e736 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:09.362578 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a99841-58b9-4ee2-bab6-67123916e736 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:09.362853 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a99841-58b9-4ee2-bab6-67123916e736 admin admin] PATH_INFO: `/v3/users/60c83f5da9c24e4dbf595340faf831ed` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:09.375783 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a99841-58b9-4ee2-bab6-67123916e736 admin admin] RBAC: Authorizing `identity:get_user(user_id=60c83f5da9c24e4dbf595340faf831ed)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:09.377915 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a99841-58b9-4ee2-bab6-67123916e736 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:09.379504 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 562/1135] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:17:09 2021] GET /identity/v3/users/60c83f5da9c24e4dbf595340faf831ed => generated 286 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:09.385430 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cebe8b-e264-48be-b35f-e2244ac25123 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:09.395103 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cebe8b-e264-48be-b35f-e2244ac25123 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:09.399481 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b228be2-1f6b-48c0-bfd3-9df3c7b41c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:09.400087 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b228be2-1f6b-48c0-bfd3-9df3c7b41c0a admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:09.400392 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b228be2-1f6b-48c0-bfd3-9df3c7b41c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:09.400666 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b228be2-1f6b-48c0-bfd3-9df3c7b41c0a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:09.409012 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b228be2-1f6b-48c0-bfd3-9df3c7b41c0a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:09.410742 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b228be2-1f6b-48c0-bfd3-9df3c7b41c0a admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:09.419317 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 574/1136] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:17:09 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:17:09.425541 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a99841-58b9-4ee2-bab6-67123916e736 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:09.434765 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a99841-58b9-4ee2-bab6-67123916e736 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:09.439255 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5cb9c-a450-4cf5-be08-f409f898826a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:09.440069 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5cb9c-a450-4cf5-be08-f409f898826a admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:09.440352 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5cb9c-a450-4cf5-be08-f409f898826a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:09.440625 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5cb9c-a450-4cf5-be08-f409f898826a admin admin] PATH_INFO: `/v3/projects/9b36694724054cc58cec97736dec98cd` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:09.441820 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5cb9c-a450-4cf5-be08-f409f898826a admin admin] RBAC: Authorizing `identity:get_project(project_id=9b36694724054cc58cec97736dec98cd)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:09.443793 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5cb9c-a450-4cf5-be08-f409f898826a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:09.445401 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 563/1137] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:17:09 2021] GET /identity/v3/projects/9b36694724054cc58cec97736dec98cd => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:09.451678 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b228be2-1f6b-48c0-bfd3-9df3c7b41c0a admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:09.460690 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b228be2-1f6b-48c0-bfd3-9df3c7b41c0a admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:09.465131 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57040fde-184e-488b-8148-0f2a7398e001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:09.465781 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57040fde-184e-488b-8148-0f2a7398e001 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:09.466065 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57040fde-184e-488b-8148-0f2a7398e001 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:09.466342 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57040fde-184e-488b-8148-0f2a7398e001 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:09.467158 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57040fde-184e-488b-8148-0f2a7398e001 admin admin] RBAC: Adding query filter params (role.id=bc8a8682d8f748788fb70d235f9978dc, scope.project.id=9b36694724054cc58cec97736dec98cd, user.id=60c83f5da9c24e4dbf595340faf831ed) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:17:09.467466 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57040fde-184e-488b-8148-0f2a7398e001 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:09.469984 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57040fde-184e-488b-8148-0f2a7398e001 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:09.475108 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 575/1138] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:17:09 2021] GET /identity/v3/role_assignments?user.id=60c83f5da9c24e4dbf595340faf831ed&scope.project.id=9b36694724054cc58cec97736dec98cd&role.id=bc8a8682d8f748788fb70d235f9978dc => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:11.696418 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597094d0-e62a-4c7c-9d5f-64144fa9ef9d None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:11.696990 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597094d0-e62a-4c7c-9d5f-64144fa9ef9d None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:11.696990 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597094d0-e62a-4c7c-9d5f-64144fa9ef9d None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:11.699073 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 564/1139] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:17:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:17:11.704820 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a4e64-0a8c-4dfc-9cf2-2a679c0b7d63 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:11.705234 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a4e64-0a8c-4dfc-9cf2-2a679c0b7d63 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:11.705366 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a4e64-0a8c-4dfc-9cf2-2a679c0b7d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:11.722358 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-0e0a4e64-0a8c-4dfc-9cf2-2a679c0b7d63 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:17:11.723513 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-0e0a4e64-0a8c-4dfc-9cf2-2a679c0b7d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:17:11.730836 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 576/1140] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:17:11 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:17:11.755011 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597094d0-e62a-4c7c-9d5f-64144fa9ef9d None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:11.767002 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597094d0-e62a-4c7c-9d5f-64144fa9ef9d None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:11.771243 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f4345-e134-4ede-bf83-8c1d7795e94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:11.772063 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f4345-e134-4ede-bf83-8c1d7795e94e admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:11.772343 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f4345-e134-4ede-bf83-8c1d7795e94e admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:11.772619 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f4345-e134-4ede-bf83-8c1d7795e94e admin admin] PATH_INFO: `/v3/roles/bc8a8682d8f748788fb70d235f9978dc` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:11.774116 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f4345-e134-4ede-bf83-8c1d7795e94e admin admin] RBAC: Authorizing `identity:get_role(role_id=bc8a8682d8f748788fb70d235f9978dc)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:11.775113 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING py.warnings [None req-8f7f4345-e134-4ede-bf83-8c1d7795e94e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:17:11.775113 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: warnings.warn(msg) Nov 23 19:17:11.775113 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: Nov 23 19:17:11.775972 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f4345-e134-4ede-bf83-8c1d7795e94e admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:11.777276 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 565/1141] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:17:11 2021] GET /identity/v3/roles/bc8a8682d8f748788fb70d235f9978dc => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:11.783056 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a4e64-0a8c-4dfc-9cf2-2a679c0b7d63 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:11.791724 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a4e64-0a8c-4dfc-9cf2-2a679c0b7d63 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:11.796617 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2fc0b-6cb2-4502-8e29-3e0253015d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:11.797521 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2fc0b-6cb2-4502-8e29-3e0253015d8e admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:11.797798 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2fc0b-6cb2-4502-8e29-3e0253015d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:11.798066 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2fc0b-6cb2-4502-8e29-3e0253015d8e admin admin] PATH_INFO: `/v3/users/60c83f5da9c24e4dbf595340faf831ed` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:11.799247 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2fc0b-6cb2-4502-8e29-3e0253015d8e admin admin] RBAC: Authorizing `identity:get_user(user_id=60c83f5da9c24e4dbf595340faf831ed)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:11.801311 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2fc0b-6cb2-4502-8e29-3e0253015d8e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:11.804343 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 577/1142] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:17:11 2021] GET /identity/v3/users/60c83f5da9c24e4dbf595340faf831ed => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:11.808857 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f4345-e134-4ede-bf83-8c1d7795e94e admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:11.819047 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f4345-e134-4ede-bf83-8c1d7795e94e admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:11.823732 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5131a-55a9-45bd-b219-8e88ea2ec07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:11.824587 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5131a-55a9-45bd-b219-8e88ea2ec07f admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:11.824866 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5131a-55a9-45bd-b219-8e88ea2ec07f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:11.825145 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5131a-55a9-45bd-b219-8e88ea2ec07f admin admin] PATH_INFO: `/v3/projects/9b36694724054cc58cec97736dec98cd` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:11.826357 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c5131a-55a9-45bd-b219-8e88ea2ec07f admin admin] RBAC: Authorizing `identity:get_project(project_id=9b36694724054cc58cec97736dec98cd)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:11.829092 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c5131a-55a9-45bd-b219-8e88ea2ec07f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:11.830768 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 566/1143] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:17:11 2021] GET /identity/v3/projects/9b36694724054cc58cec97736dec98cd => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:11.836641 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2fc0b-6cb2-4502-8e29-3e0253015d8e admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:11.845929 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2fc0b-6cb2-4502-8e29-3e0253015d8e admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:11.850319 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78eff3-1240-4081-a4c0-7072759b6878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:11.851159 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78eff3-1240-4081-a4c0-7072759b6878 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:11.851434 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78eff3-1240-4081-a4c0-7072759b6878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:11.851701 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78eff3-1240-4081-a4c0-7072759b6878 admin admin] PATH_INFO: `/v3/projects/9b36694724054cc58cec97736dec98cd/users/60c83f5da9c24e4dbf595340faf831ed/roles/bc8a8682d8f748788fb70d235f9978dc` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:11.853893 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78eff3-1240-4081-a4c0-7072759b6878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b36694724054cc58cec97736dec98cd, user_id=60c83f5da9c24e4dbf595340faf831ed, role_id=bc8a8682d8f748788fb70d235f9978dc)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:11.856420 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78eff3-1240-4081-a4c0-7072759b6878 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:11.957963 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 578/1144] 10.222.0.62 () {58 vars in 1460 bytes} [Tue Nov 23 19:17:11 2021] PUT /identity/v3/projects/9b36694724054cc58cec97736dec98cd/users/60c83f5da9c24e4dbf595340faf831ed/roles/bc8a8682d8f748788fb70d235f9978dc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:17:14.204602 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3badd28-0c19-453b-a7d0-2d0d741e651e None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:14.205137 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3badd28-0c19-453b-a7d0-2d0d741e651e None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:14.205137 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3badd28-0c19-453b-a7d0-2d0d741e651e None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:14.206959 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 567/1145] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:17:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:17:14.212691 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a77d5-ab4d-4c88-a313-9bf52a87b364 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:14.213060 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a77d5-ab4d-4c88-a313-9bf52a87b364 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:14.213239 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a77d5-ab4d-4c88-a313-9bf52a87b364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:14.230876 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-a44a77d5-ab4d-4c88-a313-9bf52a87b364 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:17:14.232039 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-a44a77d5-ab4d-4c88-a313-9bf52a87b364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:17:14.286701 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 579/1146] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:17:14 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:17:14.311713 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3badd28-0c19-453b-a7d0-2d0d741e651e None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:14.323708 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3badd28-0c19-453b-a7d0-2d0d741e651e None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:14.328079 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a52a93-e392-40f5-9e24-dc4db05a52ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:14.328891 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a52a93-e392-40f5-9e24-dc4db05a52ec admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:14.329165 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a52a93-e392-40f5-9e24-dc4db05a52ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:14.329454 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a52a93-e392-40f5-9e24-dc4db05a52ec admin admin] PATH_INFO: `/v3/roles/bc8a8682d8f748788fb70d235f9978dc` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:14.330905 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a52a93-e392-40f5-9e24-dc4db05a52ec admin admin] RBAC: Authorizing `identity:get_role(role_id=bc8a8682d8f748788fb70d235f9978dc)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:14.332446 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a52a93-e392-40f5-9e24-dc4db05a52ec admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:14.333763 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 568/1147] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:17:14 2021] GET /identity/v3/roles/bc8a8682d8f748788fb70d235f9978dc => generated 223 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:14.339664 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a77d5-ab4d-4c88-a313-9bf52a87b364 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:14.349048 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a77d5-ab4d-4c88-a313-9bf52a87b364 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:14.353519 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca8e3e-301a-4b48-8cf0-f8196ab144e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:14.354367 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca8e3e-301a-4b48-8cf0-f8196ab144e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:14.354651 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca8e3e-301a-4b48-8cf0-f8196ab144e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:14.354927 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca8e3e-301a-4b48-8cf0-f8196ab144e2 admin admin] PATH_INFO: `/v3/users/60c83f5da9c24e4dbf595340faf831ed` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:14.356118 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca8e3e-301a-4b48-8cf0-f8196ab144e2 admin admin] RBAC: Authorizing `identity:get_user(user_id=60c83f5da9c24e4dbf595340faf831ed)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:14.358241 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca8e3e-301a-4b48-8cf0-f8196ab144e2 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:14.360534 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 580/1148] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:17:14 2021] GET /identity/v3/users/60c83f5da9c24e4dbf595340faf831ed => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:14.366258 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a52a93-e392-40f5-9e24-dc4db05a52ec admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:14.375314 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a52a93-e392-40f5-9e24-dc4db05a52ec admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:14.379668 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb075c-8fa5-4904-8acd-702490c9af6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:14.380256 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb075c-8fa5-4904-8acd-702490c9af6e admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:14.380531 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb075c-8fa5-4904-8acd-702490c9af6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:14.380803 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb075c-8fa5-4904-8acd-702490c9af6e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:14.388210 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb075c-8fa5-4904-8acd-702490c9af6e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:14.389924 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb075c-8fa5-4904-8acd-702490c9af6e admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:14.398423 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 569/1149] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:17:14 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:17:14.404363 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca8e3e-301a-4b48-8cf0-f8196ab144e2 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:14.414706 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca8e3e-301a-4b48-8cf0-f8196ab144e2 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:14.419146 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3423ed-5da2-48d6-b216-ddd7539d9187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:14.419957 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3423ed-5da2-48d6-b216-ddd7539d9187 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:14.420276 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3423ed-5da2-48d6-b216-ddd7539d9187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:14.420552 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3423ed-5da2-48d6-b216-ddd7539d9187 admin admin] PATH_INFO: `/v3/projects/9b36694724054cc58cec97736dec98cd` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:14.422701 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3423ed-5da2-48d6-b216-ddd7539d9187 admin admin] RBAC: Authorizing `identity:get_project(project_id=9b36694724054cc58cec97736dec98cd)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:14.424772 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3423ed-5da2-48d6-b216-ddd7539d9187 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:14.426441 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 581/1150] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:17:14 2021] GET /identity/v3/projects/9b36694724054cc58cec97736dec98cd => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:14.432491 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb075c-8fa5-4904-8acd-702490c9af6e admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:14.440840 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb075c-8fa5-4904-8acd-702490c9af6e admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:14.445164 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97703f30-6402-465d-9a3c-fdaf54552eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:14.445801 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97703f30-6402-465d-9a3c-fdaf54552eec admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:14.446079 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97703f30-6402-465d-9a3c-fdaf54552eec admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:14.446346 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97703f30-6402-465d-9a3c-fdaf54552eec admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:14.447154 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97703f30-6402-465d-9a3c-fdaf54552eec admin admin] RBAC: Adding query filter params (role.id=bc8a8682d8f748788fb70d235f9978dc, scope.project.id=9b36694724054cc58cec97736dec98cd, user.id=60c83f5da9c24e4dbf595340faf831ed) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:17:14.447457 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97703f30-6402-465d-9a3c-fdaf54552eec admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:14.449493 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97703f30-6402-465d-9a3c-fdaf54552eec admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:14.454991 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 570/1151] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:17:14 2021] GET /identity/v3/role_assignments?user.id=60c83f5da9c24e4dbf595340faf831ed&scope.project.id=9b36694724054cc58cec97736dec98cd&role.id=bc8a8682d8f748788fb70d235f9978dc => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:17:16.743036 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f87f15-b1a6-4f99-afe1-31e4a52f6296 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:16.743570 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f87f15-b1a6-4f99-afe1-31e4a52f6296 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:16.743570 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f87f15-b1a6-4f99-afe1-31e4a52f6296 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:16.745359 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 582/1152] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:17:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:17:16.751144 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fad356-6e91-4434-b4f7-c9189b484ec0 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:16.751622 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fad356-6e91-4434-b4f7-c9189b484ec0 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:16.751717 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fad356-6e91-4434-b4f7-c9189b484ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:16.768829 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-20fad356-6e91-4434-b4f7-c9189b484ec0 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:17:16.770083 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-20fad356-6e91-4434-b4f7-c9189b484ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:17:16.778443 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 571/1153] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:17:16 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:17:16.805432 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f87f15-b1a6-4f99-afe1-31e4a52f6296 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:16.817781 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f87f15-b1a6-4f99-afe1-31e4a52f6296 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:16.822089 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ece79-26c7-499e-ac9d-a7e88947d7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:16.822859 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ece79-26c7-499e-ac9d-a7e88947d7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:16.823141 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ece79-26c7-499e-ac9d-a7e88947d7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:16.823678 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ece79-26c7-499e-ac9d-a7e88947d7c5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:16.824846 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ece79-26c7-499e-ac9d-a7e88947d7c5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:16.826538 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ece79-26c7-499e-ac9d-a7e88947d7c5 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:16.828624 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 583/1154] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:17:16 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:16.834660 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fad356-6e91-4434-b4f7-c9189b484ec0 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:16.844080 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fad356-6e91-4434-b4f7-c9189b484ec0 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:16.848517 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361c8e4-db8f-4341-9558-9fae910af05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:16.849150 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361c8e4-db8f-4341-9558-9fae910af05b admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:16.849459 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361c8e4-db8f-4341-9558-9fae910af05b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:16.849739 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361c8e4-db8f-4341-9558-9fae910af05b admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:16.850463 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361c8e4-db8f-4341-9558-9fae910af05b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:16.852314 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361c8e4-db8f-4341-9558-9fae910af05b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:16.954433 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 572/1155] 10.222.0.62 () {60 vars in 1162 bytes} [Tue Nov 23 19:17:16 2021] POST /identity/v3/projects => generated 311 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:17:19.257389 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b06cd-22f2-4a6e-b073-ba8c4466a56b None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:19.257965 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b06cd-22f2-4a6e-b073-ba8c4466a56b None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:19.258061 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b06cd-22f2-4a6e-b073-ba8c4466a56b None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:19.259767 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 584/1156] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:17:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:17:19.266426 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcda10-ceaf-4ee1-bc2c-ecfd2a44b3ce None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:19.266807 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcda10-ceaf-4ee1-bc2c-ecfd2a44b3ce None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:19.266990 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcda10-ceaf-4ee1-bc2c-ecfd2a44b3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:19.285115 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-31fcda10-ceaf-4ee1-bc2c-ecfd2a44b3ce None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:17:19.286329 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-31fcda10-ceaf-4ee1-bc2c-ecfd2a44b3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:17:19.341277 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 573/1157] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:17:19 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:17:19.367997 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b06cd-22f2-4a6e-b073-ba8c4466a56b None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:19.379673 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b06cd-22f2-4a6e-b073-ba8c4466a56b None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:19.383980 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c69084b-eb13-4883-bf9b-6bcae933ff81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:19.384741 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69084b-eb13-4883-bf9b-6bcae933ff81 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:19.385016 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69084b-eb13-4883-bf9b-6bcae933ff81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:19.385285 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69084b-eb13-4883-bf9b-6bcae933ff81 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:19.386476 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c69084b-eb13-4883-bf9b-6bcae933ff81 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:19.388120 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c69084b-eb13-4883-bf9b-6bcae933ff81 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:19.389692 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 585/1158] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:17:19 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:19.396233 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcda10-ceaf-4ee1-bc2c-ecfd2a44b3ce None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:19.404871 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fcda10-ceaf-4ee1-bc2c-ecfd2a44b3ce None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:19.410384 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903bd9d-8f43-42de-971a-c99e13fd0583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:19.411031 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903bd9d-8f43-42de-971a-c99e13fd0583 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:19.411315 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903bd9d-8f43-42de-971a-c99e13fd0583 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:19.411592 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903bd9d-8f43-42de-971a-c99e13fd0583 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:19.412306 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903bd9d-8f43-42de-971a-c99e13fd0583 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:19.414208 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903bd9d-8f43-42de-971a-c99e13fd0583 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:19.495074 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 574/1159] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Nov 23 19:17:19 2021] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:17:21.779179 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986af16-ce37-4061-8c09-4ba06b9a1e6c None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:21.779713 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986af16-ce37-4061-8c09-4ba06b9a1e6c None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:21.779713 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986af16-ce37-4061-8c09-4ba06b9a1e6c None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:21.782435 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 586/1160] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:17:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:17:21.788286 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7b905-c60a-431a-a18d-5d83a556e6c3 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:21.788740 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7b905-c60a-431a-a18d-5d83a556e6c3 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:21.788832 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7b905-c60a-431a-a18d-5d83a556e6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:21.807178 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-b5e7b905-c60a-431a-a18d-5d83a556e6c3 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:17:21.808392 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-b5e7b905-c60a-431a-a18d-5d83a556e6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:17:21.816030 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 575/1161] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:17:21 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:17:21.840370 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986af16-ce37-4061-8c09-4ba06b9a1e6c None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:21.852703 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986af16-ce37-4061-8c09-4ba06b9a1e6c None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:21.856936 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb5b18-5325-4938-a447-48dc54a90cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:21.857725 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb5b18-5325-4938-a447-48dc54a90cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:21.858005 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb5b18-5325-4938-a447-48dc54a90cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:21.858273 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb5b18-5325-4938-a447-48dc54a90cf4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:21.868819 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb5b18-5325-4938-a447-48dc54a90cf4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:17:21.875946 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-dccb5b18-5325-4938-a447-48dc54a90cf4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 19:17:21.877057 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 587/1162] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:17:21 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:17:21.883208 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7b905-c60a-431a-a18d-5d83a556e6c3 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:21.892154 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7b905-c60a-431a-a18d-5d83a556e6c3 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:21.896610 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1245ee2-cb44-4af0-a6bd-db27b52a280c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:21.897251 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1245ee2-cb44-4af0-a6bd-db27b52a280c admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:21.897578 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1245ee2-cb44-4af0-a6bd-db27b52a280c admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:21.897856 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1245ee2-cb44-4af0-a6bd-db27b52a280c admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:21.898608 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1245ee2-cb44-4af0-a6bd-db27b52a280c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:17:21.898912 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1245ee2-cb44-4af0-a6bd-db27b52a280c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:21.900468 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1245ee2-cb44-4af0-a6bd-db27b52a280c admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:21.909108 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 576/1163] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:17:21 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:21.914916 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb5b18-5325-4938-a447-48dc54a90cf4 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:21.925429 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb5b18-5325-4938-a447-48dc54a90cf4 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:21.929810 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9dca3e-a782-42da-bda2-89c0fe55c587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:21.930623 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dca3e-a782-42da-bda2-89c0fe55c587 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:21.930896 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dca3e-a782-42da-bda2-89c0fe55c587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:21.931162 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dca3e-a782-42da-bda2-89c0fe55c587 admin admin] PATH_INFO: `/v3/users/f64e33d7b20147988751ade1f66cbea3` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:21.943619 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9dca3e-a782-42da-bda2-89c0fe55c587 admin admin] RBAC: Authorizing `identity:get_user(user_id=f64e33d7b20147988751ade1f66cbea3)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:21.945709 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9dca3e-a782-42da-bda2-89c0fe55c587 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:21.947275 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 588/1164] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:17:21 2021] GET /identity/v3/users/f64e33d7b20147988751ade1f66cbea3 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:21.953693 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1245ee2-cb44-4af0-a6bd-db27b52a280c admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:21.963018 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1245ee2-cb44-4af0-a6bd-db27b52a280c admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:21.967494 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d103cd-7f9d-473c-bb87-b4cc40466ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:21.968117 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d103cd-7f9d-473c-bb87-b4cc40466ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:21.968403 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d103cd-7f9d-473c-bb87-b4cc40466ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:21.969306 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d103cd-7f9d-473c-bb87-b4cc40466ba4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:21.976901 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d103cd-7f9d-473c-bb87-b4cc40466ba4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:21.978641 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d103cd-7f9d-473c-bb87-b4cc40466ba4 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:21.988166 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 577/1165] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:17:21 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:17:21.994298 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9dca3e-a782-42da-bda2-89c0fe55c587 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:22.003521 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9dca3e-a782-42da-bda2-89c0fe55c587 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:22.007932 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7849285-c4e1-4417-a21b-7f924997b4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:22.008756 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7849285-c4e1-4417-a21b-7f924997b4fc admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:22.009035 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7849285-c4e1-4417-a21b-7f924997b4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:22.009306 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7849285-c4e1-4417-a21b-7f924997b4fc admin admin] PATH_INFO: `/v3/projects/5fe7b64b81e8435cabc1a6e763a2d8cc` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:22.010488 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7849285-c4e1-4417-a21b-7f924997b4fc admin admin] RBAC: Authorizing `identity:get_project(project_id=5fe7b64b81e8435cabc1a6e763a2d8cc)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:22.012462 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7849285-c4e1-4417-a21b-7f924997b4fc admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:22.014105 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 589/1166] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:17:21 2021] GET /identity/v3/projects/5fe7b64b81e8435cabc1a6e763a2d8cc => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:22.020629 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d103cd-7f9d-473c-bb87-b4cc40466ba4 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:22.029088 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d103cd-7f9d-473c-bb87-b4cc40466ba4 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:22.034742 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdbbd4-4deb-481f-856d-3ab42a663c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:22.035403 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdbbd4-4deb-481f-856d-3ab42a663c22 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:22.035799 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdbbd4-4deb-481f-856d-3ab42a663c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:22.036079 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdbbd4-4deb-481f-856d-3ab42a663c22 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:22.036901 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfdbbd4-4deb-481f-856d-3ab42a663c22 admin admin] RBAC: Adding query filter params (role.id=6d9a8878ffeb49fea19d854657c6b767, scope.project.id=5fe7b64b81e8435cabc1a6e763a2d8cc, user.id=f64e33d7b20147988751ade1f66cbea3) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:17:22.037209 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfdbbd4-4deb-481f-856d-3ab42a663c22 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:22.039012 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfdbbd4-4deb-481f-856d-3ab42a663c22 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:22.044313 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 578/1167] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:17:22 2021] GET /identity/v3/role_assignments?user.id=f64e33d7b20147988751ade1f66cbea3&scope.project.id=5fe7b64b81e8435cabc1a6e763a2d8cc&role.id=6d9a8878ffeb49fea19d854657c6b767 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:24.252680 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b873002-20b8-4df6-be82-5905fd8b293b None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:24.253263 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b873002-20b8-4df6-be82-5905fd8b293b None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:24.253263 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b873002-20b8-4df6-be82-5905fd8b293b None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:24.255080 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 590/1168] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:17:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:17:24.260789 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d31af6-6e4c-4ea2-8757-6f64dae35a29 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:24.261239 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d31af6-6e4c-4ea2-8757-6f64dae35a29 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:24.261348 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d31af6-6e4c-4ea2-8757-6f64dae35a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:24.278927 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-f0d31af6-6e4c-4ea2-8757-6f64dae35a29 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:17:24.280105 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-f0d31af6-6e4c-4ea2-8757-6f64dae35a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:17:24.288330 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 579/1169] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:17:24 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:17:24.311470 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b873002-20b8-4df6-be82-5905fd8b293b None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:24.323426 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b873002-20b8-4df6-be82-5905fd8b293b None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:24.328026 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ae1c7-a06d-4105-a77b-704ad9c18314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:24.328933 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ae1c7-a06d-4105-a77b-704ad9c18314 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:24.329219 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ae1c7-a06d-4105-a77b-704ad9c18314 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:24.329530 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ae1c7-a06d-4105-a77b-704ad9c18314 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:24.339402 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ae1c7-a06d-4105-a77b-704ad9c18314 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:17:24.346993 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-535ae1c7-a06d-4105-a77b-704ad9c18314 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 19:17:24.348118 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 591/1170] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:17:24 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:17:24.354387 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d31af6-6e4c-4ea2-8757-6f64dae35a29 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:24.363743 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d31af6-6e4c-4ea2-8757-6f64dae35a29 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:24.368132 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5f756-7602-4e99-88c5-fae5ee4528e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:24.368778 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5f756-7602-4e99-88c5-fae5ee4528e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:24.369063 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5f756-7602-4e99-88c5-fae5ee4528e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:24.369338 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5f756-7602-4e99-88c5-fae5ee4528e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:24.370123 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5f756-7602-4e99-88c5-fae5ee4528e4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:17:24.370431 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5f756-7602-4e99-88c5-fae5ee4528e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:24.372013 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5f756-7602-4e99-88c5-fae5ee4528e4 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:24.380054 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 580/1171] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:17:24 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:24.385866 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ae1c7-a06d-4105-a77b-704ad9c18314 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:24.396336 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ae1c7-a06d-4105-a77b-704ad9c18314 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:24.400814 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd5480-594b-4498-acef-10e8e96da218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:24.401671 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd5480-594b-4498-acef-10e8e96da218 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:24.401954 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd5480-594b-4498-acef-10e8e96da218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:24.402229 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd5480-594b-4498-acef-10e8e96da218 admin admin] PATH_INFO: `/v3/users/f64e33d7b20147988751ade1f66cbea3` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:24.403418 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd5480-594b-4498-acef-10e8e96da218 admin admin] RBAC: Authorizing `identity:get_user(user_id=f64e33d7b20147988751ade1f66cbea3)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:24.405535 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd5480-594b-4498-acef-10e8e96da218 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:24.407713 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 592/1172] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:17:24 2021] GET /identity/v3/users/f64e33d7b20147988751ade1f66cbea3 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:24.413316 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5f756-7602-4e99-88c5-fae5ee4528e4 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:24.422515 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5f756-7602-4e99-88c5-fae5ee4528e4 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:24.427017 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd0ce3-d900-4edc-a614-0f2e70a2304e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:24.427832 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd0ce3-d900-4edc-a614-0f2e70a2304e admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:24.428115 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd0ce3-d900-4edc-a614-0f2e70a2304e admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:24.428393 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd0ce3-d900-4edc-a614-0f2e70a2304e admin admin] PATH_INFO: `/v3/projects/5fe7b64b81e8435cabc1a6e763a2d8cc` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:24.429591 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd0ce3-d900-4edc-a614-0f2e70a2304e admin admin] RBAC: Authorizing `identity:get_project(project_id=5fe7b64b81e8435cabc1a6e763a2d8cc)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:24.431561 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd0ce3-d900-4edc-a614-0f2e70a2304e admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:24.433171 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 581/1173] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:17:24 2021] GET /identity/v3/projects/5fe7b64b81e8435cabc1a6e763a2d8cc => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:17:24.439204 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd5480-594b-4498-acef-10e8e96da218 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:24.448334 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd5480-594b-4498-acef-10e8e96da218 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:24.453648 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca647cd-3914-4daf-b80b-b29d91e64246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:24.454475 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca647cd-3914-4daf-b80b-b29d91e64246 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:24.454748 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca647cd-3914-4daf-b80b-b29d91e64246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:24.455020 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca647cd-3914-4daf-b80b-b29d91e64246 admin admin] PATH_INFO: `/v3/projects/5fe7b64b81e8435cabc1a6e763a2d8cc/users/f64e33d7b20147988751ade1f66cbea3/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:24.456954 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca647cd-3914-4daf-b80b-b29d91e64246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fe7b64b81e8435cabc1a6e763a2d8cc, user_id=f64e33d7b20147988751ade1f66cbea3, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:24.459499 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca647cd-3914-4daf-b80b-b29d91e64246 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:24.529218 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 593/1174] 10.222.0.62 () {58 vars in 1460 bytes} [Tue Nov 23 19:17:24 2021] PUT /identity/v3/projects/5fe7b64b81e8435cabc1a6e763a2d8cc/users/f64e33d7b20147988751ade1f66cbea3/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:17:26.775597 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f3e09-386b-4b74-8c16-b8e1fca4ec86 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:26.776159 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f3e09-386b-4b74-8c16-b8e1fca4ec86 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:26.776159 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f3e09-386b-4b74-8c16-b8e1fca4ec86 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:26.777962 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 582/1175] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:17:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:17:26.785360 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499d0c1-3838-4501-bb8e-2c8070165542 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:26.786084 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499d0c1-3838-4501-bb8e-2c8070165542 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:26.786084 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499d0c1-3838-4501-bb8e-2c8070165542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:26.803604 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-3499d0c1-3838-4501-bb8e-2c8070165542 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:17:26.804780 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-3499d0c1-3838-4501-bb8e-2c8070165542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:17:26.862905 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 594/1176] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:17:26 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:17:26.888486 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f3e09-386b-4b74-8c16-b8e1fca4ec86 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:26.902870 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f3e09-386b-4b74-8c16-b8e1fca4ec86 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:26.908181 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0f46b-7ce2-4faa-a8f2-8de28a7a65cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:26.908950 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0f46b-7ce2-4faa-a8f2-8de28a7a65cd admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:26.909231 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0f46b-7ce2-4faa-a8f2-8de28a7a65cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:26.909609 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0f46b-7ce2-4faa-a8f2-8de28a7a65cd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:26.919507 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0f46b-7ce2-4faa-a8f2-8de28a7a65cd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:17:26.926836 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-7ff0f46b-7ce2-4faa-a8f2-8de28a7a65cd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 19:17:26.927953 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 583/1177] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:17:26 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:17:26.934195 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499d0c1-3838-4501-bb8e-2c8070165542 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:26.943339 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499d0c1-3838-4501-bb8e-2c8070165542 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:26.947656 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9ec6a-c627-4e93-86c0-20683c4018ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:26.948294 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9ec6a-c627-4e93-86c0-20683c4018ae admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:26.948570 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9ec6a-c627-4e93-86c0-20683c4018ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:26.949090 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9ec6a-c627-4e93-86c0-20683c4018ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:26.949865 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb9ec6a-c627-4e93-86c0-20683c4018ae admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:17:26.950165 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb9ec6a-c627-4e93-86c0-20683c4018ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:26.951723 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb9ec6a-c627-4e93-86c0-20683c4018ae admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:26.959708 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 595/1178] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:17:26 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:26.965681 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0f46b-7ce2-4faa-a8f2-8de28a7a65cd admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:26.976506 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0f46b-7ce2-4faa-a8f2-8de28a7a65cd admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:26.980976 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd7c47-defc-4909-8363-e24bfdb7c3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:26.981843 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd7c47-defc-4909-8363-e24bfdb7c3b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:26.982129 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd7c47-defc-4909-8363-e24bfdb7c3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:26.982406 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd7c47-defc-4909-8363-e24bfdb7c3b6 admin admin] PATH_INFO: `/v3/users/f64e33d7b20147988751ade1f66cbea3` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:26.983608 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd7c47-defc-4909-8363-e24bfdb7c3b6 admin admin] RBAC: Authorizing `identity:get_user(user_id=f64e33d7b20147988751ade1f66cbea3)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:26.986253 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd7c47-defc-4909-8363-e24bfdb7c3b6 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:26.987812 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 584/1179] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:17:26 2021] GET /identity/v3/users/f64e33d7b20147988751ade1f66cbea3 => generated 286 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:26.993526 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9ec6a-c627-4e93-86c0-20683c4018ae admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:27.003249 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9ec6a-c627-4e93-86c0-20683c4018ae admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:27.007636 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878986d-aa22-432e-8702-2e62322e4911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:27.008242 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878986d-aa22-432e-8702-2e62322e4911 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:27.008519 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878986d-aa22-432e-8702-2e62322e4911 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:27.008791 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878986d-aa22-432e-8702-2e62322e4911 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:27.016249 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7878986d-aa22-432e-8702-2e62322e4911 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:27.018003 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7878986d-aa22-432e-8702-2e62322e4911 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:27.026429 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 596/1180] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:17:26 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:17:27.032697 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd7c47-defc-4909-8363-e24bfdb7c3b6 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:27.041834 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd7c47-defc-4909-8363-e24bfdb7c3b6 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:27.046270 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76f7aa-4744-4888-bfab-668c5a1da17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:27.047664 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76f7aa-4744-4888-bfab-668c5a1da17b admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:27.047944 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76f7aa-4744-4888-bfab-668c5a1da17b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:27.048216 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76f7aa-4744-4888-bfab-668c5a1da17b admin admin] PATH_INFO: `/v3/projects/5fe7b64b81e8435cabc1a6e763a2d8cc` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:27.049380 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc76f7aa-4744-4888-bfab-668c5a1da17b admin admin] RBAC: Authorizing `identity:get_project(project_id=5fe7b64b81e8435cabc1a6e763a2d8cc)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:27.051361 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc76f7aa-4744-4888-bfab-668c5a1da17b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:27.052956 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 585/1181] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:17:27 2021] GET /identity/v3/projects/5fe7b64b81e8435cabc1a6e763a2d8cc => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:27.059550 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878986d-aa22-432e-8702-2e62322e4911 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:27.068063 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878986d-aa22-432e-8702-2e62322e4911 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:27.072542 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1901f0c7-de34-4731-80ae-177110de08ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:27.073155 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901f0c7-de34-4731-80ae-177110de08ba admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:27.073466 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901f0c7-de34-4731-80ae-177110de08ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:27.074012 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901f0c7-de34-4731-80ae-177110de08ba admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:27.074825 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1901f0c7-de34-4731-80ae-177110de08ba admin admin] RBAC: Adding query filter params (role.id=6d9a8878ffeb49fea19d854657c6b767, scope.project.id=5fe7b64b81e8435cabc1a6e763a2d8cc, user.id=f64e33d7b20147988751ade1f66cbea3) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:17:27.075133 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1901f0c7-de34-4731-80ae-177110de08ba admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:27.076891 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1901f0c7-de34-4731-80ae-177110de08ba admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:27.082493 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 597/1182] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:17:27 2021] GET /identity/v3/role_assignments?user.id=f64e33d7b20147988751ade1f66cbea3&scope.project.id=5fe7b64b81e8435cabc1a6e763a2d8cc&role.id=6d9a8878ffeb49fea19d854657c6b767 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:29.313576 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398dcf2-2606-4dee-84c9-de50f5286590 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:29.314132 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398dcf2-2606-4dee-84c9-de50f5286590 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:29.314132 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398dcf2-2606-4dee-84c9-de50f5286590 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:29.315865 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 586/1183] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:17:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:17:29.321658 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7003081-bd4e-44a9-ae24-34bac02ca6e6 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:29.322036 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7003081-bd4e-44a9-ae24-34bac02ca6e6 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:29.322214 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7003081-bd4e-44a9-ae24-34bac02ca6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:29.341073 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-f7003081-bd4e-44a9-ae24-34bac02ca6e6 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:17:29.342299 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-f7003081-bd4e-44a9-ae24-34bac02ca6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:17:29.350657 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 598/1184] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:17:29 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:17:29.373633 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398dcf2-2606-4dee-84c9-de50f5286590 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:29.385487 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398dcf2-2606-4dee-84c9-de50f5286590 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:29.389715 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b10e9-0a32-40fe-a9a2-845cd5353039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:29.390325 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b10e9-0a32-40fe-a9a2-845cd5353039 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:29.390601 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b10e9-0a32-40fe-a9a2-845cd5353039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:29.390917 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b10e9-0a32-40fe-a9a2-845cd5353039 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:29.398286 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19b10e9-0a32-40fe-a9a2-845cd5353039 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:29.399978 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19b10e9-0a32-40fe-a9a2-845cd5353039 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:29.409167 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 587/1185] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:17:29 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:17:29.415205 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7003081-bd4e-44a9-ae24-34bac02ca6e6 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:29.424922 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7003081-bd4e-44a9-ae24-34bac02ca6e6 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:29.429311 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74bfbb-e43c-4c36-8b20-819920db79ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:29.430116 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74bfbb-e43c-4c36-8b20-819920db79ec admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:29.430393 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74bfbb-e43c-4c36-8b20-819920db79ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:29.430659 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74bfbb-e43c-4c36-8b20-819920db79ec admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:29.437262 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d74bfbb-e43c-4c36-8b20-819920db79ec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:29.439576 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d74bfbb-e43c-4c36-8b20-819920db79ec admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:29.453811 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-8d74bfbb-e43c-4c36-8b20-819920db79ec admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Nov 23 19:17:29.454909 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 599/1186] 10.222.0.62 () {56 vars in 1138 bytes} [Tue Nov 23 19:17:29 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:17:29.460886 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b10e9-0a32-40fe-a9a2-845cd5353039 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:29.469950 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b10e9-0a32-40fe-a9a2-845cd5353039 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:29.474527 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea426c8-0e81-4723-9ef4-f32f9d212dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:29.475144 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea426c8-0e81-4723-9ef4-f32f9d212dce admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:29.475419 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea426c8-0e81-4723-9ef4-f32f9d212dce admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:29.475688 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea426c8-0e81-4723-9ef4-f32f9d212dce admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:29.476398 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea426c8-0e81-4723-9ef4-f32f9d212dce admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:17:29.476696 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea426c8-0e81-4723-9ef4-f32f9d212dce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:29.478248 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea426c8-0e81-4723-9ef4-f32f9d212dce admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:29.486054 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 588/1187] 10.222.0.62 () {56 vars in 1136 bytes} [Tue Nov 23 19:17:29 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:31.761143 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88938b-886e-4184-af71-f6343d4709b8 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:31.761717 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88938b-886e-4184-af71-f6343d4709b8 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:31.761717 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88938b-886e-4184-af71-f6343d4709b8 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:31.763522 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 600/1188] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:17:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:17:31.769534 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9312e-aa72-490d-9955-2bff83b6282e None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:31.769957 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9312e-aa72-490d-9955-2bff83b6282e None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:31.770091 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9312e-aa72-490d-9955-2bff83b6282e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:31.788399 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-1ad9312e-aa72-490d-9955-2bff83b6282e None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:17:31.789628 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-1ad9312e-aa72-490d-9955-2bff83b6282e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:17:31.797813 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 589/1189] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:17:31 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:17:31.821510 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88938b-886e-4184-af71-f6343d4709b8 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:31.834391 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88938b-886e-4184-af71-f6343d4709b8 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:31.838708 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ea893-99ce-46c7-89ee-17657f77c248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:31.839337 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ea893-99ce-46c7-89ee-17657f77c248 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:31.839670 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ea893-99ce-46c7-89ee-17657f77c248 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:31.839947 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ea893-99ce-46c7-89ee-17657f77c248 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:31.840692 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983ea893-99ce-46c7-89ee-17657f77c248 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:31.841719 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING py.warnings [None req-983ea893-99ce-46c7-89ee-17657f77c248 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:17:31.841719 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: warnings.warn(msg) Nov 23 19:17:31.841719 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: Nov 23 19:17:31.842589 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983ea893-99ce-46c7-89ee-17657f77c248 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:31.925893 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 601/1190] 10.222.0.62 () {60 vars in 1159 bytes} [Tue Nov 23 19:17:31 2021] POST /identity/v3/domains => generated 267 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:17:34.202838 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d1072-4329-44f4-8eec-78191cd72242 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:34.203368 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d1072-4329-44f4-8eec-78191cd72242 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:34.203955 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d1072-4329-44f4-8eec-78191cd72242 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:34.205857 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 590/1191] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:17:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:17:34.211719 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30750969-b29b-49df-86eb-2aa1c08ccb17 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:34.212124 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30750969-b29b-49df-86eb-2aa1c08ccb17 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:34.212274 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30750969-b29b-49df-86eb-2aa1c08ccb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:34.230060 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-30750969-b29b-49df-86eb-2aa1c08ccb17 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:17:34.231265 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-30750969-b29b-49df-86eb-2aa1c08ccb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:17:34.286865 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 602/1192] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:17:34 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:17:34.312016 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d1072-4329-44f4-8eec-78191cd72242 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:34.324621 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d1072-4329-44f4-8eec-78191cd72242 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:34.328987 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055d4f5-fdf5-4f09-9a92-fd93f2126d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:34.329853 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055d4f5-fdf5-4f09-9a92-fd93f2126d2a admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:34.330130 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055d4f5-fdf5-4f09-9a92-fd93f2126d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:34.330401 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055d4f5-fdf5-4f09-9a92-fd93f2126d2a admin admin] PATH_INFO: `/v3/domains/f42f3b6fa01a43b0aa56e815ddab108a` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:34.340437 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055d4f5-fdf5-4f09-9a92-fd93f2126d2a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=f42f3b6fa01a43b0aa56e815ddab108a)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:34.342376 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055d4f5-fdf5-4f09-9a92-fd93f2126d2a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:34.343932 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 591/1193] 10.222.0.62 () {56 vars in 1204 bytes} [Tue Nov 23 19:17:34 2021] GET /identity/v3/domains/f42f3b6fa01a43b0aa56e815ddab108a => generated 267 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:34.349872 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30750969-b29b-49df-86eb-2aa1c08ccb17 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:34.358488 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30750969-b29b-49df-86eb-2aa1c08ccb17 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:34.363497 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4e6c3-921c-4f1f-bf99-383fb89e1e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:34.364157 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4e6c3-921c-4f1f-bf99-383fb89e1e11 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:34.364437 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4e6c3-921c-4f1f-bf99-383fb89e1e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:34.364709 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4e6c3-921c-4f1f-bf99-383fb89e1e11 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:34.365437 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db4e6c3-921c-4f1f-bf99-383fb89e1e11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:34.367306 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db4e6c3-921c-4f1f-bf99-383fb89e1e11 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:34.451231 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 603/1194] 10.222.0.62 () {60 vars in 1162 bytes} [Tue Nov 23 19:17:34 2021] POST /identity/v3/projects => generated 361 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:17:36.698779 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d97738-325b-48ca-a2db-7aaf39cab077 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:36.699600 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d97738-325b-48ca-a2db-7aaf39cab077 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:36.699600 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d97738-325b-48ca-a2db-7aaf39cab077 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:36.701363 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 592/1195] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:17:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:17:36.706954 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d5dd9-377b-4a54-94dc-613bed0fd88e None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:36.707385 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d5dd9-377b-4a54-94dc-613bed0fd88e None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:36.707487 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d5dd9-377b-4a54-94dc-613bed0fd88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:36.725197 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-373d5dd9-377b-4a54-94dc-613bed0fd88e None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:17:36.726405 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-373d5dd9-377b-4a54-94dc-613bed0fd88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:17:36.780094 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 604/1196] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:17:36 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:17:36.806581 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d97738-325b-48ca-a2db-7aaf39cab077 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:36.818435 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d97738-325b-48ca-a2db-7aaf39cab077 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:36.822664 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9f2f9-2cdd-4f07-8b67-60ee2f903cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:36.823491 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9f2f9-2cdd-4f07-8b67-60ee2f903cac admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:36.823766 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9f2f9-2cdd-4f07-8b67-60ee2f903cac admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:36.824297 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9f2f9-2cdd-4f07-8b67-60ee2f903cac admin admin] PATH_INFO: `/v3/domains/f42f3b6fa01a43b0aa56e815ddab108a` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:36.825505 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e9f2f9-2cdd-4f07-8b67-60ee2f903cac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=f42f3b6fa01a43b0aa56e815ddab108a)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:36.827379 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e9f2f9-2cdd-4f07-8b67-60ee2f903cac admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:36.829007 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 593/1197] 10.222.0.62 () {56 vars in 1204 bytes} [Tue Nov 23 19:17:36 2021] GET /identity/v3/domains/f42f3b6fa01a43b0aa56e815ddab108a => generated 267 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:36.834915 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d5dd9-377b-4a54-94dc-613bed0fd88e None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:36.843484 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d5dd9-377b-4a54-94dc-613bed0fd88e None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:36.848469 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7b8e9-cd44-416b-a99b-e8fdaf80b523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:36.849108 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7b8e9-cd44-416b-a99b-e8fdaf80b523 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:36.849386 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7b8e9-cd44-416b-a99b-e8fdaf80b523 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:36.849685 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7b8e9-cd44-416b-a99b-e8fdaf80b523 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:36.850396 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7b8e9-cd44-416b-a99b-e8fdaf80b523 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:36.852247 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7b8e9-cd44-416b-a99b-e8fdaf80b523 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:36.941474 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 605/1198] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Nov 23 19:17:36 2021] POST /identity/v3/users => generated 311 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:17:39.223819 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde831e-2b5c-4a5f-9162-adb967fe6b1b None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:39.224351 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde831e-2b5c-4a5f-9162-adb967fe6b1b None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:39.224351 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde831e-2b5c-4a5f-9162-adb967fe6b1b None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:39.226180 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 594/1199] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:17:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:17:39.231835 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e0c0e-c73c-4381-9b92-a4b1e7820752 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:39.232247 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e0c0e-c73c-4381-9b92-a4b1e7820752 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:39.232390 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e0c0e-c73c-4381-9b92-a4b1e7820752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:39.250038 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-0d5e0c0e-c73c-4381-9b92-a4b1e7820752 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:17:39.251300 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-0d5e0c0e-c73c-4381-9b92-a4b1e7820752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:17:39.258794 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 606/1200] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:17:39 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:17:39.283304 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde831e-2b5c-4a5f-9162-adb967fe6b1b None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:39.295085 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde831e-2b5c-4a5f-9162-adb967fe6b1b None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:39.300087 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785aba00-329b-40e3-a6b4-947d073496b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:39.300844 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785aba00-329b-40e3-a6b4-947d073496b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:39.301126 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785aba00-329b-40e3-a6b4-947d073496b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:39.301398 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785aba00-329b-40e3-a6b4-947d073496b7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:39.311577 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785aba00-329b-40e3-a6b4-947d073496b7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:17:39.318494 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-785aba00-329b-40e3-a6b4-947d073496b7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 19:17:39.319607 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 595/1201] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:17:39 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:17:39.326021 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e0c0e-c73c-4381-9b92-a4b1e7820752 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:39.334604 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e0c0e-c73c-4381-9b92-a4b1e7820752 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:39.339064 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66fd266-1044-4d0d-8366-76cbbb53c685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:39.339698 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fd266-1044-4d0d-8366-76cbbb53c685 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:39.339980 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fd266-1044-4d0d-8366-76cbbb53c685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:39.340256 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fd266-1044-4d0d-8366-76cbbb53c685 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:39.341004 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66fd266-1044-4d0d-8366-76cbbb53c685 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:17:39.341309 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66fd266-1044-4d0d-8366-76cbbb53c685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:39.342904 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66fd266-1044-4d0d-8366-76cbbb53c685 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:39.351368 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 607/1202] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:17:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:39.357227 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785aba00-329b-40e3-a6b4-947d073496b7 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:39.367287 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785aba00-329b-40e3-a6b4-947d073496b7 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:39.371642 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348fcda-8bb8-4bcf-9ef7-f46ec8dc9511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:39.372459 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348fcda-8bb8-4bcf-9ef7-f46ec8dc9511 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:39.372730 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348fcda-8bb8-4bcf-9ef7-f46ec8dc9511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:39.372993 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348fcda-8bb8-4bcf-9ef7-f46ec8dc9511 admin admin] PATH_INFO: `/v3/users/6a3350a3654a42a9a5443fb99c97a1ef` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:39.385794 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348fcda-8bb8-4bcf-9ef7-f46ec8dc9511 admin admin] RBAC: Authorizing `identity:get_user(user_id=6a3350a3654a42a9a5443fb99c97a1ef)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:39.387844 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348fcda-8bb8-4bcf-9ef7-f46ec8dc9511 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:39.389390 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 596/1203] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:17:39 2021] GET /identity/v3/users/6a3350a3654a42a9a5443fb99c97a1ef => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:39.395928 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66fd266-1044-4d0d-8366-76cbbb53c685 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:39.405133 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66fd266-1044-4d0d-8366-76cbbb53c685 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:39.410194 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc5570-ca0f-40df-b680-fd44bc250b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:39.410804 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc5570-ca0f-40df-b680-fd44bc250b15 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:39.411084 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc5570-ca0f-40df-b680-fd44bc250b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:39.411360 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc5570-ca0f-40df-b680-fd44bc250b15 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:39.418803 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc5570-ca0f-40df-b680-fd44bc250b15 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:39.420497 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc5570-ca0f-40df-b680-fd44bc250b15 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:39.429035 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 608/1204] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:17:39 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:17:39.435070 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348fcda-8bb8-4bcf-9ef7-f46ec8dc9511 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:39.444156 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348fcda-8bb8-4bcf-9ef7-f46ec8dc9511 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:39.448477 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c9673-b407-4913-b954-764cb70bf4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:39.449576 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c9673-b407-4913-b954-764cb70bf4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:39.449853 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c9673-b407-4913-b954-764cb70bf4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:39.450121 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c9673-b407-4913-b954-764cb70bf4d0 admin admin] PATH_INFO: `/v3/projects/b8ba8f5f040e4bf2810d1dd88e8b2352` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:39.451263 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c9673-b407-4913-b954-764cb70bf4d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=b8ba8f5f040e4bf2810d1dd88e8b2352)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:39.453209 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c9673-b407-4913-b954-764cb70bf4d0 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:39.455357 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 597/1205] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:17:39 2021] GET /identity/v3/projects/b8ba8f5f040e4bf2810d1dd88e8b2352 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:39.462018 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc5570-ca0f-40df-b680-fd44bc250b15 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:39.471157 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc5570-ca0f-40df-b680-fd44bc250b15 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:39.475676 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7090c-4b42-48c3-bf6c-e2244f4721db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:39.476232 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7090c-4b42-48c3-bf6c-e2244f4721db admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:39.476514 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7090c-4b42-48c3-bf6c-e2244f4721db admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:39.476789 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7090c-4b42-48c3-bf6c-e2244f4721db admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:39.477641 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7090c-4b42-48c3-bf6c-e2244f4721db admin admin] RBAC: Adding query filter params (role.id=6d9a8878ffeb49fea19d854657c6b767, scope.project.id=b8ba8f5f040e4bf2810d1dd88e8b2352, user.id=6a3350a3654a42a9a5443fb99c97a1ef) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:17:39.477951 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7090c-4b42-48c3-bf6c-e2244f4721db admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:39.479711 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7090c-4b42-48c3-bf6c-e2244f4721db admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:39.485451 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 609/1206] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:17:39 2021] GET /identity/v3/role_assignments?user.id=6a3350a3654a42a9a5443fb99c97a1ef&scope.project.id=b8ba8f5f040e4bf2810d1dd88e8b2352&role.id=6d9a8878ffeb49fea19d854657c6b767 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:41.682221 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90e5c4-5b4d-4a9d-a51d-d5f978121602 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:41.682787 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90e5c4-5b4d-4a9d-a51d-d5f978121602 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:41.682787 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90e5c4-5b4d-4a9d-a51d-d5f978121602 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:41.684540 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 598/1207] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:17:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:17:41.690891 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51c3e5-9398-4c94-a35c-d54b0f0aad6d None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:41.691315 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51c3e5-9398-4c94-a35c-d54b0f0aad6d None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:41.691448 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51c3e5-9398-4c94-a35c-d54b0f0aad6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:41.717230 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-9c51c3e5-9398-4c94-a35c-d54b0f0aad6d None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:17:41.718446 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-9c51c3e5-9398-4c94-a35c-d54b0f0aad6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:17:41.726269 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 610/1208] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:17:41 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:17:41.750324 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90e5c4-5b4d-4a9d-a51d-d5f978121602 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:41.763234 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90e5c4-5b4d-4a9d-a51d-d5f978121602 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:41.767977 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32344e4f-eb02-4f4e-81d9-ce43bd761760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:41.768743 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32344e4f-eb02-4f4e-81d9-ce43bd761760 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:41.769027 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32344e4f-eb02-4f4e-81d9-ce43bd761760 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:41.769302 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32344e4f-eb02-4f4e-81d9-ce43bd761760 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:41.779165 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32344e4f-eb02-4f4e-81d9-ce43bd761760 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:17:41.786077 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-32344e4f-eb02-4f4e-81d9-ce43bd761760 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 19:17:41.787230 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 599/1209] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:17:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:17:41.793824 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51c3e5-9398-4c94-a35c-d54b0f0aad6d None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:41.803224 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51c3e5-9398-4c94-a35c-d54b0f0aad6d None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:41.807742 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05a08f-ae89-40be-bea7-f27836d9a3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:41.808386 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05a08f-ae89-40be-bea7-f27836d9a3ee admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:41.808667 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05a08f-ae89-40be-bea7-f27836d9a3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:41.808938 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05a08f-ae89-40be-bea7-f27836d9a3ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:41.809722 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05a08f-ae89-40be-bea7-f27836d9a3ee admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:17:41.810025 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05a08f-ae89-40be-bea7-f27836d9a3ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:41.811744 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05a08f-ae89-40be-bea7-f27836d9a3ee admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:41.820848 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 611/1210] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:17:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:41.827175 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32344e4f-eb02-4f4e-81d9-ce43bd761760 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:41.837117 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32344e4f-eb02-4f4e-81d9-ce43bd761760 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:41.841513 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a3e92-feb9-45b1-bf1f-8352001c7859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:41.842343 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a3e92-feb9-45b1-bf1f-8352001c7859 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:41.842620 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a3e92-feb9-45b1-bf1f-8352001c7859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:41.842887 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a3e92-feb9-45b1-bf1f-8352001c7859 admin admin] PATH_INFO: `/v3/users/6a3350a3654a42a9a5443fb99c97a1ef` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:41.844053 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a3e92-feb9-45b1-bf1f-8352001c7859 admin admin] RBAC: Authorizing `identity:get_user(user_id=6a3350a3654a42a9a5443fb99c97a1ef)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:41.846242 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a3e92-feb9-45b1-bf1f-8352001c7859 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:41.847772 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 600/1211] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:17:41 2021] GET /identity/v3/users/6a3350a3654a42a9a5443fb99c97a1ef => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:41.853620 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05a08f-ae89-40be-bea7-f27836d9a3ee admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:41.863397 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05a08f-ae89-40be-bea7-f27836d9a3ee admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:41.867807 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d7c27-a2d9-4544-ab93-d33758b091e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:41.868625 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d7c27-a2d9-4544-ab93-d33758b091e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:41.868903 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d7c27-a2d9-4544-ab93-d33758b091e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:41.869175 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d7c27-a2d9-4544-ab93-d33758b091e6 admin admin] PATH_INFO: `/v3/projects/b8ba8f5f040e4bf2810d1dd88e8b2352` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:41.870366 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d7c27-a2d9-4544-ab93-d33758b091e6 admin admin] RBAC: Authorizing `identity:get_project(project_id=b8ba8f5f040e4bf2810d1dd88e8b2352)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:41.872353 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d7c27-a2d9-4544-ab93-d33758b091e6 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:41.874018 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 612/1212] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:17:41 2021] GET /identity/v3/projects/b8ba8f5f040e4bf2810d1dd88e8b2352 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:41.880471 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a3e92-feb9-45b1-bf1f-8352001c7859 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:41.889647 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a3e92-feb9-45b1-bf1f-8352001c7859 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:41.893972 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac5912-d5c9-464c-9d1d-2a9c763c0621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:41.894791 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac5912-d5c9-464c-9d1d-2a9c763c0621 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:41.895069 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac5912-d5c9-464c-9d1d-2a9c763c0621 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:41.895352 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac5912-d5c9-464c-9d1d-2a9c763c0621 admin admin] PATH_INFO: `/v3/projects/b8ba8f5f040e4bf2810d1dd88e8b2352/users/6a3350a3654a42a9a5443fb99c97a1ef/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:41.897225 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac5912-d5c9-464c-9d1d-2a9c763c0621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8ba8f5f040e4bf2810d1dd88e8b2352, user_id=6a3350a3654a42a9a5443fb99c97a1ef, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:41.899742 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac5912-d5c9-464c-9d1d-2a9c763c0621 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:42.043781 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 601/1213] 10.222.0.62 () {58 vars in 1460 bytes} [Tue Nov 23 19:17:41 2021] PUT /identity/v3/projects/b8ba8f5f040e4bf2810d1dd88e8b2352/users/6a3350a3654a42a9a5443fb99c97a1ef/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:17:44.267519 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac8d0b-01e1-4358-ad30-a6ffa9e499a7 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:44.268082 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac8d0b-01e1-4358-ad30-a6ffa9e499a7 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:44.268082 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac8d0b-01e1-4358-ad30-a6ffa9e499a7 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:44.269872 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 613/1214] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:17:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:17:44.275554 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa799607-e4e9-4dd2-bc70-7892b0bb411a None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:44.275984 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa799607-e4e9-4dd2-bc70-7892b0bb411a None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:44.276101 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa799607-e4e9-4dd2-bc70-7892b0bb411a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:44.293697 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-aa799607-e4e9-4dd2-bc70-7892b0bb411a None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:17:44.294881 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-aa799607-e4e9-4dd2-bc70-7892b0bb411a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:17:44.351694 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 602/1215] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:17:44 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:17:44.376038 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac8d0b-01e1-4358-ad30-a6ffa9e499a7 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:44.387957 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac8d0b-01e1-4358-ad30-a6ffa9e499a7 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:44.392492 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d35554-2b16-434c-affe-d1197aa215fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:44.393260 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d35554-2b16-434c-affe-d1197aa215fc admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:44.393570 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d35554-2b16-434c-affe-d1197aa215fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:44.393845 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d35554-2b16-434c-affe-d1197aa215fc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:44.403601 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d35554-2b16-434c-affe-d1197aa215fc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:17:44.410997 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-50d35554-2b16-434c-affe-d1197aa215fc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 19:17:44.412102 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 614/1216] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:17:44 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:17:44.418322 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa799607-e4e9-4dd2-bc70-7892b0bb411a None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:44.427744 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa799607-e4e9-4dd2-bc70-7892b0bb411a None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:44.432168 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4eced5-b7f7-4d9e-8789-f67891c48f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:44.432811 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4eced5-b7f7-4d9e-8789-f67891c48f44 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:44.433091 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4eced5-b7f7-4d9e-8789-f67891c48f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:44.433365 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4eced5-b7f7-4d9e-8789-f67891c48f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:44.434153 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4eced5-b7f7-4d9e-8789-f67891c48f44 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:17:44.434462 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4eced5-b7f7-4d9e-8789-f67891c48f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:44.436012 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4eced5-b7f7-4d9e-8789-f67891c48f44 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:44.443993 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 603/1217] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:17:44 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:44.450115 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d35554-2b16-434c-affe-d1197aa215fc admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:44.459921 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d35554-2b16-434c-affe-d1197aa215fc admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:44.464345 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4234f9-5e18-42f0-a687-64b758be475f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:44.465161 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4234f9-5e18-42f0-a687-64b758be475f admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:44.465460 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4234f9-5e18-42f0-a687-64b758be475f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:44.465733 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4234f9-5e18-42f0-a687-64b758be475f admin admin] PATH_INFO: `/v3/users/6a3350a3654a42a9a5443fb99c97a1ef` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:44.466907 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4234f9-5e18-42f0-a687-64b758be475f admin admin] RBAC: Authorizing `identity:get_user(user_id=6a3350a3654a42a9a5443fb99c97a1ef)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:44.468974 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4234f9-5e18-42f0-a687-64b758be475f admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:44.471200 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 615/1218] 10.222.0.62 () {56 vars in 1198 bytes} [Tue Nov 23 19:17:44 2021] GET /identity/v3/users/6a3350a3654a42a9a5443fb99c97a1ef => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:44.476886 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4eced5-b7f7-4d9e-8789-f67891c48f44 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:44.486935 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4eced5-b7f7-4d9e-8789-f67891c48f44 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:44.491557 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014af23e-513a-4114-9029-7d2038f9831a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:44.492173 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014af23e-513a-4114-9029-7d2038f9831a admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:44.492455 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014af23e-513a-4114-9029-7d2038f9831a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:44.492727 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014af23e-513a-4114-9029-7d2038f9831a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:44.500340 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014af23e-513a-4114-9029-7d2038f9831a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:44.502445 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014af23e-513a-4114-9029-7d2038f9831a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:44.510987 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 604/1219] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:17:44 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:17:44.517045 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4234f9-5e18-42f0-a687-64b758be475f admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:44.526139 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4234f9-5e18-42f0-a687-64b758be475f admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:44.530473 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3e22a-0055-40db-84d5-6fe97022db34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:44.531277 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3e22a-0055-40db-84d5-6fe97022db34 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:44.531557 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3e22a-0055-40db-84d5-6fe97022db34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:44.531831 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3e22a-0055-40db-84d5-6fe97022db34 admin admin] PATH_INFO: `/v3/projects/b8ba8f5f040e4bf2810d1dd88e8b2352` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:44.533548 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c3e22a-0055-40db-84d5-6fe97022db34 admin admin] RBAC: Authorizing `identity:get_project(project_id=b8ba8f5f040e4bf2810d1dd88e8b2352)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:44.535518 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c3e22a-0055-40db-84d5-6fe97022db34 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:44.537115 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 616/1220] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:17:44 2021] GET /identity/v3/projects/b8ba8f5f040e4bf2810d1dd88e8b2352 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:17:44.543616 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014af23e-513a-4114-9029-7d2038f9831a admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:17:44.552685 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014af23e-513a-4114-9029-7d2038f9831a admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:17:44.557111 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157de96-342a-45a3-8f78-d58e8d82570f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:17:44.557761 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157de96-342a-45a3-8f78-d58e8d82570f admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:17:44.558048 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157de96-342a-45a3-8f78-d58e8d82570f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:17:44.558327 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157de96-342a-45a3-8f78-d58e8d82570f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:17:44.559151 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157de96-342a-45a3-8f78-d58e8d82570f admin admin] RBAC: Adding query filter params (role.id=6d9a8878ffeb49fea19d854657c6b767, scope.project.id=b8ba8f5f040e4bf2810d1dd88e8b2352, user.id=6a3350a3654a42a9a5443fb99c97a1ef) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:17:44.559464 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157de96-342a-45a3-8f78-d58e8d82570f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:17:44.561226 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157de96-342a-45a3-8f78-d58e8d82570f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:17:44.566832 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 605/1221] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:17:44 2021] GET /identity/v3/role_assignments?user.id=6a3350a3654a42a9a5443fb99c97a1ef&scope.project.id=b8ba8f5f040e4bf2810d1dd88e8b2352&role.id=6d9a8878ffeb49fea19d854657c6b767 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:18:57.611735 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cb717-d65a-4696-b440-1a068753e817 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:18:57.612353 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cb717-d65a-4696-b440-1a068753e817 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:18:57.612353 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cb717-d65a-4696-b440-1a068753e817 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:18:57.614085 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 617/1222] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:18:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:18:57.620822 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1f00d-00e5-442c-a503-965f3038503e None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:18:57.621243 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1f00d-00e5-442c-a503-965f3038503e None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:18:57.621378 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1f00d-00e5-442c-a503-965f3038503e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:18:57.638742 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-99c1f00d-00e5-442c-a503-965f3038503e None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:18:57.640825 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-99c1f00d-00e5-442c-a503-965f3038503e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:18:57.647481 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 606/1223] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:18:57 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:18:57.674677 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7cb717-d65a-4696-b440-1a068753e817 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:18:57.686881 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7cb717-d65a-4696-b440-1a068753e817 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:18:57.691173 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac356012-c468-4ccd-adc6-75e332c0e816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:18:57.691990 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac356012-c468-4ccd-adc6-75e332c0e816 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:18:57.692265 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac356012-c468-4ccd-adc6-75e332c0e816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:18:57.692538 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac356012-c468-4ccd-adc6-75e332c0e816 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:18:57.702798 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac356012-c468-4ccd-adc6-75e332c0e816 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:18:57.704636 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac356012-c468-4ccd-adc6-75e332c0e816 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:18:57.721605 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-ac356012-c468-4ccd-adc6-75e332c0e816 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:18:57.722773 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 618/1224] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:18:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:18:57.730099 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1f00d-00e5-442c-a503-965f3038503e None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:18:57.738931 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1f00d-00e5-442c-a503-965f3038503e None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:18:57.743772 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5f819-a63d-4b28-aa4f-0d6994488d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:18:57.744422 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5f819-a63d-4b28-aa4f-0d6994488d4a admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:18:57.744705 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5f819-a63d-4b28-aa4f-0d6994488d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:18:57.744983 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5f819-a63d-4b28-aa4f-0d6994488d4a admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:18:57.745749 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5f819-a63d-4b28-aa4f-0d6994488d4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:18:57.746058 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5f819-a63d-4b28-aa4f-0d6994488d4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:18:57.747611 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5f819-a63d-4b28-aa4f-0d6994488d4a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:18:57.758811 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 607/1225] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:18:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:18:57.764853 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac356012-c468-4ccd-adc6-75e332c0e816 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:18:57.774921 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac356012-c468-4ccd-adc6-75e332c0e816 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:18:57.779452 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad84ac-a1bf-45b7-9ac9-d18e1a0da775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:18:57.780088 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad84ac-a1bf-45b7-9ac9-d18e1a0da775 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:18:57.780367 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad84ac-a1bf-45b7-9ac9-d18e1a0da775 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:18:57.780636 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad84ac-a1bf-45b7-9ac9-d18e1a0da775 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:18:57.781347 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad84ac-a1bf-45b7-9ac9-d18e1a0da775 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:18:57.783274 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad84ac-a1bf-45b7-9ac9-d18e1a0da775 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:18:57.889099 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 619/1226] 10.222.0.62 () {60 vars in 1153 bytes} [Tue Nov 23 19:18:57 2021] POST /identity/v3/users => generated 251 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:19:00.224462 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff504836-2678-406f-aae0-ee6a278b22bf None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:00.224995 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff504836-2678-406f-aae0-ee6a278b22bf None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:00.225102 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff504836-2678-406f-aae0-ee6a278b22bf None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:00.226833 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 608/1227] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:19:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:19:00.232850 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005f679-9e5d-45ce-a89f-97d7282caee6 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:00.233264 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005f679-9e5d-45ce-a89f-97d7282caee6 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:00.233448 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005f679-9e5d-45ce-a89f-97d7282caee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:00.251646 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-4005f679-9e5d-45ce-a89f-97d7282caee6 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:19:00.252824 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-4005f679-9e5d-45ce-a89f-97d7282caee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:19:00.261588 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 620/1228] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:19:00 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:19:00.286578 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff504836-2678-406f-aae0-ee6a278b22bf None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:00.299419 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff504836-2678-406f-aae0-ee6a278b22bf None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:00.303741 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17db49a-7fdf-4808-b0b6-e591551d7c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:00.304936 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17db49a-7fdf-4808-b0b6-e591551d7c0b admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:00.304936 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17db49a-7fdf-4808-b0b6-e591551d7c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:00.305164 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17db49a-7fdf-4808-b0b6-e591551d7c0b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:00.316011 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17db49a-7fdf-4808-b0b6-e591551d7c0b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:19:00.323399 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-e17db49a-7fdf-4808-b0b6-e591551d7c0b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 19:19:00.336581 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 609/1229] 10.222.0.62 () {56 vars in 1123 bytes} [Tue Nov 23 19:19:00 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:19:00.336704 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005f679-9e5d-45ce-a89f-97d7282caee6 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:00.341422 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005f679-9e5d-45ce-a89f-97d7282caee6 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:00.345842 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac55c57-44d8-4ec5-9a87-c5fd9fc4e452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:00.346477 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac55c57-44d8-4ec5-9a87-c5fd9fc4e452 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:00.346754 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac55c57-44d8-4ec5-9a87-c5fd9fc4e452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:00.347022 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac55c57-44d8-4ec5-9a87-c5fd9fc4e452 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:00.347763 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac55c57-44d8-4ec5-9a87-c5fd9fc4e452 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:00.348063 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac55c57-44d8-4ec5-9a87-c5fd9fc4e452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:00.349648 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac55c57-44d8-4ec5-9a87-c5fd9fc4e452 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:00.358277 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 621/1230] 10.222.0.62 () {56 vars in 1124 bytes} [Tue Nov 23 19:19:00 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:19:00.364318 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17db49a-7fdf-4808-b0b6-e591551d7c0b admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:00.374592 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17db49a-7fdf-4808-b0b6-e591551d7c0b admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:00.379129 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348982c2-0575-4761-8475-86eb6781b2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:00.379895 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348982c2-0575-4761-8475-86eb6781b2ec admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:00.380175 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348982c2-0575-4761-8475-86eb6781b2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:00.380449 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348982c2-0575-4761-8475-86eb6781b2ec admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:00.390399 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348982c2-0575-4761-8475-86eb6781b2ec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:00.394371 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348982c2-0575-4761-8475-86eb6781b2ec admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:00.408579 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-348982c2-0575-4761-8475-86eb6781b2ec admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:19:00.409723 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 610/1231] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:19:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:19:00.416537 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac55c57-44d8-4ec5-9a87-c5fd9fc4e452 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:00.426163 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac55c57-44d8-4ec5-9a87-c5fd9fc4e452 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:00.431607 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd3e80-ea1b-4ac1-92fe-e7efad9238c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:00.432250 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd3e80-ea1b-4ac1-92fe-e7efad9238c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:00.432536 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd3e80-ea1b-4ac1-92fe-e7efad9238c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:00.432819 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd3e80-ea1b-4ac1-92fe-e7efad9238c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:00.433594 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd3e80-ea1b-4ac1-92fe-e7efad9238c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:00.433905 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd3e80-ea1b-4ac1-92fe-e7efad9238c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:00.435579 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd3e80-ea1b-4ac1-92fe-e7efad9238c6 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:00.447282 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 622/1232] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:19:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:19:00.453796 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348982c2-0575-4761-8475-86eb6781b2ec admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:00.463276 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348982c2-0575-4761-8475-86eb6781b2ec admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:00.467794 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ef354-7e17-43ea-a6b5-24fe9e0ca681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:00.468569 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ef354-7e17-43ea-a6b5-24fe9e0ca681 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:00.468849 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ef354-7e17-43ea-a6b5-24fe9e0ca681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:00.469118 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ef354-7e17-43ea-a6b5-24fe9e0ca681 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:00.476329 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ef354-7e17-43ea-a6b5-24fe9e0ca681 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:00.478961 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ef354-7e17-43ea-a6b5-24fe9e0ca681 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:00.493262 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-209ef354-7e17-43ea-a6b5-24fe9e0ca681 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 23 19:19:00.494414 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 611/1233] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:19:00 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:19:00.500375 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd3e80-ea1b-4ac1-92fe-e7efad9238c6 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:00.510129 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd3e80-ea1b-4ac1-92fe-e7efad9238c6 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:00.514719 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf7024-5f83-4853-8864-912e2d99170d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:00.515429 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf7024-5f83-4853-8864-912e2d99170d admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:00.515714 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf7024-5f83-4853-8864-912e2d99170d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:00.515992 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf7024-5f83-4853-8864-912e2d99170d admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:00.516844 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf7024-5f83-4853-8864-912e2d99170d admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:00.517155 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf7024-5f83-4853-8864-912e2d99170d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:00.519028 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf7024-5f83-4853-8864-912e2d99170d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:00.536882 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 623/1234] 10.222.0.62 () {56 vars in 1164 bytes} [Tue Nov 23 19:19:00 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:19:00.543770 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ef354-7e17-43ea-a6b5-24fe9e0ca681 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:00.553181 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ef354-7e17-43ea-a6b5-24fe9e0ca681 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:00.558437 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18052dd7-0103-4b74-8903-66b853427229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:00.559060 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18052dd7-0103-4b74-8903-66b853427229 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:00.559343 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18052dd7-0103-4b74-8903-66b853427229 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:00.559617 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18052dd7-0103-4b74-8903-66b853427229 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:00.567262 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18052dd7-0103-4b74-8903-66b853427229 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:00.574229 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18052dd7-0103-4b74-8903-66b853427229 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:00.577862 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 612/1235] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:19:00 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:19:00.584128 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf7024-5f83-4853-8864-912e2d99170d admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:00.593632 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf7024-5f83-4853-8864-912e2d99170d admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:00.598276 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79ba37-86fe-48bc-8c86-4dd532c618d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:00.599041 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79ba37-86fe-48bc-8c86-4dd532c618d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:00.599323 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79ba37-86fe-48bc-8c86-4dd532c618d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:00.599596 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79ba37-86fe-48bc-8c86-4dd532c618d7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:00.610886 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79ba37-86fe-48bc-8c86-4dd532c618d7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:00.612678 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79ba37-86fe-48bc-8c86-4dd532c618d7 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:00.630841 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-4d79ba37-86fe-48bc-8c86-4dd532c618d7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:19:00.631996 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 624/1236] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:19:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:19:00.639227 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18052dd7-0103-4b74-8903-66b853427229 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:00.647923 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18052dd7-0103-4b74-8903-66b853427229 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:00.652979 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424b24b-744b-4d9a-95be-113a6a7a61f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:00.653625 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424b24b-744b-4d9a-95be-113a6a7a61f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:00.653904 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424b24b-744b-4d9a-95be-113a6a7a61f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:00.654173 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424b24b-744b-4d9a-95be-113a6a7a61f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:00.654886 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424b24b-744b-4d9a-95be-113a6a7a61f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:00.655186 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424b24b-744b-4d9a-95be-113a6a7a61f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:00.656710 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424b24b-744b-4d9a-95be-113a6a7a61f3 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:00.668170 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 613/1237] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:19:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:19:00.674429 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79ba37-86fe-48bc-8c86-4dd532c618d7 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:00.683826 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79ba37-86fe-48bc-8c86-4dd532c618d7 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:00.688488 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749eaf4e-935a-41f6-9567-2e389f0a7a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:00.689324 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749eaf4e-935a-41f6-9567-2e389f0a7a0e admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:00.689630 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749eaf4e-935a-41f6-9567-2e389f0a7a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:00.689908 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749eaf4e-935a-41f6-9567-2e389f0a7a0e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:00.696692 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749eaf4e-935a-41f6-9567-2e389f0a7a0e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:00.698622 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749eaf4e-935a-41f6-9567-2e389f0a7a0e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:00.712242 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-749eaf4e-935a-41f6-9567-2e389f0a7a0e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:19:00.713359 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 625/1238] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:19:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:19:00.719499 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424b24b-744b-4d9a-95be-113a6a7a61f3 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:00.729958 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424b24b-744b-4d9a-95be-113a6a7a61f3 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:00.734384 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc872b20-ba53-4f07-ba03-7286a9a4bae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:00.735013 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc872b20-ba53-4f07-ba03-7286a9a4bae3 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:00.735297 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc872b20-ba53-4f07-ba03-7286a9a4bae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:00.735571 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc872b20-ba53-4f07-ba03-7286a9a4bae3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:00.736359 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc872b20-ba53-4f07-ba03-7286a9a4bae3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:00.736665 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc872b20-ba53-4f07-ba03-7286a9a4bae3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:00.738582 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc872b20-ba53-4f07-ba03-7286a9a4bae3 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:00.750959 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 614/1239] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:19:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:19:00.757179 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749eaf4e-935a-41f6-9567-2e389f0a7a0e admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:00.768299 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749eaf4e-935a-41f6-9567-2e389f0a7a0e admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:00.772792 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e151f0-ed7d-4c35-8d94-9a2109cd8754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:00.773430 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e151f0-ed7d-4c35-8d94-9a2109cd8754 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:00.773733 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e151f0-ed7d-4c35-8d94-9a2109cd8754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:00.774035 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e151f0-ed7d-4c35-8d94-9a2109cd8754 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:00.774855 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e151f0-ed7d-4c35-8d94-9a2109cd8754 admin admin] RBAC: Adding query filter params (role.id=e68dc60061bd41dc894e1be26b4d5027, scope.project.id=2955b3037801465c9eec5d78fe2e3ae9, user.id=d100a378f1ff441080555bfc2ff4d6ff) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:00.775162 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e151f0-ed7d-4c35-8d94-9a2109cd8754 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:00.776952 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e151f0-ed7d-4c35-8d94-9a2109cd8754 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:00.782323 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 626/1240] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:19:00 2021] GET /identity/v3/role_assignments?user.id=d100a378f1ff441080555bfc2ff4d6ff&scope.project.id=2955b3037801465c9eec5d78fe2e3ae9&role.id=e68dc60061bd41dc894e1be26b4d5027 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:19:02.995862 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae1717-8a81-461e-b2ef-d4f0ff80fd06 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:02.996410 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae1717-8a81-461e-b2ef-d4f0ff80fd06 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:02.996410 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae1717-8a81-461e-b2ef-d4f0ff80fd06 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:02.998212 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 615/1241] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:19:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:19:03.003993 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ec3b2-f014-4f40-b8b3-e43e0a21d238 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:03.004420 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ec3b2-f014-4f40-b8b3-e43e0a21d238 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:03.004530 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ec3b2-f014-4f40-b8b3-e43e0a21d238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:03.021967 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-2e6ec3b2-f014-4f40-b8b3-e43e0a21d238 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:19:03.023132 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-2e6ec3b2-f014-4f40-b8b3-e43e0a21d238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:19:03.030732 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 627/1242] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:19:03 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:19:03.053638 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae1717-8a81-461e-b2ef-d4f0ff80fd06 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:03.066004 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae1717-8a81-461e-b2ef-d4f0ff80fd06 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:03.070376 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe78d4-9e92-4f9d-8574-e6a0e23df415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:03.072270 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe78d4-9e92-4f9d-8574-e6a0e23df415 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:03.072553 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe78d4-9e92-4f9d-8574-e6a0e23df415 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:03.072831 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe78d4-9e92-4f9d-8574-e6a0e23df415 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:03.083141 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbe78d4-9e92-4f9d-8574-e6a0e23df415 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:19:03.090393 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-bfbe78d4-9e92-4f9d-8574-e6a0e23df415 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 19:19:03.091529 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 616/1243] 10.222.0.62 () {56 vars in 1123 bytes} [Tue Nov 23 19:19:03 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:19:03.097924 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ec3b2-f014-4f40-b8b3-e43e0a21d238 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:03.106903 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ec3b2-f014-4f40-b8b3-e43e0a21d238 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:03.111458 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627b089-c0de-46a2-98cc-14982219a12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:03.112107 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627b089-c0de-46a2-98cc-14982219a12c admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:03.112387 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627b089-c0de-46a2-98cc-14982219a12c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:03.112660 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627b089-c0de-46a2-98cc-14982219a12c admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:03.113429 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627b089-c0de-46a2-98cc-14982219a12c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:03.113742 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627b089-c0de-46a2-98cc-14982219a12c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:03.115309 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627b089-c0de-46a2-98cc-14982219a12c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:03.124260 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 628/1244] 10.222.0.62 () {56 vars in 1124 bytes} [Tue Nov 23 19:19:03 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:19:03.129986 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe78d4-9e92-4f9d-8574-e6a0e23df415 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:03.142308 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe78d4-9e92-4f9d-8574-e6a0e23df415 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:03.146759 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7139d-aba1-4108-82d0-af3cb360f07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:03.147509 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7139d-aba1-4108-82d0-af3cb360f07c admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:03.147788 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7139d-aba1-4108-82d0-af3cb360f07c admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:03.148057 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7139d-aba1-4108-82d0-af3cb360f07c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:03.158308 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e7139d-aba1-4108-82d0-af3cb360f07c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:03.160076 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e7139d-aba1-4108-82d0-af3cb360f07c admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:03.176541 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-12e7139d-aba1-4108-82d0-af3cb360f07c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:19:03.177686 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 617/1245] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:19:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:19:03.184916 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627b089-c0de-46a2-98cc-14982219a12c admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:03.194274 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627b089-c0de-46a2-98cc-14982219a12c admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:03.200039 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3858068-bce3-4322-9b82-9a2bd5314078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:03.200684 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3858068-bce3-4322-9b82-9a2bd5314078 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:03.200963 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3858068-bce3-4322-9b82-9a2bd5314078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:03.201235 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3858068-bce3-4322-9b82-9a2bd5314078 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:03.202002 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3858068-bce3-4322-9b82-9a2bd5314078 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:03.206003 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3858068-bce3-4322-9b82-9a2bd5314078 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:03.206003 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3858068-bce3-4322-9b82-9a2bd5314078 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:03.216071 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 629/1246] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:19:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:19:03.222085 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7139d-aba1-4108-82d0-af3cb360f07c admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:03.231963 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7139d-aba1-4108-82d0-af3cb360f07c admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:03.236377 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b69f98-6b31-49e1-a931-fd44eb5e5a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:03.237152 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b69f98-6b31-49e1-a931-fd44eb5e5a55 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:03.237455 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b69f98-6b31-49e1-a931-fd44eb5e5a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:03.237729 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b69f98-6b31-49e1-a931-fd44eb5e5a55 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:03.245821 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b69f98-6b31-49e1-a931-fd44eb5e5a55 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:03.247769 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b69f98-6b31-49e1-a931-fd44eb5e5a55 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:03.262432 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-33b69f98-6b31-49e1-a931-fd44eb5e5a55 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 23 19:19:03.263577 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 618/1247] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:19:03 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:19:03.269525 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3858068-bce3-4322-9b82-9a2bd5314078 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:03.278937 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3858068-bce3-4322-9b82-9a2bd5314078 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:03.283438 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f0857-b709-4090-af00-11666af86575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:03.284076 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f0857-b709-4090-af00-11666af86575 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:03.284356 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f0857-b709-4090-af00-11666af86575 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:03.284628 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f0857-b709-4090-af00-11666af86575 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:03.285489 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f0857-b709-4090-af00-11666af86575 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:03.285799 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f0857-b709-4090-af00-11666af86575 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:03.287596 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f0857-b709-4090-af00-11666af86575 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:03.304642 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 630/1248] 10.222.0.62 () {56 vars in 1164 bytes} [Tue Nov 23 19:19:03 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:19:03.311562 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b69f98-6b31-49e1-a931-fd44eb5e5a55 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:03.321578 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b69f98-6b31-49e1-a931-fd44eb5e5a55 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:03.326035 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c9e40-a574-44bf-9e71-470536fac976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:03.326793 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c9e40-a574-44bf-9e71-470536fac976 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:03.327075 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c9e40-a574-44bf-9e71-470536fac976 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:03.327612 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c9e40-a574-44bf-9e71-470536fac976 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:03.338088 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c9e40-a574-44bf-9e71-470536fac976 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:03.339884 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c9e40-a574-44bf-9e71-470536fac976 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:03.358429 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-ea8c9e40-a574-44bf-9e71-470536fac976 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:19:03.359578 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 619/1249] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:19:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:19:03.365647 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f0857-b709-4090-af00-11666af86575 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:03.375781 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f0857-b709-4090-af00-11666af86575 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:03.380237 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6828ba8-2828-492d-b232-c2111fe2b9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:03.380875 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6828ba8-2828-492d-b232-c2111fe2b9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:03.381156 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6828ba8-2828-492d-b232-c2111fe2b9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:03.381453 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6828ba8-2828-492d-b232-c2111fe2b9f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:03.382179 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6828ba8-2828-492d-b232-c2111fe2b9f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:03.382483 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6828ba8-2828-492d-b232-c2111fe2b9f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:03.384148 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6828ba8-2828-492d-b232-c2111fe2b9f2 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:03.395028 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 631/1250] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:19:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:19:03.400936 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c9e40-a574-44bf-9e71-470536fac976 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:03.410554 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c9e40-a574-44bf-9e71-470536fac976 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:03.415646 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c9f14-5385-4c01-b8b0-5aa6d8d59500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:03.416400 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c9f14-5385-4c01-b8b0-5aa6d8d59500 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:03.416765 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c9f14-5385-4c01-b8b0-5aa6d8d59500 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:03.417028 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c9f14-5385-4c01-b8b0-5aa6d8d59500 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:03.423907 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c9f14-5385-4c01-b8b0-5aa6d8d59500 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:03.425912 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c9f14-5385-4c01-b8b0-5aa6d8d59500 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:03.439451 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-652c9f14-5385-4c01-b8b0-5aa6d8d59500 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:19:03.440623 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 620/1251] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:19:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:19:03.446848 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6828ba8-2828-492d-b232-c2111fe2b9f2 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:03.456596 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6828ba8-2828-492d-b232-c2111fe2b9f2 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:03.461460 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7163a-630d-433d-9998-a2748a4402e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:03.462112 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7163a-630d-433d-9998-a2748a4402e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:03.462499 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7163a-630d-433d-9998-a2748a4402e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:03.462656 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7163a-630d-433d-9998-a2748a4402e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:03.463453 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f7163a-630d-433d-9998-a2748a4402e2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:03.463764 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f7163a-630d-433d-9998-a2748a4402e2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:03.465617 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f7163a-630d-433d-9998-a2748a4402e2 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:03.477429 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 632/1252] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:19:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:19:03.484373 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c9f14-5385-4c01-b8b0-5aa6d8d59500 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:03.495274 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c9f14-5385-4c01-b8b0-5aa6d8d59500 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:03.499773 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873740a6-a039-48b3-a919-826c5557a0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:03.500621 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873740a6-a039-48b3-a919-826c5557a0a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:03.500904 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873740a6-a039-48b3-a919-826c5557a0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:03.501176 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873740a6-a039-48b3-a919-826c5557a0a1 admin admin] PATH_INFO: `/v3/projects/2955b3037801465c9eec5d78fe2e3ae9/users/d100a378f1ff441080555bfc2ff4d6ff/roles/e68dc60061bd41dc894e1be26b4d5027` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:03.515259 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873740a6-a039-48b3-a919-826c5557a0a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2955b3037801465c9eec5d78fe2e3ae9, user_id=d100a378f1ff441080555bfc2ff4d6ff, role_id=e68dc60061bd41dc894e1be26b4d5027)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:03.517987 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873740a6-a039-48b3-a919-826c5557a0a1 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:03.601328 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 621/1253] 10.222.0.62 () {58 vars in 1460 bytes} [Tue Nov 23 19:19:03 2021] PUT /identity/v3/projects/2955b3037801465c9eec5d78fe2e3ae9/users/d100a378f1ff441080555bfc2ff4d6ff/roles/e68dc60061bd41dc894e1be26b4d5027 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:19:05.817421 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01737737-aeac-4d52-be8a-aed02e328a53 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:05.817884 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01737737-aeac-4d52-be8a-aed02e328a53 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:05.818024 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01737737-aeac-4d52-be8a-aed02e328a53 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:05.819848 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 633/1254] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:19:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:19:05.826776 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3f866-d089-4350-a031-abdf2e08fd05 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:05.827491 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3f866-d089-4350-a031-abdf2e08fd05 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:05.827590 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3f866-d089-4350-a031-abdf2e08fd05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:05.845958 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-09e3f866-d089-4350-a031-abdf2e08fd05 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:19:05.847151 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-09e3f866-d089-4350-a031-abdf2e08fd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:19:05.903877 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 622/1255] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:19:05 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:19:05.928436 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01737737-aeac-4d52-be8a-aed02e328a53 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:05.940863 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01737737-aeac-4d52-be8a-aed02e328a53 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:05.945438 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89573c0-ccd2-469a-8881-897d98dee5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:05.947014 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89573c0-ccd2-469a-8881-897d98dee5fa admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:05.947300 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89573c0-ccd2-469a-8881-897d98dee5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:05.947575 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89573c0-ccd2-469a-8881-897d98dee5fa admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:05.957808 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89573c0-ccd2-469a-8881-897d98dee5fa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:19:05.964880 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-d89573c0-ccd2-469a-8881-897d98dee5fa admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 23 19:19:05.966036 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 634/1256] 10.222.0.62 () {56 vars in 1123 bytes} [Tue Nov 23 19:19:05 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:19:05.972230 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3f866-d089-4350-a031-abdf2e08fd05 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:05.981092 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3f866-d089-4350-a031-abdf2e08fd05 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:05.985619 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb20827-4a5d-4102-ad92-e10c5452050c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:05.986264 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb20827-4a5d-4102-ad92-e10c5452050c admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:05.986549 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb20827-4a5d-4102-ad92-e10c5452050c admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:05.986823 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb20827-4a5d-4102-ad92-e10c5452050c admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:05.987613 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb20827-4a5d-4102-ad92-e10c5452050c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:05.987919 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb20827-4a5d-4102-ad92-e10c5452050c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:05.989502 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb20827-4a5d-4102-ad92-e10c5452050c admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:05.998077 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 623/1257] 10.222.0.62 () {56 vars in 1124 bytes} [Tue Nov 23 19:19:05 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:19:06.004202 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89573c0-ccd2-469a-8881-897d98dee5fa admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:06.015076 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89573c0-ccd2-469a-8881-897d98dee5fa admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:06.019501 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee268549-ee7f-4950-8980-1a114fe23598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:06.020252 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee268549-ee7f-4950-8980-1a114fe23598 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:06.020526 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee268549-ee7f-4950-8980-1a114fe23598 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:06.020798 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee268549-ee7f-4950-8980-1a114fe23598 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:06.030682 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee268549-ee7f-4950-8980-1a114fe23598 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:06.032482 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee268549-ee7f-4950-8980-1a114fe23598 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:06.048571 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-ee268549-ee7f-4950-8980-1a114fe23598 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:19:06.049697 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 635/1258] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:19:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:19:06.056347 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb20827-4a5d-4102-ad92-e10c5452050c admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:06.068696 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb20827-4a5d-4102-ad92-e10c5452050c admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:06.076679 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a13ea-b1bc-4b84-8eef-9c653b0af4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:06.077907 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a13ea-b1bc-4b84-8eef-9c653b0af4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:06.078217 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a13ea-b1bc-4b84-8eef-9c653b0af4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:06.083958 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a13ea-b1bc-4b84-8eef-9c653b0af4a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:06.083958 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a13ea-b1bc-4b84-8eef-9c653b0af4a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:06.083958 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a13ea-b1bc-4b84-8eef-9c653b0af4a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:06.083958 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a13ea-b1bc-4b84-8eef-9c653b0af4a8 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:06.092973 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 624/1259] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:19:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:19:06.099270 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee268549-ee7f-4950-8980-1a114fe23598 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:06.109850 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee268549-ee7f-4950-8980-1a114fe23598 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:06.114509 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ffe27-971b-4d33-afb6-26d87a5a59db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:06.115927 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ffe27-971b-4d33-afb6-26d87a5a59db admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:06.115927 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ffe27-971b-4d33-afb6-26d87a5a59db admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:06.115927 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ffe27-971b-4d33-afb6-26d87a5a59db admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:06.123834 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ffe27-971b-4d33-afb6-26d87a5a59db admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:06.125893 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ffe27-971b-4d33-afb6-26d87a5a59db admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:06.140333 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-944ffe27-971b-4d33-afb6-26d87a5a59db admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 23 19:19:06.141528 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 636/1260] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:19:06 2021] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:19:06.147909 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a13ea-b1bc-4b84-8eef-9c653b0af4a8 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:06.157492 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a13ea-b1bc-4b84-8eef-9c653b0af4a8 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:06.161989 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c4284-0730-473a-a622-124e9ec87ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:06.162627 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c4284-0730-473a-a622-124e9ec87ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:06.162906 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c4284-0730-473a-a622-124e9ec87ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:06.165949 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c4284-0730-473a-a622-124e9ec87ef7 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:06.165949 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c4284-0730-473a-a622-124e9ec87ef7 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:06.165949 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c4284-0730-473a-a622-124e9ec87ef7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:06.166269 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c4284-0730-473a-a622-124e9ec87ef7 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:06.183236 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 625/1261] 10.222.0.62 () {56 vars in 1164 bytes} [Tue Nov 23 19:19:06 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:19:06.189544 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ffe27-971b-4d33-afb6-26d87a5a59db admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:06.199713 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ffe27-971b-4d33-afb6-26d87a5a59db admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:06.204513 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926625cc-3abd-4ffa-846a-2978b8bbef3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:06.205136 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926625cc-3abd-4ffa-846a-2978b8bbef3f admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:06.205463 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926625cc-3abd-4ffa-846a-2978b8bbef3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:06.206130 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926625cc-3abd-4ffa-846a-2978b8bbef3f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:06.213726 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926625cc-3abd-4ffa-846a-2978b8bbef3f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:06.215451 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926625cc-3abd-4ffa-846a-2978b8bbef3f admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:06.223980 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 637/1262] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:19:06 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:19:06.230737 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c4284-0730-473a-a622-124e9ec87ef7 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:06.244029 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c4284-0730-473a-a622-124e9ec87ef7 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:06.245167 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e251905-f49f-41c2-a0c5-4aa816675ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:06.245962 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e251905-f49f-41c2-a0c5-4aa816675ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:06.246247 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e251905-f49f-41c2-a0c5-4aa816675ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:06.246524 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e251905-f49f-41c2-a0c5-4aa816675ff7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:06.256363 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e251905-f49f-41c2-a0c5-4aa816675ff7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:06.258170 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e251905-f49f-41c2-a0c5-4aa816675ff7 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:06.275254 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-7e251905-f49f-41c2-a0c5-4aa816675ff7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:19:06.276359 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 626/1263] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:19:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:19:06.282306 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926625cc-3abd-4ffa-846a-2978b8bbef3f admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:06.291609 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926625cc-3abd-4ffa-846a-2978b8bbef3f admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:06.296161 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75309560-69e7-4619-8ccb-0ee7d08c2f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:06.296793 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75309560-69e7-4619-8ccb-0ee7d08c2f31 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:06.297076 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75309560-69e7-4619-8ccb-0ee7d08c2f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:06.297352 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75309560-69e7-4619-8ccb-0ee7d08c2f31 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:06.300973 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75309560-69e7-4619-8ccb-0ee7d08c2f31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:06.300973 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75309560-69e7-4619-8ccb-0ee7d08c2f31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:06.300973 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75309560-69e7-4619-8ccb-0ee7d08c2f31 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:06.312229 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 638/1264] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:19:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:19:06.318138 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e251905-f49f-41c2-a0c5-4aa816675ff7 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:06.328208 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e251905-f49f-41c2-a0c5-4aa816675ff7 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:06.332714 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4f1d8-3be0-4cbe-afcb-b4ee7accbc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:06.333511 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4f1d8-3be0-4cbe-afcb-b4ee7accbc23 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:06.333798 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4f1d8-3be0-4cbe-afcb-b4ee7accbc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:06.334074 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4f1d8-3be0-4cbe-afcb-b4ee7accbc23 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:06.341019 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d4f1d8-3be0-4cbe-afcb-b4ee7accbc23 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:06.343025 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d4f1d8-3be0-4cbe-afcb-b4ee7accbc23 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:06.356338 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-a1d4f1d8-3be0-4cbe-afcb-b4ee7accbc23 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:19:06.357474 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 627/1265] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:19:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:19:06.363814 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75309560-69e7-4619-8ccb-0ee7d08c2f31 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:06.374167 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75309560-69e7-4619-8ccb-0ee7d08c2f31 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:06.378773 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e9a89-33f8-468e-96cf-4e86e572cef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:06.379413 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e9a89-33f8-468e-96cf-4e86e572cef5 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:06.379694 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e9a89-33f8-468e-96cf-4e86e572cef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:06.379968 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e9a89-33f8-468e-96cf-4e86e572cef5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:06.380760 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e9a89-33f8-468e-96cf-4e86e572cef5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:06.381069 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e9a89-33f8-468e-96cf-4e86e572cef5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:06.383016 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e9a89-33f8-468e-96cf-4e86e572cef5 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:06.395048 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 639/1266] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:19:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:19:06.401845 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4f1d8-3be0-4cbe-afcb-b4ee7accbc23 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:06.412191 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4f1d8-3be0-4cbe-afcb-b4ee7accbc23 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:06.417698 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91aec0e-9e16-4c29-a4eb-32c2a2299b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:06.418322 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91aec0e-9e16-4c29-a4eb-32c2a2299b87 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:06.418603 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91aec0e-9e16-4c29-a4eb-32c2a2299b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:06.418877 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91aec0e-9e16-4c29-a4eb-32c2a2299b87 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:06.419709 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91aec0e-9e16-4c29-a4eb-32c2a2299b87 admin admin] RBAC: Adding query filter params (role.id=e68dc60061bd41dc894e1be26b4d5027, scope.project.id=2955b3037801465c9eec5d78fe2e3ae9, user.id=d100a378f1ff441080555bfc2ff4d6ff) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:06.420026 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91aec0e-9e16-4c29-a4eb-32c2a2299b87 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:06.421851 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91aec0e-9e16-4c29-a4eb-32c2a2299b87 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:06.427740 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 628/1267] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:19:06 2021] GET /identity/v3/role_assignments?user.id=d100a378f1ff441080555bfc2ff4d6ff&scope.project.id=2955b3037801465c9eec5d78fe2e3ae9&role.id=e68dc60061bd41dc894e1be26b4d5027 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:19:08.724899 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55388d-26a4-4753-a45e-195c16e6db0a None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:08.725455 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55388d-26a4-4753-a45e-195c16e6db0a None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:08.725455 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55388d-26a4-4753-a45e-195c16e6db0a None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:08.727410 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 640/1268] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:19:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:19:08.733118 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d808069-7bfb-4981-9670-ee2df6292ce3 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:08.733558 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d808069-7bfb-4981-9670-ee2df6292ce3 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:08.733696 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d808069-7bfb-4981-9670-ee2df6292ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:08.750579 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-9d808069-7bfb-4981-9670-ee2df6292ce3 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:19:08.751757 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-9d808069-7bfb-4981-9670-ee2df6292ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:19:08.759839 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 629/1269] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:19:08 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:19:08.784719 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55388d-26a4-4753-a45e-195c16e6db0a None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:08.797242 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55388d-26a4-4753-a45e-195c16e6db0a None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:08.801606 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660246e4-a1bb-4316-944c-94f0a3f315ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:08.802387 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660246e4-a1bb-4316-944c-94f0a3f315ff admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:08.802666 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660246e4-a1bb-4316-944c-94f0a3f315ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:08.802937 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660246e4-a1bb-4316-944c-94f0a3f315ff admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:08.813230 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660246e4-a1bb-4316-944c-94f0a3f315ff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:19:08.820015 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-660246e4-a1bb-4316-944c-94f0a3f315ff admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 19:19:08.822196 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 641/1270] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:19:08 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:19:08.828855 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d808069-7bfb-4981-9670-ee2df6292ce3 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:08.838274 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d808069-7bfb-4981-9670-ee2df6292ce3 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:08.842696 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8529b0-ba3c-40a5-aa02-1f2bfeb45a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:08.843341 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8529b0-ba3c-40a5-aa02-1f2bfeb45a04 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:08.846585 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8529b0-ba3c-40a5-aa02-1f2bfeb45a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:08.846585 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8529b0-ba3c-40a5-aa02-1f2bfeb45a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:08.846585 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8529b0-ba3c-40a5-aa02-1f2bfeb45a04 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:08.846585 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8529b0-ba3c-40a5-aa02-1f2bfeb45a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:08.846585 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8529b0-ba3c-40a5-aa02-1f2bfeb45a04 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:08.854833 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 630/1271] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:19:08 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:19:08.860834 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660246e4-a1bb-4316-944c-94f0a3f315ff admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:08.872101 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660246e4-a1bb-4316-944c-94f0a3f315ff admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:08.876725 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c583f-f1f2-4cad-9fe1-de68a005eae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:08.877519 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c583f-f1f2-4cad-9fe1-de68a005eae3 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:08.877797 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c583f-f1f2-4cad-9fe1-de68a005eae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:08.878124 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c583f-f1f2-4cad-9fe1-de68a005eae3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:08.889220 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c583f-f1f2-4cad-9fe1-de68a005eae3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:08.891059 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c583f-f1f2-4cad-9fe1-de68a005eae3 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:08.907580 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-cd1c583f-f1f2-4cad-9fe1-de68a005eae3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:19:08.908835 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 642/1272] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:19:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:19:08.915177 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8529b0-ba3c-40a5-aa02-1f2bfeb45a04 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:08.924622 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8529b0-ba3c-40a5-aa02-1f2bfeb45a04 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:08.929031 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578451ea-d89a-4654-a7c3-19277b56e173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:08.929694 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578451ea-d89a-4654-a7c3-19277b56e173 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:08.929974 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578451ea-d89a-4654-a7c3-19277b56e173 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:08.930760 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578451ea-d89a-4654-a7c3-19277b56e173 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:08.931482 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578451ea-d89a-4654-a7c3-19277b56e173 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:08.931784 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578451ea-d89a-4654-a7c3-19277b56e173 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:08.933338 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578451ea-d89a-4654-a7c3-19277b56e173 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:08.944525 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 631/1273] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:19:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:19:08.950922 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c583f-f1f2-4cad-9fe1-de68a005eae3 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:08.960625 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c583f-f1f2-4cad-9fe1-de68a005eae3 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:08.965787 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a55e2-858e-4009-b65e-631737dc1beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:08.966562 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a55e2-858e-4009-b65e-631737dc1beb admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:08.966843 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a55e2-858e-4009-b65e-631737dc1beb admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:08.967118 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a55e2-858e-4009-b65e-631737dc1beb admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:08.974217 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a55e2-858e-4009-b65e-631737dc1beb admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:08.976418 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a55e2-858e-4009-b65e-631737dc1beb admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:08.991400 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-6d7a55e2-858e-4009-b65e-631737dc1beb admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 23 19:19:08.993506 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 643/1274] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:19:08 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:19:08.999307 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578451ea-d89a-4654-a7c3-19277b56e173 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:09.010082 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578451ea-d89a-4654-a7c3-19277b56e173 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:09.014930 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c3482-08b7-48e2-adf0-68de32d385d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:09.015646 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c3482-08b7-48e2-adf0-68de32d385d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:09.020669 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c3482-08b7-48e2-adf0-68de32d385d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:09.020669 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c3482-08b7-48e2-adf0-68de32d385d6 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:09.020669 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c3482-08b7-48e2-adf0-68de32d385d6 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:09.020669 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c3482-08b7-48e2-adf0-68de32d385d6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:09.020669 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c3482-08b7-48e2-adf0-68de32d385d6 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:09.037512 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 632/1275] 10.222.0.62 () {56 vars in 1164 bytes} [Tue Nov 23 19:19:08 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:19:09.044780 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a55e2-858e-4009-b65e-631737dc1beb admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:09.054212 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a55e2-858e-4009-b65e-631737dc1beb admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:09.059263 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714586b-9ea2-4b17-b454-e683bb6ba92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:09.059883 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714586b-9ea2-4b17-b454-e683bb6ba92c admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:09.060164 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714586b-9ea2-4b17-b454-e683bb6ba92c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:09.060438 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714586b-9ea2-4b17-b454-e683bb6ba92c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:09.068040 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714586b-9ea2-4b17-b454-e683bb6ba92c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:09.069764 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714586b-9ea2-4b17-b454-e683bb6ba92c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:09.079318 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 644/1276] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:19:09 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:19:09.085506 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c3482-08b7-48e2-adf0-68de32d385d6 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:09.095532 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c3482-08b7-48e2-adf0-68de32d385d6 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:09.100165 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f10173-c07c-4c13-a7b2-6cb637daa956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:09.100938 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f10173-c07c-4c13-a7b2-6cb637daa956 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:09.101219 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f10173-c07c-4c13-a7b2-6cb637daa956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:09.102086 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f10173-c07c-4c13-a7b2-6cb637daa956 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:09.112487 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f10173-c07c-4c13-a7b2-6cb637daa956 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:09.114300 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f10173-c07c-4c13-a7b2-6cb637daa956 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:09.131057 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-42f10173-c07c-4c13-a7b2-6cb637daa956 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:19:09.132168 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 633/1277] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:19:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:19:09.138351 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714586b-9ea2-4b17-b454-e683bb6ba92c admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:09.147138 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714586b-9ea2-4b17-b454-e683bb6ba92c admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:09.152377 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ebaee-e8f0-4c34-b639-35745813313e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:09.153020 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ebaee-e8f0-4c34-b639-35745813313e admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:09.153300 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ebaee-e8f0-4c34-b639-35745813313e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:09.153818 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ebaee-e8f0-4c34-b639-35745813313e admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:09.154530 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ebaee-e8f0-4c34-b639-35745813313e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:09.154835 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ebaee-e8f0-4c34-b639-35745813313e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:09.156387 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ebaee-e8f0-4c34-b639-35745813313e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:09.168718 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 645/1278] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:19:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:19:09.174669 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f10173-c07c-4c13-a7b2-6cb637daa956 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:09.184117 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f10173-c07c-4c13-a7b2-6cb637daa956 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:09.188550 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5dcda-dee6-4721-bc9a-c90b66112f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:09.189311 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5dcda-dee6-4721-bc9a-c90b66112f85 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:09.189632 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5dcda-dee6-4721-bc9a-c90b66112f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:09.189906 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5dcda-dee6-4721-bc9a-c90b66112f85 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:09.196439 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5dcda-dee6-4721-bc9a-c90b66112f85 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:09.198357 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5dcda-dee6-4721-bc9a-c90b66112f85 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:09.211331 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-1db5dcda-dee6-4721-bc9a-c90b66112f85 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:19:09.213012 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 634/1279] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:19:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:19:09.219448 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ebaee-e8f0-4c34-b639-35745813313e admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:09.229984 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ebaee-e8f0-4c34-b639-35745813313e admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:09.234511 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4cf89-06d1-4cfb-a7d3-b05b40505d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:09.235164 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4cf89-06d1-4cfb-a7d3-b05b40505d26 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:09.235438 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4cf89-06d1-4cfb-a7d3-b05b40505d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:09.235718 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4cf89-06d1-4cfb-a7d3-b05b40505d26 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:09.236512 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4cf89-06d1-4cfb-a7d3-b05b40505d26 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:09.236821 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4cf89-06d1-4cfb-a7d3-b05b40505d26 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:09.238678 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4cf89-06d1-4cfb-a7d3-b05b40505d26 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:09.250904 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 646/1280] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:19:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:19:09.257386 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5dcda-dee6-4721-bc9a-c90b66112f85 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:09.268942 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5dcda-dee6-4721-bc9a-c90b66112f85 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:09.273487 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9218891-697c-4aba-b854-230c38f09896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:09.274735 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9218891-697c-4aba-b854-230c38f09896 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:09.275032 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9218891-697c-4aba-b854-230c38f09896 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:09.275299 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9218891-697c-4aba-b854-230c38f09896 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:09.276115 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9218891-697c-4aba-b854-230c38f09896 admin admin] RBAC: Adding query filter params (role.id=6d9a8878ffeb49fea19d854657c6b767, scope.project.id=2955b3037801465c9eec5d78fe2e3ae9, user.id=d100a378f1ff441080555bfc2ff4d6ff) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:09.276423 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9218891-697c-4aba-b854-230c38f09896 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:09.278260 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9218891-697c-4aba-b854-230c38f09896 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:09.283615 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 635/1281] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:19:09 2021] GET /identity/v3/role_assignments?user.id=d100a378f1ff441080555bfc2ff4d6ff&scope.project.id=2955b3037801465c9eec5d78fe2e3ae9&role.id=6d9a8878ffeb49fea19d854657c6b767 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:19:11.572643 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959e633-c85f-4461-8604-5a17422e970a None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:11.573194 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959e633-c85f-4461-8604-5a17422e970a None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:11.573283 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959e633-c85f-4461-8604-5a17422e970a None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:11.575037 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 647/1282] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:19:11 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:19:11.580908 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aa2d5-0fa1-4f64-98b4-01d661b228df None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:11.581286 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aa2d5-0fa1-4f64-98b4-01d661b228df None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:11.581493 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aa2d5-0fa1-4f64-98b4-01d661b228df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:11.599724 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-461aa2d5-0fa1-4f64-98b4-01d661b228df None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:19:11.600905 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-461aa2d5-0fa1-4f64-98b4-01d661b228df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:19:11.609002 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 636/1283] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:19:11 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:19:11.632199 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959e633-c85f-4461-8604-5a17422e970a None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:11.645308 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959e633-c85f-4461-8604-5a17422e970a None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:11.650754 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c0ff3-b187-4e6b-9bb6-0e13ef12f023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:11.651517 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c0ff3-b187-4e6b-9bb6-0e13ef12f023 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:11.651793 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c0ff3-b187-4e6b-9bb6-0e13ef12f023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:11.652061 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c0ff3-b187-4e6b-9bb6-0e13ef12f023 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:11.662086 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c0ff3-b187-4e6b-9bb6-0e13ef12f023 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:19:11.669378 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-4c2c0ff3-b187-4e6b-9bb6-0e13ef12f023 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 19:19:11.670552 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 648/1284] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:19:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:19:11.676992 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461aa2d5-0fa1-4f64-98b4-01d661b228df None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:11.686569 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461aa2d5-0fa1-4f64-98b4-01d661b228df None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:11.691029 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21369a3a-6388-4932-b970-5335560b68d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:11.691676 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21369a3a-6388-4932-b970-5335560b68d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:11.691956 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21369a3a-6388-4932-b970-5335560b68d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:11.692228 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21369a3a-6388-4932-b970-5335560b68d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:11.692975 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21369a3a-6388-4932-b970-5335560b68d7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:11.693279 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21369a3a-6388-4932-b970-5335560b68d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:11.694864 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21369a3a-6388-4932-b970-5335560b68d7 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:11.703712 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 637/1285] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:19:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:19:11.709624 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c0ff3-b187-4e6b-9bb6-0e13ef12f023 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:11.719646 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c0ff3-b187-4e6b-9bb6-0e13ef12f023 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:11.724115 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c864802-1494-4ef6-9412-954ba6074dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:11.726407 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c864802-1494-4ef6-9412-954ba6074dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:11.726407 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c864802-1494-4ef6-9412-954ba6074dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:11.726407 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c864802-1494-4ef6-9412-954ba6074dd0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:11.735569 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c864802-1494-4ef6-9412-954ba6074dd0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:11.737359 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c864802-1494-4ef6-9412-954ba6074dd0 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:11.752869 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-9c864802-1494-4ef6-9412-954ba6074dd0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:19:11.753996 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 649/1286] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:19:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:19:11.760546 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21369a3a-6388-4932-b970-5335560b68d7 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:11.769913 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21369a3a-6388-4932-b970-5335560b68d7 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:11.775022 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81780cff-fecf-4b95-bbed-cfa1a8f81e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:11.775657 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81780cff-fecf-4b95-bbed-cfa1a8f81e74 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:11.775938 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81780cff-fecf-4b95-bbed-cfa1a8f81e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:11.776211 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81780cff-fecf-4b95-bbed-cfa1a8f81e74 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:11.776961 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81780cff-fecf-4b95-bbed-cfa1a8f81e74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:11.777261 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81780cff-fecf-4b95-bbed-cfa1a8f81e74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:11.778853 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81780cff-fecf-4b95-bbed-cfa1a8f81e74 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:11.791259 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 638/1287] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:19:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:19:11.797265 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c864802-1494-4ef6-9412-954ba6074dd0 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:11.807637 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c864802-1494-4ef6-9412-954ba6074dd0 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:11.812168 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387057d-7a97-40f0-a74d-f329d2ef9685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:11.812941 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387057d-7a97-40f0-a74d-f329d2ef9685 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:11.813222 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387057d-7a97-40f0-a74d-f329d2ef9685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:11.813537 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387057d-7a97-40f0-a74d-f329d2ef9685 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:11.821605 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387057d-7a97-40f0-a74d-f329d2ef9685 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:11.823679 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387057d-7a97-40f0-a74d-f329d2ef9685 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:11.837443 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-5387057d-7a97-40f0-a74d-f329d2ef9685 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 23 19:19:11.838578 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 650/1288] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:19:11 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 23 19:19:11.844698 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81780cff-fecf-4b95-bbed-cfa1a8f81e74 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:11.854659 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81780cff-fecf-4b95-bbed-cfa1a8f81e74 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:11.859151 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf45b5-c13e-447e-a46b-12792ba2862b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:11.859788 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf45b5-c13e-447e-a46b-12792ba2862b admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:11.860067 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf45b5-c13e-447e-a46b-12792ba2862b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:11.860339 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf45b5-c13e-447e-a46b-12792ba2862b admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:11.861175 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf45b5-c13e-447e-a46b-12792ba2862b admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:11.861512 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf45b5-c13e-447e-a46b-12792ba2862b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:11.863358 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf45b5-c13e-447e-a46b-12792ba2862b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:11.880864 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 639/1289] 10.222.0.62 () {56 vars in 1164 bytes} [Tue Nov 23 19:19:11 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:19:11.886806 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387057d-7a97-40f0-a74d-f329d2ef9685 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:11.896109 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387057d-7a97-40f0-a74d-f329d2ef9685 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:11.901046 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c1ef0-ce22-447c-abfc-fe60cc0e60e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:11.901926 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c1ef0-ce22-447c-abfc-fe60cc0e60e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:11.902108 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c1ef0-ce22-447c-abfc-fe60cc0e60e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:11.902437 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c1ef0-ce22-447c-abfc-fe60cc0e60e9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:11.912662 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c1ef0-ce22-447c-abfc-fe60cc0e60e9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:11.915089 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c1ef0-ce22-447c-abfc-fe60cc0e60e9 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:11.930627 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-7f3c1ef0-ce22-447c-abfc-fe60cc0e60e9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:19:11.931757 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 651/1290] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:19:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:19:11.937855 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf45b5-c13e-447e-a46b-12792ba2862b admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:11.947383 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf45b5-c13e-447e-a46b-12792ba2862b admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:11.952291 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937c462-584a-4fb3-9c0e-be9c63beb43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:11.952930 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937c462-584a-4fb3-9c0e-be9c63beb43c admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:11.953233 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937c462-584a-4fb3-9c0e-be9c63beb43c admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:11.953517 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937c462-584a-4fb3-9c0e-be9c63beb43c admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:11.954242 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937c462-584a-4fb3-9c0e-be9c63beb43c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:11.959327 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937c462-584a-4fb3-9c0e-be9c63beb43c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:11.959327 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937c462-584a-4fb3-9c0e-be9c63beb43c admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:11.967661 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 640/1291] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:19:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:19:11.973472 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c1ef0-ce22-447c-abfc-fe60cc0e60e9 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:11.983330 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c1ef0-ce22-447c-abfc-fe60cc0e60e9 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:11.988028 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499210c-de42-44ae-aa8d-ac6209a58504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:11.988542 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499210c-de42-44ae-aa8d-ac6209a58504 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:11.988818 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499210c-de42-44ae-aa8d-ac6209a58504 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:11.989085 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499210c-de42-44ae-aa8d-ac6209a58504 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:11.995874 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499210c-de42-44ae-aa8d-ac6209a58504 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:11.997823 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499210c-de42-44ae-aa8d-ac6209a58504 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:12.011016 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-b499210c-de42-44ae-aa8d-ac6209a58504 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:19:12.012198 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 652/1292] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:19:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:19:12.018369 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937c462-584a-4fb3-9c0e-be9c63beb43c admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:12.028686 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937c462-584a-4fb3-9c0e-be9c63beb43c admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:12.033120 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b01ff-1699-47a4-8838-70890b709964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:12.033790 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b01ff-1699-47a4-8838-70890b709964 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:12.040487 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b01ff-1699-47a4-8838-70890b709964 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:12.040487 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b01ff-1699-47a4-8838-70890b709964 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:12.040487 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b01ff-1699-47a4-8838-70890b709964 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:12.040487 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b01ff-1699-47a4-8838-70890b709964 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:12.040487 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b01ff-1699-47a4-8838-70890b709964 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:12.050390 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 641/1293] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:19:12 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:19:12.057459 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499210c-de42-44ae-aa8d-ac6209a58504 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:12.067107 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499210c-de42-44ae-aa8d-ac6209a58504 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:12.071747 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cb1a0-1a9c-4a77-bc91-ce44b3c41d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:12.072607 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cb1a0-1a9c-4a77-bc91-ce44b3c41d79 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:12.072888 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cb1a0-1a9c-4a77-bc91-ce44b3c41d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:12.073163 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cb1a0-1a9c-4a77-bc91-ce44b3c41d79 admin admin] PATH_INFO: `/v3/projects/2955b3037801465c9eec5d78fe2e3ae9/users/d100a378f1ff441080555bfc2ff4d6ff/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:12.075199 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09cb1a0-1a9c-4a77-bc91-ce44b3c41d79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2955b3037801465c9eec5d78fe2e3ae9, user_id=d100a378f1ff441080555bfc2ff4d6ff, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:12.078039 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09cb1a0-1a9c-4a77-bc91-ce44b3c41d79 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:12.155326 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 653/1294] 10.222.0.62 () {58 vars in 1460 bytes} [Tue Nov 23 19:19:12 2021] PUT /identity/v3/projects/2955b3037801465c9eec5d78fe2e3ae9/users/d100a378f1ff441080555bfc2ff4d6ff/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:19:14.402491 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc13416-c0a5-44e1-ba63-203ad4150ed7 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:14.403053 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc13416-c0a5-44e1-ba63-203ad4150ed7 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:14.403053 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc13416-c0a5-44e1-ba63-203ad4150ed7 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:14.404876 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 642/1295] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:19:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:19:14.410886 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12eb79d-10c7-4473-89d4-4f8844c7c60d None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:14.411309 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12eb79d-10c7-4473-89d4-4f8844c7c60d None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:14.411450 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12eb79d-10c7-4473-89d4-4f8844c7c60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:14.429913 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-a12eb79d-10c7-4473-89d4-4f8844c7c60d None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:19:14.431514 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-a12eb79d-10c7-4473-89d4-4f8844c7c60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:19:14.488150 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 654/1296] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:19:14 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:19:14.514448 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc13416-c0a5-44e1-ba63-203ad4150ed7 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:14.526434 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc13416-c0a5-44e1-ba63-203ad4150ed7 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:14.530680 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fce28d-8323-4027-a389-5db6d92e7a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:14.531437 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fce28d-8323-4027-a389-5db6d92e7a8a admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:14.531710 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fce28d-8323-4027-a389-5db6d92e7a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:14.531976 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fce28d-8323-4027-a389-5db6d92e7a8a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:14.542647 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fce28d-8323-4027-a389-5db6d92e7a8a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 23 19:19:14.549398 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-f1fce28d-8323-4027-a389-5db6d92e7a8a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 23 19:19:14.550559 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 643/1297] 10.222.0.62 () {56 vars in 1117 bytes} [Tue Nov 23 19:19:14 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:19:14.557472 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12eb79d-10c7-4473-89d4-4f8844c7c60d None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:14.566575 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12eb79d-10c7-4473-89d4-4f8844c7c60d None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:14.571422 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f5a69-6c56-4768-8eb9-2bc2e49b9c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:14.572067 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f5a69-6c56-4768-8eb9-2bc2e49b9c8e admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:14.572349 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f5a69-6c56-4768-8eb9-2bc2e49b9c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:14.572624 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f5a69-6c56-4768-8eb9-2bc2e49b9c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:14.573380 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f5a69-6c56-4768-8eb9-2bc2e49b9c8e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:14.573713 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f5a69-6c56-4768-8eb9-2bc2e49b9c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:14.575279 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f5a69-6c56-4768-8eb9-2bc2e49b9c8e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:14.583954 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 655/1298] 10.222.0.62 () {56 vars in 1120 bytes} [Tue Nov 23 19:19:14 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:19:14.590199 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fce28d-8323-4027-a389-5db6d92e7a8a admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:14.600077 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fce28d-8323-4027-a389-5db6d92e7a8a admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:14.604992 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d301b7-a56e-447a-9700-ee6fd016b2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:14.605784 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d301b7-a56e-447a-9700-ee6fd016b2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:14.610102 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d301b7-a56e-447a-9700-ee6fd016b2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:14.610102 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d301b7-a56e-447a-9700-ee6fd016b2d6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:14.616023 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d301b7-a56e-447a-9700-ee6fd016b2d6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:14.618451 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d301b7-a56e-447a-9700-ee6fd016b2d6 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:14.635826 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-92d301b7-a56e-447a-9700-ee6fd016b2d6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:19:14.638806 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 644/1299] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:19:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:19:14.643308 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f5a69-6c56-4768-8eb9-2bc2e49b9c8e admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:14.653560 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f5a69-6c56-4768-8eb9-2bc2e49b9c8e admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:14.658196 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0169ec-5e2a-4919-8379-963b392b8ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:14.658834 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0169ec-5e2a-4919-8379-963b392b8ade admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:14.659119 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0169ec-5e2a-4919-8379-963b392b8ade admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:14.659396 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0169ec-5e2a-4919-8379-963b392b8ade admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:14.660134 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0169ec-5e2a-4919-8379-963b392b8ade admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:14.660439 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0169ec-5e2a-4919-8379-963b392b8ade admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:14.662112 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0169ec-5e2a-4919-8379-963b392b8ade admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:14.674533 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 656/1300] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:19:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:19:14.681511 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d301b7-a56e-447a-9700-ee6fd016b2d6 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:14.691046 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d301b7-a56e-447a-9700-ee6fd016b2d6 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:14.695571 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee0f33-5b05-40d4-9dca-b5c3b8faddd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:14.696348 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee0f33-5b05-40d4-9dca-b5c3b8faddd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:14.696625 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee0f33-5b05-40d4-9dca-b5c3b8faddd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:14.696897 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee0f33-5b05-40d4-9dca-b5c3b8faddd7 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:14.704388 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee0f33-5b05-40d4-9dca-b5c3b8faddd7 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:14.706393 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee0f33-5b05-40d4-9dca-b5c3b8faddd7 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:14.720243 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-7eee0f33-5b05-40d4-9dca-b5c3b8faddd7 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 23 19:19:14.721344 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 645/1301] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:19:14 2021] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:19:14.728278 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0169ec-5e2a-4919-8379-963b392b8ade admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:14.737684 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0169ec-5e2a-4919-8379-963b392b8ade admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:14.742146 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876ef6c-0ee6-435d-8649-c3f888606aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:14.747736 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876ef6c-0ee6-435d-8649-c3f888606aaf admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:14.747736 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876ef6c-0ee6-435d-8649-c3f888606aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:14.747736 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876ef6c-0ee6-435d-8649-c3f888606aaf admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:14.747736 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5876ef6c-0ee6-435d-8649-c3f888606aaf admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:14.747736 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5876ef6c-0ee6-435d-8649-c3f888606aaf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:14.747736 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5876ef6c-0ee6-435d-8649-c3f888606aaf admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:14.763154 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 657/1302] 10.222.0.62 () {56 vars in 1164 bytes} [Tue Nov 23 19:19:14 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:19:14.769181 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee0f33-5b05-40d4-9dca-b5c3b8faddd7 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:14.778869 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee0f33-5b05-40d4-9dca-b5c3b8faddd7 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:14.783295 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92b803-3228-4ff5-b051-02036b75885a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:14.783921 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92b803-3228-4ff5-b051-02036b75885a admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:14.784207 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92b803-3228-4ff5-b051-02036b75885a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:14.784481 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92b803-3228-4ff5-b051-02036b75885a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:14.792777 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92b803-3228-4ff5-b051-02036b75885a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:14.794526 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92b803-3228-4ff5-b051-02036b75885a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:14.803142 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 646/1303] 10.222.0.62 () {58 vars in 1324 bytes} [Tue Nov 23 19:19:14 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:19:14.809910 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876ef6c-0ee6-435d-8649-c3f888606aaf admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:14.819624 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876ef6c-0ee6-435d-8649-c3f888606aaf admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:14.824231 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff5c77-e33b-4ba4-a567-b469d4b1689e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:14.834041 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff5c77-e33b-4ba4-a567-b469d4b1689e admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:14.834041 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff5c77-e33b-4ba4-a567-b469d4b1689e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:14.834041 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff5c77-e33b-4ba4-a567-b469d4b1689e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:14.835683 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff5c77-e33b-4ba4-a567-b469d4b1689e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:14.837505 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff5c77-e33b-4ba4-a567-b469d4b1689e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:14.854320 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-5fff5c77-e33b-4ba4-a567-b469d4b1689e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 23 19:19:14.855429 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 658/1304] 10.222.0.62 () {56 vars in 1129 bytes} [Tue Nov 23 19:19:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:19:14.861563 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92b803-3228-4ff5-b051-02036b75885a admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:14.870934 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92b803-3228-4ff5-b051-02036b75885a admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:14.875461 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a2aba-60a9-470c-be30-1a7b0fb7a8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:14.876094 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a2aba-60a9-470c-be30-1a7b0fb7a8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:14.876374 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a2aba-60a9-470c-be30-1a7b0fb7a8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:14.876646 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a2aba-60a9-470c-be30-1a7b0fb7a8f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:14.877362 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a2aba-60a9-470c-be30-1a7b0fb7a8f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:14.877696 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a2aba-60a9-470c-be30-1a7b0fb7a8f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:14.879267 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a2aba-60a9-470c-be30-1a7b0fb7a8f9 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:14.890185 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 647/1305] 10.222.0.62 () {56 vars in 1130 bytes} [Tue Nov 23 19:19:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:19:14.896495 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff5c77-e33b-4ba4-a567-b469d4b1689e admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:14.906611 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff5c77-e33b-4ba4-a567-b469d4b1689e admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:14.911084 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ab75c-f030-4cf4-bbb5-039ade444c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:14.911845 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ab75c-f030-4cf4-bbb5-039ade444c59 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:14.912126 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ab75c-f030-4cf4-bbb5-039ade444c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:14.912396 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ab75c-f030-4cf4-bbb5-039ade444c59 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:14.919849 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ab75c-f030-4cf4-bbb5-039ade444c59 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:14.921813 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ab75c-f030-4cf4-bbb5-039ade444c59 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:14.934461 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING keystone.server.flask.application [None req-5c3ab75c-f030-4cf4-bbb5-039ade444c59 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 23 19:19:14.939718 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 659/1306] 10.222.0.62 () {56 vars in 1132 bytes} [Tue Nov 23 19:19:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:19:14.942289 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a2aba-60a9-470c-be30-1a7b0fb7a8f9 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:14.952144 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a2aba-60a9-470c-be30-1a7b0fb7a8f9 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:14.956832 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aacd4e-d77e-4a2b-b8ed-2215f0057917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:14.957479 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aacd4e-d77e-4a2b-b8ed-2215f0057917 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:14.957768 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aacd4e-d77e-4a2b-b8ed-2215f0057917 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:14.958044 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aacd4e-d77e-4a2b-b8ed-2215f0057917 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:14.958834 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aacd4e-d77e-4a2b-b8ed-2215f0057917 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:14.959141 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aacd4e-d77e-4a2b-b8ed-2215f0057917 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:14.961557 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aacd4e-d77e-4a2b-b8ed-2215f0057917 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:14.973278 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 648/1307] 10.222.0.62 () {56 vars in 1169 bytes} [Tue Nov 23 19:19:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:19:14.980272 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ab75c-f030-4cf4-bbb5-039ade444c59 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:14.990560 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ab75c-f030-4cf4-bbb5-039ade444c59 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:14.995296 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5087b-a0cf-4d66-889a-d945830bc71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:14.995918 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5087b-a0cf-4d66-889a-d945830bc71e admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:14.996202 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5087b-a0cf-4d66-889a-d945830bc71e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:14.996476 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5087b-a0cf-4d66-889a-d945830bc71e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:14.997315 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5087b-a0cf-4d66-889a-d945830bc71e admin admin] RBAC: Adding query filter params (role.id=6d9a8878ffeb49fea19d854657c6b767, scope.project.id=2955b3037801465c9eec5d78fe2e3ae9, user.id=d100a378f1ff441080555bfc2ff4d6ff) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:14.997657 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5087b-a0cf-4d66-889a-d945830bc71e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:14.999526 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5087b-a0cf-4d66-889a-d945830bc71e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:15.005203 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 660/1308] 10.222.0.62 () {56 vars in 1395 bytes} [Tue Nov 23 19:19:14 2021] GET /identity/v3/role_assignments?user.id=d100a378f1ff441080555bfc2ff4d6ff&scope.project.id=2955b3037801465c9eec5d78fe2e3ae9&role.id=6d9a8878ffeb49fea19d854657c6b767 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:19:17.274139 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495267fd-106b-4c9b-b5ce-f20d1b821d04 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:17.274791 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495267fd-106b-4c9b-b5ce-f20d1b821d04 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:17.274791 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495267fd-106b-4c9b-b5ce-f20d1b821d04 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:17.276449 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 649/1309] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:19:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:19:17.282220 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cb35e-b03d-4de2-93e0-df3797656329 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:17.282660 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cb35e-b03d-4de2-93e0-df3797656329 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:17.282800 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cb35e-b03d-4de2-93e0-df3797656329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:17.300020 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-9a0cb35e-b03d-4de2-93e0-df3797656329 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:19:17.301365 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-9a0cb35e-b03d-4de2-93e0-df3797656329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:19:17.309670 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 661/1310] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:19:17 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:19:17.333518 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495267fd-106b-4c9b-b5ce-f20d1b821d04 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:17.346858 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495267fd-106b-4c9b-b5ce-f20d1b821d04 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:17.352295 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d1afe-31fb-4e7b-ad91-6a66b74d595b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:17.353116 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d1afe-31fb-4e7b-ad91-6a66b74d595b admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:17.353469 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d1afe-31fb-4e7b-ad91-6a66b74d595b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:17.353746 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d1afe-31fb-4e7b-ad91-6a66b74d595b admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:17.354405 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d1afe-31fb-4e7b-ad91-6a66b74d595b admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:17.355953 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d1afe-31fb-4e7b-ad91-6a66b74d595b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:17.366772 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-542d1afe-31fb-4e7b-ad91-6a66b74d595b admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 23 19:19:17.368405 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 650/1311] 10.222.0.62 () {56 vars in 1138 bytes} [Tue Nov 23 19:19:17 2021] GET /identity/v3/services/placement => generated 90 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:19:17.374899 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0cb35e-b03d-4de2-93e0-df3797656329 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:17.384053 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0cb35e-b03d-4de2-93e0-df3797656329 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:17.388712 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9dc12a-beaf-45bc-9414-86544cb3855b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:17.389359 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9dc12a-beaf-45bc-9414-86544cb3855b admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:17.389671 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9dc12a-beaf-45bc-9414-86544cb3855b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:17.389949 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9dc12a-beaf-45bc-9414-86544cb3855b admin admin] PATH_INFO: `/v3/services` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:17.390669 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9dc12a-beaf-45bc-9414-86544cb3855b admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:17.390977 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9dc12a-beaf-45bc-9414-86544cb3855b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:17.392539 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9dc12a-beaf-45bc-9414-86544cb3855b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:17.397239 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 662/1312] 10.222.0.62 () {56 vars in 1137 bytes} [Tue Nov 23 19:19:17 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:19:17.404091 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d1afe-31fb-4e7b-ad91-6a66b74d595b admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:17.413682 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d1afe-31fb-4e7b-ad91-6a66b74d595b admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:17.419306 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514301fc-ab5e-4aa8-92cc-da4609657a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:17.419937 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514301fc-ab5e-4aa8-92cc-da4609657a42 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:17.420216 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514301fc-ab5e-4aa8-92cc-da4609657a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:17.420484 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514301fc-ab5e-4aa8-92cc-da4609657a42 admin admin] PATH_INFO: `/v3/services` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:17.421199 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514301fc-ab5e-4aa8-92cc-da4609657a42 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:17.421566 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514301fc-ab5e-4aa8-92cc-da4609657a42 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:17.423109 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514301fc-ab5e-4aa8-92cc-da4609657a42 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:17.427420 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 651/1313] 10.222.0.62 () {56 vars in 1137 bytes} [Tue Nov 23 19:19:17 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:19:19.651197 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178de11e-3247-4583-ace5-eb761f046fd9 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:19.651735 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178de11e-3247-4583-ace5-eb761f046fd9 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:19.651735 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178de11e-3247-4583-ace5-eb761f046fd9 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:19.653539 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 663/1314] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:19:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 19:19:19.659257 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747476cb-48cc-4632-a247-a500472c4cdd None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:19.659688 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747476cb-48cc-4632-a247-a500472c4cdd None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:19.659848 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747476cb-48cc-4632-a247-a500472c4cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:19.678131 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-747476cb-48cc-4632-a247-a500472c4cdd None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:19:19.679589 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-747476cb-48cc-4632-a247-a500472c4cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:19:19.687203 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 652/1315] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:19:19 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:19:19.712020 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178de11e-3247-4583-ace5-eb761f046fd9 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:19.724119 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178de11e-3247-4583-ace5-eb761f046fd9 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:19.729367 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5f3ac-e475-4d0e-8707-e986f6147e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:19.730033 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5f3ac-e475-4d0e-8707-e986f6147e3f admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:19.730423 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5f3ac-e475-4d0e-8707-e986f6147e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:19.730729 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5f3ac-e475-4d0e-8707-e986f6147e3f admin admin] PATH_INFO: `/v3/services` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:19.731450 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5f3ac-e475-4d0e-8707-e986f6147e3f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:19.733016 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5f3ac-e475-4d0e-8707-e986f6147e3f admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:19.806861 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 664/1316] 10.222.0.62 () {60 vars in 1162 bytes} [Tue Nov 23 19:19:19 2021] POST /identity/v3/services => generated 246 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:19:22.067280 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff2a87-27a4-41ea-9bf1-cafc4193c0ac None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:22.067798 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff2a87-27a4-41ea-9bf1-cafc4193c0ac None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:22.067798 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff2a87-27a4-41ea-9bf1-cafc4193c0ac None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:22.069618 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 653/1317] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:19:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:19:22.076242 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac32997-3963-46b3-88a8-ee86c02ab7ca None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:22.076644 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac32997-3963-46b3-88a8-ee86c02ab7ca None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:22.076805 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac32997-3963-46b3-88a8-ee86c02ab7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:22.095687 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-9ac32997-3963-46b3-88a8-ee86c02ab7ca None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:19:22.096866 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-9ac32997-3963-46b3-88a8-ee86c02ab7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:19:22.113225 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 665/1318] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:19:22 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:19:22.137280 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff2a87-27a4-41ea-9bf1-cafc4193c0ac None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:22.149993 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff2a87-27a4-41ea-9bf1-cafc4193c0ac None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:22.154427 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a1ae9-d2f8-4475-b5fa-0745eaf0d158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:22.155200 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a1ae9-d2f8-4475-b5fa-0745eaf0d158 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:22.155480 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a1ae9-d2f8-4475-b5fa-0745eaf0d158 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:22.155753 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a1ae9-d2f8-4475-b5fa-0745eaf0d158 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:22.156416 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a1ae9-d2f8-4475-b5fa-0745eaf0d158 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:22.158027 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a1ae9-d2f8-4475-b5fa-0745eaf0d158 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:22.168989 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-731a1ae9-d2f8-4475-b5fa-0745eaf0d158 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 23 19:19:22.170131 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 654/1319] 10.222.0.62 () {56 vars in 1138 bytes} [Tue Nov 23 19:19:22 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:19:22.176508 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac32997-3963-46b3-88a8-ee86c02ab7ca None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:22.185635 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac32997-3963-46b3-88a8-ee86c02ab7ca None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:22.190185 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49427c8b-5a4a-4a81-ad06-bc303b46ef5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:22.190830 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49427c8b-5a4a-4a81-ad06-bc303b46ef5a admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:22.191116 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49427c8b-5a4a-4a81-ad06-bc303b46ef5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:22.191392 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49427c8b-5a4a-4a81-ad06-bc303b46ef5a admin admin] PATH_INFO: `/v3/services` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:22.192166 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49427c8b-5a4a-4a81-ad06-bc303b46ef5a admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:22.193061 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49427c8b-5a4a-4a81-ad06-bc303b46ef5a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:22.195220 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49427c8b-5a4a-4a81-ad06-bc303b46ef5a admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:22.200924 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 666/1320] 10.222.0.62 () {56 vars in 1137 bytes} [Tue Nov 23 19:19:22 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:19:22.207545 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a1ae9-d2f8-4475-b5fa-0745eaf0d158 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:22.217938 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a1ae9-d2f8-4475-b5fa-0745eaf0d158 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:22.222523 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d787c-cc01-4cfa-a4f9-637a1e8f4854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:22.223156 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d787c-cc01-4cfa-a4f9-637a1e8f4854 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:22.223439 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d787c-cc01-4cfa-a4f9-637a1e8f4854 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:22.223713 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d787c-cc01-4cfa-a4f9-637a1e8f4854 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:22.224509 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d787c-cc01-4cfa-a4f9-637a1e8f4854 admin admin] RBAC: Adding query filter params (interface=public, service_id=5833446dd3f44639981f6c8244d68186, region_id=RegionOne) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:22.224822 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d787c-cc01-4cfa-a4f9-637a1e8f4854 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:22.227019 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d787c-cc01-4cfa-a4f9-637a1e8f4854 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:22.231828 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 655/1321] 10.222.0.62 () {56 vars in 1272 bytes} [Tue Nov 23 19:19:22 2021] GET /identity/v3/endpoints?service_id=5833446dd3f44639981f6c8244d68186&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:19:22.237930 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49427c8b-5a4a-4a81-ad06-bc303b46ef5a admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:22.248508 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49427c8b-5a4a-4a81-ad06-bc303b46ef5a admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:22.252997 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584ba99-f98d-437e-9922-2654ef008a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:22.253660 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584ba99-f98d-437e-9922-2654ef008a2a admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:22.253941 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584ba99-f98d-437e-9922-2654ef008a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:22.254211 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584ba99-f98d-437e-9922-2654ef008a2a admin admin] PATH_INFO: `/v3/services` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:22.255028 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584ba99-f98d-437e-9922-2654ef008a2a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:22.256540 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584ba99-f98d-437e-9922-2654ef008a2a admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:22.263775 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 667/1322] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Nov 23 19:19:22 2021] GET /identity/v3/services => generated 2191 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:19:24.534318 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c02de-60d4-47e4-8abc-2bc72536857c None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:24.534879 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c02de-60d4-47e4-8abc-2bc72536857c None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:24.534879 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c02de-60d4-47e4-8abc-2bc72536857c None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:24.536641 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 656/1323] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:19:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:19:24.543049 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df0aac-ad44-4070-9a13-c186c4ad6d8c None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:24.543440 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df0aac-ad44-4070-9a13-c186c4ad6d8c None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:24.543599 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df0aac-ad44-4070-9a13-c186c4ad6d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:24.561227 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-45df0aac-ad44-4070-9a13-c186c4ad6d8c None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:19:24.562430 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-45df0aac-ad44-4070-9a13-c186c4ad6d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:19:24.570591 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 668/1324] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:19:24 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:19:24.594681 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c02de-60d4-47e4-8abc-2bc72536857c None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:24.606691 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c02de-60d4-47e4-8abc-2bc72536857c None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:24.611190 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055acaf5-c8fb-42fe-a71f-18eb12a4e139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:24.611962 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055acaf5-c8fb-42fe-a71f-18eb12a4e139 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:24.612245 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055acaf5-c8fb-42fe-a71f-18eb12a4e139 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:24.612521 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055acaf5-c8fb-42fe-a71f-18eb12a4e139 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:24.613176 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055acaf5-c8fb-42fe-a71f-18eb12a4e139 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:24.614775 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055acaf5-c8fb-42fe-a71f-18eb12a4e139 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:24.626168 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING keystone.server.flask.application [None req-055acaf5-c8fb-42fe-a71f-18eb12a4e139 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 23 19:19:24.627307 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 657/1325] 10.222.0.62 () {56 vars in 1138 bytes} [Tue Nov 23 19:19:24 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 23 19:19:24.634100 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df0aac-ad44-4070-9a13-c186c4ad6d8c None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:24.642786 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df0aac-ad44-4070-9a13-c186c4ad6d8c None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:24.647300 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2528f-a445-400a-865e-1525928ed364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:24.648046 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2528f-a445-400a-865e-1525928ed364 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:24.648291 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2528f-a445-400a-865e-1525928ed364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:24.648565 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2528f-a445-400a-865e-1525928ed364 admin admin] PATH_INFO: `/v3/services` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:24.649280 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2528f-a445-400a-865e-1525928ed364 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:19:24.649626 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2528f-a445-400a-865e-1525928ed364 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:24.651188 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2528f-a445-400a-865e-1525928ed364 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:24.656235 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 669/1326] 10.222.0.62 () {56 vars in 1137 bytes} [Tue Nov 23 19:19:24 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:19:24.662119 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055acaf5-c8fb-42fe-a71f-18eb12a4e139 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:19:24.672194 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055acaf5-c8fb-42fe-a71f-18eb12a4e139 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:19:24.676634 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1240149-b077-4115-a599-1d5a877741a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:19:24.677252 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1240149-b077-4115-a599-1d5a877741a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:19:24.685080 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1240149-b077-4115-a599-1d5a877741a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:19:24.685080 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1240149-b077-4115-a599-1d5a877741a9 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:19:24.685080 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1240149-b077-4115-a599-1d5a877741a9 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:19:24.685080 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1240149-b077-4115-a599-1d5a877741a9 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:19:24.765258 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 658/1327] 10.222.0.62 () {60 vars in 1165 bytes} [Tue Nov 23 19:19:24 2021] POST /identity/v3/endpoints => generated 331 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:25:14.718253 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190d70a-03b3-4869-b6cb-65382605f28f None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:14.719352 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190d70a-03b3-4869-b6cb-65382605f28f None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:14.720011 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190d70a-03b3-4869-b6cb-65382605f28f None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:14.727828 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 670/1328] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:25:14 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:25:14.729215 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386621a-1a4b-43f3-87bc-2f1aa13231d9 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:14.729686 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386621a-1a4b-43f3-87bc-2f1aa13231d9 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:14.729940 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386621a-1a4b-43f3-87bc-2f1aa13231d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:14.873599 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-9386621a-1a4b-43f3-87bc-2f1aa13231d9 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:25:14.875818 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-9386621a-1a4b-43f3-87bc-2f1aa13231d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:15.006504 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 659/1329] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:25:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:25:15.031087 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190d70a-03b3-4869-b6cb-65382605f28f None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:25:15.033265 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-c190d70a-03b3-4869-b6cb-65382605f28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:15.175552 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190d70a-03b3-4869-b6cb-65382605f28f None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:25:15.271588 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5143aa2-f01a-4a68-8305-8af14b5a144c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:25:15.272325 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5143aa2-f01a-4a68-8305-8af14b5a144c admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:15.272707 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5143aa2-f01a-4a68-8305-8af14b5a144c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:15.273077 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5143aa2-f01a-4a68-8305-8af14b5a144c admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:15.273980 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5143aa2-f01a-4a68-8305-8af14b5a144c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:25:15.275899 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5143aa2-f01a-4a68-8305-8af14b5a144c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:25:15.295116 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 671/1330] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Nov 23 19:25:15 2021] GET /identity/v3/projects => generated 2553 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:25:17.637307 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5d182-22a7-40dd-afb7-a8e540b15bb7 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:17.638298 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5d182-22a7-40dd-afb7-a8e540b15bb7 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:17.638695 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5d182-22a7-40dd-afb7-a8e540b15bb7 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:17.640832 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 660/1331] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:25:17 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:25:17.646790 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af79568-01bf-4396-9ccd-8d702b42fe4f None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:17.647231 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af79568-01bf-4396-9ccd-8d702b42fe4f None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:17.647499 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af79568-01bf-4396-9ccd-8d702b42fe4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:17.719587 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-6af79568-01bf-4396-9ccd-8d702b42fe4f None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:25:17.720808 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-6af79568-01bf-4396-9ccd-8d702b42fe4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:17.820719 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 672/1332] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:25:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:25:17.872530 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2fe0d-4cc8-47a4-8b9f-6a84aa061e8b None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:17.872962 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2fe0d-4cc8-47a4-8b9f-6a84aa061e8b None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:17.873349 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2fe0d-4cc8-47a4-8b9f-6a84aa061e8b None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:17.875288 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 661/1333] 10.222.0.62 () {54 vars in 964 bytes} [Tue Nov 23 19:25:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:25:17.881641 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a982e93-0583-4000-922a-2dab0969d6a2 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:17.882049 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a982e93-0583-4000-922a-2dab0969d6a2 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:17.882427 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a982e93-0583-4000-922a-2dab0969d6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:17.956414 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-1a982e93-0583-4000-922a-2dab0969d6a2 None None] MFA Rules not processed for user `f1ef2ac0a788451eb50fa80f559f808f`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:25:17.957653 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-1a982e93-0583-4000-922a-2dab0969d6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:18.034560 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 673/1334] 10.222.0.62 () {58 vars in 1061 bytes} [Tue Nov 23 19:25:17 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:25:18.043934 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2fe0d-4cc8-47a4-8b9f-6a84aa061e8b None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:25:18.045575 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-9ee2fe0d-4cc8-47a4-8b9f-6a84aa061e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:18.151183 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2fe0d-4cc8-47a4-8b9f-6a84aa061e8b None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:25:18.225293 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34614c-fe1c-400b-96a0-57faee86656d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:25:18.226245 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34614c-fe1c-400b-96a0-57faee86656d service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:18.226620 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34614c-fe1c-400b-96a0-57faee86656d service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:18.227004 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34614c-fe1c-400b-96a0-57faee86656d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:18.228725 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-4f34614c-fe1c-400b-96a0-57faee86656d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:18.342745 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34614c-fe1c-400b-96a0-57faee86656d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:25:18.344255 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34614c-fe1c-400b-96a0-57faee86656d service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:25:18.364970 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 662/1335] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:25:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:25:20.984035 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae8273-650d-4387-9154-1359acf89b8e None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:20.984595 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae8273-650d-4387-9154-1359acf89b8e None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:20.984595 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae8273-650d-4387-9154-1359acf89b8e None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:20.986435 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 674/1336] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:25:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:25:20.993060 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6160cd4-32a0-4b2a-9753-cc7729bbac86 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:20.993507 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6160cd4-32a0-4b2a-9753-cc7729bbac86 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:20.993717 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6160cd4-32a0-4b2a-9753-cc7729bbac86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:21.057625 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-d6160cd4-32a0-4b2a-9753-cc7729bbac86 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:25:21.058734 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-d6160cd4-32a0-4b2a-9753-cc7729bbac86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:21.152095 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 663/1337] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:25:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:25:21.193775 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae8273-650d-4387-9154-1359acf89b8e None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:25:21.195311 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-60ae8273-650d-4387-9154-1359acf89b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:21.294359 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae8273-650d-4387-9154-1359acf89b8e None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:25:21.364426 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c116e9-2e27-4368-95e4-fd9c25d9e40a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:25:21.364991 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c116e9-2e27-4368-95e4-fd9c25d9e40a service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:21.366300 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c116e9-2e27-4368-95e4-fd9c25d9e40a service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:21.366579 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c116e9-2e27-4368-95e4-fd9c25d9e40a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:21.368216 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-31c116e9-2e27-4368-95e4-fd9c25d9e40a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:21.472396 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c116e9-2e27-4368-95e4-fd9c25d9e40a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:25:21.473888 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c116e9-2e27-4368-95e4-fd9c25d9e40a service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:25:21.491937 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 675/1338] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:25:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:25:24.270902 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31982f-a82e-40ef-bf4f-48f642623b22 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:24.271685 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31982f-a82e-40ef-bf4f-48f642623b22 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:24.271685 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31982f-a82e-40ef-bf4f-48f642623b22 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:24.273274 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 664/1339] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:25:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:25:24.279175 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee7ea1-768e-427d-bf43-a40f70ae64a5 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:24.279609 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee7ea1-768e-427d-bf43-a40f70ae64a5 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:24.279756 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee7ea1-768e-427d-bf43-a40f70ae64a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:24.343286 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-5eee7ea1-768e-427d-bf43-a40f70ae64a5 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:25:24.344462 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-5eee7ea1-768e-427d-bf43-a40f70ae64a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:24.433595 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 676/1340] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:25:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:25:24.471054 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31982f-a82e-40ef-bf4f-48f642623b22 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:25:24.472574 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-7d31982f-a82e-40ef-bf4f-48f642623b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:24.595874 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31982f-a82e-40ef-bf4f-48f642623b22 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:25:24.685708 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96619d69-48b3-43c2-a7a0-322befd50b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:25:24.686556 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96619d69-48b3-43c2-a7a0-322befd50b62 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:24.686840 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96619d69-48b3-43c2-a7a0-322befd50b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:24.687115 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96619d69-48b3-43c2-a7a0-322befd50b62 admin admin] PATH_INFO: `/v3/projects/febc4f33fba1433992fc8e043a47dd5c` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:24.697522 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96619d69-48b3-43c2-a7a0-322befd50b62 admin admin] RBAC: Authorizing `identity:get_project(project_id=febc4f33fba1433992fc8e043a47dd5c)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:25:24.699568 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96619d69-48b3-43c2-a7a0-322befd50b62 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:25:24.701256 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 665/1341] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:25:24 2021] GET /identity/v3/projects/febc4f33fba1433992fc8e043a47dd5c => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:25:24.730033 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d17ebe-b42d-490d-8ba2-8e722ef1ee9e None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:24.730320 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d17ebe-b42d-490d-8ba2-8e722ef1ee9e None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:24.730593 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d17ebe-b42d-490d-8ba2-8e722ef1ee9e None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:24.732412 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 677/1342] 10.222.0.62 () {54 vars in 964 bytes} [Tue Nov 23 19:25:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:25:24.738597 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9dea7-7ceb-4f23-8950-ed0b917d644d None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:24.738893 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9dea7-7ceb-4f23-8950-ed0b917d644d None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:24.739178 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9dea7-7ceb-4f23-8950-ed0b917d644d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:24.819159 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-eba9dea7-7ceb-4f23-8950-ed0b917d644d None None] MFA Rules not processed for user `f1ef2ac0a788451eb50fa80f559f808f`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:25:24.820363 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-eba9dea7-7ceb-4f23-8950-ed0b917d644d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:24.893917 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 666/1343] 10.222.0.62 () {58 vars in 1061 bytes} [Tue Nov 23 19:25:24 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:25:24.903746 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d17ebe-b42d-490d-8ba2-8e722ef1ee9e None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:25:24.906354 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-e6d17ebe-b42d-490d-8ba2-8e722ef1ee9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:25.010365 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d17ebe-b42d-490d-8ba2-8e722ef1ee9e None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:25:25.081274 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfa8be-856e-4e46-a749-c4f018941b67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:25:25.081944 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfa8be-856e-4e46-a749-c4f018941b67 service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:25.082261 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfa8be-856e-4e46-a749-c4f018941b67 service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:25.082533 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfa8be-856e-4e46-a749-c4f018941b67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:25.084632 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-1ecfa8be-856e-4e46-a749-c4f018941b67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:25.189540 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecfa8be-856e-4e46-a749-c4f018941b67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:25:25.191152 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecfa8be-856e-4e46-a749-c4f018941b67 service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:25:25.208690 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 678/1344] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:25:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:25:28.629397 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fce524-2cf0-4574-b5fa-9488777c7f51 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:28.629992 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fce524-2cf0-4574-b5fa-9488777c7f51 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:28.629992 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fce524-2cf0-4574-b5fa-9488777c7f51 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:28.632431 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 667/1345] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:25:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:25:28.638221 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3e762-7c0e-4836-8af6-a6510b6c33a2 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:28.638636 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3e762-7c0e-4836-8af6-a6510b6c33a2 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:28.638776 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3e762-7c0e-4836-8af6-a6510b6c33a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:28.703390 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-83c3e762-7c0e-4836-8af6-a6510b6c33a2 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:25:28.704609 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-83c3e762-7c0e-4836-8af6-a6510b6c33a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:28.799302 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 679/1346] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:25:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:25:28.835030 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fce524-2cf0-4574-b5fa-9488777c7f51 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:25:28.836572 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-84fce524-2cf0-4574-b5fa-9488777c7f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:28.953282 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fce524-2cf0-4574-b5fa-9488777c7f51 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:25:29.041784 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba681fbb-8968-4b67-b92c-e63e1e398593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:25:29.042638 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba681fbb-8968-4b67-b92c-e63e1e398593 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:29.042922 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba681fbb-8968-4b67-b92c-e63e1e398593 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:29.043193 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba681fbb-8968-4b67-b92c-e63e1e398593 admin admin] PATH_INFO: `/v3/projects/febc4f33fba1433992fc8e043a47dd5c` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:29.052701 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba681fbb-8968-4b67-b92c-e63e1e398593 admin admin] RBAC: Authorizing `identity:get_project(project_id=febc4f33fba1433992fc8e043a47dd5c)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:25:29.055114 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba681fbb-8968-4b67-b92c-e63e1e398593 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:25:29.056796 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 668/1347] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:25:28 2021] GET /identity/v3/projects/febc4f33fba1433992fc8e043a47dd5c => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:25:29.069799 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3e762-7c0e-4836-8af6-a6510b6c33a2 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:25:29.071014 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-83c3e762-7c0e-4836-8af6-a6510b6c33a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:29.158886 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3e762-7c0e-4836-8af6-a6510b6c33a2 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:25:29.230328 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5e377-51a8-454e-bfed-1b013c809657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:25:29.230889 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5e377-51a8-454e-bfed-1b013c809657 service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:29.231170 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5e377-51a8-454e-bfed-1b013c809657 service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:29.231441 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5e377-51a8-454e-bfed-1b013c809657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:29.233065 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-6cd5e377-51a8-454e-bfed-1b013c809657 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:29.337390 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5e377-51a8-454e-bfed-1b013c809657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:25:29.338822 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5e377-51a8-454e-bfed-1b013c809657 service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:25:29.356300 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 680/1348] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:25:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:25:32.513246 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fd187-09bd-48b4-a934-697081ab43d3 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:32.513870 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fd187-09bd-48b4-a934-697081ab43d3 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:32.513870 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fd187-09bd-48b4-a934-697081ab43d3 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:32.517453 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 669/1349] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:25:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:25:32.522565 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10816606-f5f2-4c2c-b803-260be414ab94 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:32.523089 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10816606-f5f2-4c2c-b803-260be414ab94 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:32.523185 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10816606-f5f2-4c2c-b803-260be414ab94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:32.592845 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-10816606-f5f2-4c2c-b803-260be414ab94 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:25:32.594087 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-10816606-f5f2-4c2c-b803-260be414ab94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:32.694370 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 681/1350] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:25:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:25:32.734190 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28fd187-09bd-48b4-a934-697081ab43d3 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:25:32.735747 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-d28fd187-09bd-48b4-a934-697081ab43d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:32.840331 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28fd187-09bd-48b4-a934-697081ab43d3 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:25:32.911397 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf6a66-df39-4fc8-be3e-facb29f2caed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:25:32.912040 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf6a66-df39-4fc8-be3e-facb29f2caed service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:32.912324 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf6a66-df39-4fc8-be3e-facb29f2caed service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:32.912603 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf6a66-df39-4fc8-be3e-facb29f2caed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:32.914281 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-eadf6a66-df39-4fc8-be3e-facb29f2caed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:33.019918 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf6a66-df39-4fc8-be3e-facb29f2caed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:25:33.021366 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf6a66-df39-4fc8-be3e-facb29f2caed service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:25:33.039053 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 670/1351] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:25:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:25:35.369456 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a1fab-4066-49d5-b358-05b1afbc7bfd None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:35.370012 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a1fab-4066-49d5-b358-05b1afbc7bfd None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:35.370012 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a1fab-4066-49d5-b358-05b1afbc7bfd None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:35.371752 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 682/1352] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:25:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:25:35.377607 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41de663-12ad-44f9-bb06-aa7cb58311d4 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:35.378032 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41de663-12ad-44f9-bb06-aa7cb58311d4 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:35.378163 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41de663-12ad-44f9-bb06-aa7cb58311d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:35.445043 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-b41de663-12ad-44f9-bb06-aa7cb58311d4 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:25:35.446294 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-b41de663-12ad-44f9-bb06-aa7cb58311d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:35.539206 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 671/1353] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:25:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:25:35.578242 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a1fab-4066-49d5-b358-05b1afbc7bfd None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:25:35.579831 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-616a1fab-4066-49d5-b358-05b1afbc7bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:35.681664 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a1fab-4066-49d5-b358-05b1afbc7bfd None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:25:35.752375 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a452f19-560a-4bc0-89f1-24b9c24f91ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:25:35.753019 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a452f19-560a-4bc0-89f1-24b9c24f91ac service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:35.753303 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a452f19-560a-4bc0-89f1-24b9c24f91ac service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:35.753608 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a452f19-560a-4bc0-89f1-24b9c24f91ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:35.755246 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-4a452f19-560a-4bc0-89f1-24b9c24f91ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:35.864871 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a452f19-560a-4bc0-89f1-24b9c24f91ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:25:35.866391 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a452f19-560a-4bc0-89f1-24b9c24f91ac service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:25:35.885041 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 683/1354] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:25:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:25:38.230837 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6c9ae-fbd8-4c8b-ac61-e2a24c0a5a8c None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:38.231326 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6c9ae-fbd8-4c8b-ac61-e2a24c0a5a8c None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:38.231431 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6c9ae-fbd8-4c8b-ac61-e2a24c0a5a8c None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:38.233158 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 672/1355] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:25:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:25:38.239048 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b4f15-aeb8-49b2-b7d5-a3069e420c2c None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:38.239464 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b4f15-aeb8-49b2-b7d5-a3069e420c2c None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:38.239750 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b4f15-aeb8-49b2-b7d5-a3069e420c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:38.307896 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-9b7b4f15-aeb8-49b2-b7d5-a3069e420c2c None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:25:38.309130 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-9b7b4f15-aeb8-49b2-b7d5-a3069e420c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:38.404466 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 684/1356] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:25:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:25:38.437199 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6c9ae-fbd8-4c8b-ac61-e2a24c0a5a8c None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:25:38.438771 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-ccc6c9ae-fbd8-4c8b-ac61-e2a24c0a5a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:38.559456 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6c9ae-fbd8-4c8b-ac61-e2a24c0a5a8c None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:25:38.650179 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db0dbf-2a04-4c62-b781-526466f044d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:25:38.651028 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db0dbf-2a04-4c62-b781-526466f044d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:38.651311 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db0dbf-2a04-4c62-b781-526466f044d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:38.651585 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db0dbf-2a04-4c62-b781-526466f044d1 admin admin] PATH_INFO: `/v3/projects/febc4f33fba1433992fc8e043a47dd5c` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:38.661187 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db0dbf-2a04-4c62-b781-526466f044d1 admin admin] RBAC: Authorizing `identity:get_project(project_id=febc4f33fba1433992fc8e043a47dd5c)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:25:38.663318 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db0dbf-2a04-4c62-b781-526466f044d1 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:25:38.665024 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 673/1357] 10.222.0.62 () {56 vars in 1207 bytes} [Tue Nov 23 19:25:38 2021] GET /identity/v3/projects/febc4f33fba1433992fc8e043a47dd5c => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:25:38.677093 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b4f15-aeb8-49b2-b7d5-a3069e420c2c None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:25:38.678610 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-9b7b4f15-aeb8-49b2-b7d5-a3069e420c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:38.768368 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b4f15-aeb8-49b2-b7d5-a3069e420c2c None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:25:38.848100 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b2c27-2c8a-4a8d-b87a-056ac9ba23c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:25:38.848100 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b2c27-2c8a-4a8d-b87a-056ac9ba23c6 service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:38.848100 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b2c27-2c8a-4a8d-b87a-056ac9ba23c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:38.848100 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b2c27-2c8a-4a8d-b87a-056ac9ba23c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:38.848528 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-9c0b2c27-2c8a-4a8d-b87a-056ac9ba23c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:38.953045 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b2c27-2c8a-4a8d-b87a-056ac9ba23c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:25:38.954514 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b2c27-2c8a-4a8d-b87a-056ac9ba23c6 service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:25:38.972369 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 685/1358] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:25:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:25:41.681057 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f991431-edf7-43cc-8324-9e63aef83ddd None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:41.681586 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f991431-edf7-43cc-8324-9e63aef83ddd None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:41.681693 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f991431-edf7-43cc-8324-9e63aef83ddd None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:41.683502 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 674/1359] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:25:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:25:41.689266 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a5f78-6ed1-47d7-a0e9-10af5cd69211 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:41.689736 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a5f78-6ed1-47d7-a0e9-10af5cd69211 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:41.689861 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a5f78-6ed1-47d7-a0e9-10af5cd69211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:41.752923 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-c00a5f78-6ed1-47d7-a0e9-10af5cd69211 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:25:41.754137 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-c00a5f78-6ed1-47d7-a0e9-10af5cd69211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:41.846574 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 686/1360] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:25:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:25:41.884484 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f991431-edf7-43cc-8324-9e63aef83ddd None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:25:41.886055 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-3f991431-edf7-43cc-8324-9e63aef83ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:41.984577 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f991431-edf7-43cc-8324-9e63aef83ddd None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:25:42.053275 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c433c57-91e8-44b8-ba60-b209f192799e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:25:42.053938 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c433c57-91e8-44b8-ba60-b209f192799e service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:42.054222 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c433c57-91e8-44b8-ba60-b209f192799e service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:42.054497 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c433c57-91e8-44b8-ba60-b209f192799e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:42.056100 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-8c433c57-91e8-44b8-ba60-b209f192799e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:42.160070 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c433c57-91e8-44b8-ba60-b209f192799e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:25:42.161503 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c433c57-91e8-44b8-ba60-b209f192799e service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:25:42.178644 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 675/1361] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:25:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:25:44.474251 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7901914-b898-4b00-9301-19cdcf9f2f23 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:44.475000 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7901914-b898-4b00-9301-19cdcf9f2f23 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:44.475289 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7901914-b898-4b00-9301-19cdcf9f2f23 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:44.477130 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 687/1362] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:25:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:25:44.482737 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558545b-0d6d-4e9a-9240-ab6b9e91c7ab None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:44.483168 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558545b-0d6d-4e9a-9240-ab6b9e91c7ab None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:44.483287 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558545b-0d6d-4e9a-9240-ab6b9e91c7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:44.545839 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-1558545b-0d6d-4e9a-9240-ab6b9e91c7ab None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:25:44.547048 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-1558545b-0d6d-4e9a-9240-ab6b9e91c7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:44.640345 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 676/1363] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:25:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:25:44.681954 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7901914-b898-4b00-9301-19cdcf9f2f23 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:25:44.683482 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-d7901914-b898-4b00-9301-19cdcf9f2f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:44.788448 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7901914-b898-4b00-9301-19cdcf9f2f23 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:25:44.859981 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de3560-7f20-4825-a29b-c17f5ac704d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:25:44.860628 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de3560-7f20-4825-a29b-c17f5ac704d6 service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:44.860940 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de3560-7f20-4825-a29b-c17f5ac704d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:44.861217 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de3560-7f20-4825-a29b-c17f5ac704d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:44.862904 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-87de3560-7f20-4825-a29b-c17f5ac704d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:44.968868 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de3560-7f20-4825-a29b-c17f5ac704d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:25:44.970337 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de3560-7f20-4825-a29b-c17f5ac704d6 service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:25:44.987566 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 688/1364] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:25:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:25:47.966326 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6a3b4-5863-4a64-98bd-499210aeca7f None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:47.966885 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6a3b4-5863-4a64-98bd-499210aeca7f None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:47.966885 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6a3b4-5863-4a64-98bd-499210aeca7f None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:47.968723 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 677/1365] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:25:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:25:47.975100 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f27fa1-05b5-47be-a1fd-92acd821de49 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:47.975545 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f27fa1-05b5-47be-a1fd-92acd821de49 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:47.975636 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f27fa1-05b5-47be-a1fd-92acd821de49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:48.042358 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-c0f27fa1-05b5-47be-a1fd-92acd821de49 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:25:48.043699 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-c0f27fa1-05b5-47be-a1fd-92acd821de49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:48.144012 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 689/1366] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:25:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:25:48.181571 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6a3b4-5863-4a64-98bd-499210aeca7f None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:25:48.183665 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-72f6a3b4-5863-4a64-98bd-499210aeca7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:48.275385 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6a3b4-5863-4a64-98bd-499210aeca7f None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:25:48.278932 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadfcf93-5f67-4e4a-abbb-58fdaa1f8eef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:25:48.279562 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfcf93-5f67-4e4a-abbb-58fdaa1f8eef service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:48.279844 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfcf93-5f67-4e4a-abbb-58fdaa1f8eef service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:48.280119 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfcf93-5f67-4e4a-abbb-58fdaa1f8eef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:48.288940 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadfcf93-5f67-4e4a-abbb-58fdaa1f8eef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:25:48.290381 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadfcf93-5f67-4e4a-abbb-58fdaa1f8eef service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:25:48.299633 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 678/1367] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:25:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:25:52.876403 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb05051-ea7f-40fa-8b70-c3456387799a None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:52.876915 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb05051-ea7f-40fa-8b70-c3456387799a None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:52.876915 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb05051-ea7f-40fa-8b70-c3456387799a None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:52.878723 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 690/1368] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:25:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:25:52.884587 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd530a-2598-41a4-b55a-be433019189e None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:52.885005 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd530a-2598-41a4-b55a-be433019189e None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:52.885140 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd530a-2598-41a4-b55a-be433019189e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:52.903014 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-a2cd530a-2598-41a4-b55a-be433019189e None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:25:52.904197 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-a2cd530a-2598-41a4-b55a-be433019189e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:52.912434 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 679/1369] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:25:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:25:52.953284 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb05051-ea7f-40fa-8b70-c3456387799a None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:25:52.964363 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb05051-ea7f-40fa-8b70-c3456387799a None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:25:52.967855 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977bcc8-bf37-465f-a4e8-53397a6111d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:25:52.968487 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977bcc8-bf37-465f-a4e8-53397a6111d6 service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:52.968768 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977bcc8-bf37-465f-a4e8-53397a6111d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:52.969042 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977bcc8-bf37-465f-a4e8-53397a6111d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:52.978605 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977bcc8-bf37-465f-a4e8-53397a6111d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:25:52.980033 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977bcc8-bf37-465f-a4e8-53397a6111d6 service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:25:52.989722 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 691/1370] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:25:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:25:56.220232 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faae7b-ef54-44a7-b93a-c6a662344532 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:56.220814 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faae7b-ef54-44a7-b93a-c6a662344532 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:56.220814 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faae7b-ef54-44a7-b93a-c6a662344532 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:56.223047 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 680/1371] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:25:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:25:56.229152 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57627fa-f074-4dc0-acf6-322efcbfeb71 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:56.229675 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57627fa-f074-4dc0-acf6-322efcbfeb71 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:56.229754 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57627fa-f074-4dc0-acf6-322efcbfeb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:56.249109 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-f57627fa-f074-4dc0-acf6-322efcbfeb71 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:25:56.250381 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-f57627fa-f074-4dc0-acf6-322efcbfeb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:25:56.259606 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 692/1372] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:25:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:25:56.299198 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9faae7b-ef54-44a7-b93a-c6a662344532 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:25:56.312001 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9faae7b-ef54-44a7-b93a-c6a662344532 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:25:56.316269 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f00d6-9a36-4ecf-8f06-eb2ffa42c67a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:25:56.316908 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f00d6-9a36-4ecf-8f06-eb2ffa42c67a service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:25:56.317192 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f00d6-9a36-4ecf-8f06-eb2ffa42c67a service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:25:56.317506 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f00d6-9a36-4ecf-8f06-eb2ffa42c67a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:25:56.327907 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f00d6-9a36-4ecf-8f06-eb2ffa42c67a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:25:56.329717 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f00d6-9a36-4ecf-8f06-eb2ffa42c67a service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:25:56.339744 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 681/1373] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:25:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:26:00.967387 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b36bf7-63dc-4887-8d2f-7c5ae7fd3aa1 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:00.967913 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b36bf7-63dc-4887-8d2f-7c5ae7fd3aa1 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:00.967913 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b36bf7-63dc-4887-8d2f-7c5ae7fd3aa1 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:00.969817 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 693/1374] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:26:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:26:00.976399 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd1fc7-7f79-4016-ae97-9a7cac5a69a1 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:00.981154 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd1fc7-7f79-4016-ae97-9a7cac5a69a1 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:00.981154 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd1fc7-7f79-4016-ae97-9a7cac5a69a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:00.996249 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-f6bd1fc7-7f79-4016-ae97-9a7cac5a69a1 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:26:00.997489 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-f6bd1fc7-7f79-4016-ae97-9a7cac5a69a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:26:01.005372 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 682/1375] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:26:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:26:01.044181 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b36bf7-63dc-4887-8d2f-7c5ae7fd3aa1 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:26:01.045934 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-91b36bf7-63dc-4887-8d2f-7c5ae7fd3aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:26:01.059323 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b36bf7-63dc-4887-8d2f-7c5ae7fd3aa1 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:26:01.062792 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b31461-82fa-4ddb-a39c-82139399c703 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:26:01.063457 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b31461-82fa-4ddb-a39c-82139399c703 service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:01.063735 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b31461-82fa-4ddb-a39c-82139399c703 service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:01.064004 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b31461-82fa-4ddb-a39c-82139399c703 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:01.073136 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b31461-82fa-4ddb-a39c-82139399c703 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:26:01.074611 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b31461-82fa-4ddb-a39c-82139399c703 service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:26:01.084238 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 694/1376] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:26:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:26:06.044465 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bba446-5354-48b2-be0d-c9aa9f216e17 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:06.045543 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bba446-5354-48b2-be0d-c9aa9f216e17 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:06.046059 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bba446-5354-48b2-be0d-c9aa9f216e17 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:06.048337 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 683/1377] 10.222.0.62 () {54 vars in 921 bytes} [Tue Nov 23 19:26:06 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:26:06.054157 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba8676-0912-464c-9364-5720002c59e4 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:06.055046 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba8676-0912-464c-9364-5720002c59e4 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:06.055544 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba8676-0912-464c-9364-5720002c59e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:06.134866 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-4dba8676-0912-464c-9364-5720002c59e4 None None] MFA Rules not processed for user `d100a378f1ff441080555bfc2ff4d6ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:26:06.136055 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-4dba8676-0912-464c-9364-5720002c59e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:26:06.269522 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 695/1378] 10.222.0.62 () {58 vars in 1018 bytes} [Tue Nov 23 19:26:06 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:26:10.323415 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13caae8d-75b9-48b4-8286-c83326926acf None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:10.324271 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13caae8d-75b9-48b4-8286-c83326926acf None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:10.324549 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13caae8d-75b9-48b4-8286-c83326926acf None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:10.326359 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 684/1379] 10.222.0.62 () {54 vars in 921 bytes} [Tue Nov 23 19:26:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:26:10.331680 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb373a3-1012-4a57-81b5-56ade03e2428 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:10.332089 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb373a3-1012-4a57-81b5-56ade03e2428 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:10.332242 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb373a3-1012-4a57-81b5-56ade03e2428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:10.352953 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-ebb373a3-1012-4a57-81b5-56ade03e2428 None None] MFA Rules not processed for user `d100a378f1ff441080555bfc2ff4d6ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:26:10.354174 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-ebb373a3-1012-4a57-81b5-56ade03e2428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:26:10.363999 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 696/1380] 10.222.0.62 () {58 vars in 1018 bytes} [Tue Nov 23 19:26:10 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:26:11.811161 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4fbd56-95e4-4daa-ba5a-7e6bdacef525 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:11.811637 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4fbd56-95e4-4daa-ba5a-7e6bdacef525 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:11.811718 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4fbd56-95e4-4daa-ba5a-7e6bdacef525 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:11.813483 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 685/1381] 10.222.0.62 () {54 vars in 921 bytes} [Tue Nov 23 19:26:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:26:11.819200 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0140e-999f-42b2-8a8b-2ce22d5436f2 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:11.819671 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0140e-999f-42b2-8a8b-2ce22d5436f2 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:11.819949 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0140e-999f-42b2-8a8b-2ce22d5436f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:11.838948 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-c0c0140e-999f-42b2-8a8b-2ce22d5436f2 None None] MFA Rules not processed for user `d100a378f1ff441080555bfc2ff4d6ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:26:11.840129 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-c0c0140e-999f-42b2-8a8b-2ce22d5436f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:26:11.848862 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 697/1382] 10.222.0.62 () {58 vars in 1018 bytes} [Tue Nov 23 19:26:11 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:26:15.609144 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65fe25-6a34-40a6-b027-c19dd2878edb None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:15.609760 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65fe25-6a34-40a6-b027-c19dd2878edb None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:15.609760 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65fe25-6a34-40a6-b027-c19dd2878edb None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:15.611657 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 686/1383] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:26:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 19:26:15.617679 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b7464-518c-4ec6-b6d4-52a67646a421 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:15.618083 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b7464-518c-4ec6-b6d4-52a67646a421 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:15.618233 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b7464-518c-4ec6-b6d4-52a67646a421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:15.636438 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-a91b7464-518c-4ec6-b6d4-52a67646a421 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:26:15.637912 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-a91b7464-518c-4ec6-b6d4-52a67646a421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:26:15.645968 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 698/1384] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:26:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:26:15.696936 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d02cd-525a-4f2f-8bec-7f9a626c1cec None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:15.697582 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d02cd-525a-4f2f-8bec-7f9a626c1cec None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:15.698027 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d02cd-525a-4f2f-8bec-7f9a626c1cec None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:15.700229 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 687/1385] 10.222.0.62 () {54 vars in 961 bytes} [Tue Nov 23 19:26:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:26:15.709551 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab86417-2c9a-4c11-bea5-d8a9d01f01d4 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:15.709839 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab86417-2c9a-4c11-bea5-d8a9d01f01d4 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:15.710383 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab86417-2c9a-4c11-bea5-d8a9d01f01d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:15.760913 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-dab86417-2c9a-4c11-bea5-d8a9d01f01d4 None None] MFA Rules not processed for user `6d91fe7f996b48b0bc28e1eadc4f8869`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:26:15.762296 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-dab86417-2c9a-4c11-bea5-d8a9d01f01d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:26:15.851883 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 699/1386] 10.222.0.62 () {58 vars in 1058 bytes} [Tue Nov 23 19:26:15 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:26:15.859953 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d02cd-525a-4f2f-8bec-7f9a626c1cec None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:26:15.874833 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d02cd-525a-4f2f-8bec-7f9a626c1cec None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:26:15.881660 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7fe47-a372-4418-9ed4-a954187e22a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:26:15.882278 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7fe47-a372-4418-9ed4-a954187e22a3 service nova] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:15.882561 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7fe47-a372-4418-9ed4-a954187e22a3 service nova] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:15.882838 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7fe47-a372-4418-9ed4-a954187e22a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:15.891921 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a7fe47-a372-4418-9ed4-a954187e22a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:26:15.893916 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a7fe47-a372-4418-9ed4-a954187e22a3 service nova] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:26:15.905161 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 688/1387] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:26:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:26:18.545849 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8b2df-104d-4ece-948e-4d560cf966e6 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:18.546366 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8b2df-104d-4ece-948e-4d560cf966e6 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:18.546366 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8b2df-104d-4ece-948e-4d560cf966e6 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:18.548079 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 700/1388] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:26:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:26:18.554356 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ec2bd-78cc-4701-a44d-f2b2ae8b96d8 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:18.554744 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ec2bd-78cc-4701-a44d-f2b2ae8b96d8 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:18.554917 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ec2bd-78cc-4701-a44d-f2b2ae8b96d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:18.573275 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-282ec2bd-78cc-4701-a44d-f2b2ae8b96d8 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:26:18.575234 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-282ec2bd-78cc-4701-a44d-f2b2ae8b96d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:26:18.586107 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 689/1389] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:26:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:26:18.631692 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8b2df-104d-4ece-948e-4d560cf966e6 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:26:18.646762 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8b2df-104d-4ece-948e-4d560cf966e6 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:26:18.652207 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835ea22-b5f7-428f-8bbe-8971b5a55967 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:26:18.653028 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835ea22-b5f7-428f-8bbe-8971b5a55967 service nova] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:18.653432 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835ea22-b5f7-428f-8bbe-8971b5a55967 service nova] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:18.653782 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835ea22-b5f7-428f-8bbe-8971b5a55967 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:18.662801 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835ea22-b5f7-428f-8bbe-8971b5a55967 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:26:18.664510 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835ea22-b5f7-428f-8bbe-8971b5a55967 service nova] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:26:18.674282 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 701/1390] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:26:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:26:21.512560 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73287053-a2a2-4e8b-933f-65120ed97ddd None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:21.513116 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73287053-a2a2-4e8b-933f-65120ed97ddd None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:21.513116 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73287053-a2a2-4e8b-933f-65120ed97ddd None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:21.514930 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 690/1391] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:26:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:26:21.520805 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9fbfa-dba8-4770-a76b-bd19064a54c4 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:21.521279 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9fbfa-dba8-4770-a76b-bd19064a54c4 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:21.521363 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9fbfa-dba8-4770-a76b-bd19064a54c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:21.541499 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-9ed9fbfa-dba8-4770-a76b-bd19064a54c4 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:26:21.542700 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-9ed9fbfa-dba8-4770-a76b-bd19064a54c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:26:21.550429 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 702/1392] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:26:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:26:21.599002 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c3ea4-579d-4382-b1c4-f8a06778af8d None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:21.599279 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c3ea4-579d-4382-b1c4-f8a06778af8d None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:21.599925 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c3ea4-579d-4382-b1c4-f8a06778af8d None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:21.601703 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 691/1393] 10.222.0.62 () {54 vars in 961 bytes} [Tue Nov 23 19:26:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:26:21.607843 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9a0aa-3aec-4818-9f40-d3038d5429bf None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:21.608238 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9a0aa-3aec-4818-9f40-d3038d5429bf None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:21.608582 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9a0aa-3aec-4818-9f40-d3038d5429bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:21.627975 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-2fc9a0aa-3aec-4818-9f40-d3038d5429bf None None] MFA Rules not processed for user `6d91fe7f996b48b0bc28e1eadc4f8869`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:26:21.629247 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-2fc9a0aa-3aec-4818-9f40-d3038d5429bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:26:21.639782 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 703/1394] 10.222.0.62 () {58 vars in 1058 bytes} [Tue Nov 23 19:26:21 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:26:21.648490 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c3ea4-579d-4382-b1c4-f8a06778af8d None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:26:21.662918 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c3ea4-579d-4382-b1c4-f8a06778af8d None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:26:21.668269 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14e069-ac2a-40e6-9741-9578b7a581e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:26:21.668971 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14e069-ac2a-40e6-9741-9578b7a581e3 service nova] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:21.669503 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14e069-ac2a-40e6-9741-9578b7a581e3 service nova] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:21.670015 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14e069-ac2a-40e6-9741-9578b7a581e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:21.679599 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14e069-ac2a-40e6-9741-9578b7a581e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:26:21.681262 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14e069-ac2a-40e6-9741-9578b7a581e3 service nova] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:26:21.691299 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 692/1395] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:26:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:26:23.458032 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0c77b-62c0-4c5d-a585-52496f0219a7 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:23.458583 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0c77b-62c0-4c5d-a585-52496f0219a7 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:23.458583 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0c77b-62c0-4c5d-a585-52496f0219a7 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:23.460603 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 704/1396] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:26:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:26:23.466551 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fed6e-f164-4fcd-9622-a991afa4686b None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:23.467312 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fed6e-f164-4fcd-9622-a991afa4686b None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:23.467591 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fed6e-f164-4fcd-9622-a991afa4686b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:23.485957 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-816fed6e-f164-4fcd-9622-a991afa4686b None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:26:23.487129 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-816fed6e-f164-4fcd-9622-a991afa4686b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:26:23.496121 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 693/1397] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:26:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:26:23.551508 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e670b-ca3a-4cf5-8bc2-da42e0fded66 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:23.551789 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e670b-ca3a-4cf5-8bc2-da42e0fded66 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:23.552236 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e670b-ca3a-4cf5-8bc2-da42e0fded66 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:23.555430 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 705/1398] 10.222.0.62 () {54 vars in 963 bytes} [Tue Nov 23 19:26:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:26:23.561117 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a16834-cf22-43c8-9402-94636884b93c None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:23.561421 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a16834-cf22-43c8-9402-94636884b93c None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:23.561707 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a16834-cf22-43c8-9402-94636884b93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:23.610683 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-56a16834-cf22-43c8-9402-94636884b93c None None] MFA Rules not processed for user `9845615593004371a592e46701b5ece6`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:26:23.611867 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-56a16834-cf22-43c8-9402-94636884b93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:26:23.675623 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 694/1399] 10.222.0.62 () {58 vars in 1060 bytes} [Tue Nov 23 19:26:23 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:26:23.684780 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e670b-ca3a-4cf5-8bc2-da42e0fded66 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:26:23.695860 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e670b-ca3a-4cf5-8bc2-da42e0fded66 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:26:23.699374 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d8eac-cac5-43a3-b451-5e8d5c917cbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:26:23.700014 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d8eac-cac5-43a3-b451-5e8d5c917cbe service cinder] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:23.700289 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d8eac-cac5-43a3-b451-5e8d5c917cbe service cinder] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:23.700561 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d8eac-cac5-43a3-b451-5e8d5c917cbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:23.711043 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d8eac-cac5-43a3-b451-5e8d5c917cbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:26:23.712397 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d8eac-cac5-43a3-b451-5e8d5c917cbe service cinder] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:26:23.721977 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 706/1400] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:26:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:26:24.147638 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779747f6-5b3b-45bd-8287-bf2c4fdba527 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:24.147930 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779747f6-5b3b-45bd-8287-bf2c4fdba527 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:24.148239 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779747f6-5b3b-45bd-8287-bf2c4fdba527 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:24.150097 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 695/1401] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:26:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:26:24.156149 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e2b06-db23-46dd-b99e-c7c9ce63611d None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:24.156551 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e2b06-db23-46dd-b99e-c7c9ce63611d None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:24.156924 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e2b06-db23-46dd-b99e-c7c9ce63611d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:24.174434 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-7e9e2b06-db23-46dd-b99e-c7c9ce63611d None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:26:24.175752 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-7e9e2b06-db23-46dd-b99e-c7c9ce63611d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:26:24.184553 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 707/1402] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:26:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:26:24.232711 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779747f6-5b3b-45bd-8287-bf2c4fdba527 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:26:24.247012 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779747f6-5b3b-45bd-8287-bf2c4fdba527 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:26:24.252440 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac37ec-025d-4202-8c96-330b1986ff8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:26:24.253067 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac37ec-025d-4202-8c96-330b1986ff8b service nova] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:24.253345 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac37ec-025d-4202-8c96-330b1986ff8b service nova] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:24.253665 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac37ec-025d-4202-8c96-330b1986ff8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:24.262409 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac37ec-025d-4202-8c96-330b1986ff8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:26:24.263952 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac37ec-025d-4202-8c96-330b1986ff8b service nova] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:26:24.273921 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 696/1403] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:26:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:26:26.709750 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d294c-8f29-4a91-a00a-1a558fb2ade2 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:26.710598 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d294c-8f29-4a91-a00a-1a558fb2ade2 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:26.711041 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d294c-8f29-4a91-a00a-1a558fb2ade2 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:26.712851 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 708/1404] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:26:26 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:26:26.718713 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d26dc-f273-4283-bb32-366742af93f1 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:26.719563 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d26dc-f273-4283-bb32-366742af93f1 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:26.719843 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d26dc-f273-4283-bb32-366742af93f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:26.738723 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-495d26dc-f273-4283-bb32-366742af93f1 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:26:26.739916 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-495d26dc-f273-4283-bb32-366742af93f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:26:26.747649 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 697/1405] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:26:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:26:26.794818 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d294c-8f29-4a91-a00a-1a558fb2ade2 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:26:26.809597 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d294c-8f29-4a91-a00a-1a558fb2ade2 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:26:26.814941 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6183b00-64fe-46e1-acf7-d160c0b5a820 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:26:26.815839 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6183b00-64fe-46e1-acf7-d160c0b5a820 service nova] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:26.816117 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6183b00-64fe-46e1-acf7-d160c0b5a820 service nova] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:26.816390 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6183b00-64fe-46e1-acf7-d160c0b5a820 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:26.824766 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6183b00-64fe-46e1-acf7-d160c0b5a820 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:26:26.826410 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6183b00-64fe-46e1-acf7-d160c0b5a820 service nova] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:26:26.836673 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 709/1406] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:26:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:26:29.281954 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200889a-04bf-4c0a-aade-674ce816161e None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:29.282491 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200889a-04bf-4c0a-aade-674ce816161e None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:29.282491 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200889a-04bf-4c0a-aade-674ce816161e None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:29.284247 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 698/1407] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:26:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:26:29.289970 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea1423-a32d-4bfd-9510-a54cefa2c781 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:29.290386 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea1423-a32d-4bfd-9510-a54cefa2c781 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:29.290510 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea1423-a32d-4bfd-9510-a54cefa2c781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:29.308484 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-a7ea1423-a32d-4bfd-9510-a54cefa2c781 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:26:29.309675 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-a7ea1423-a32d-4bfd-9510-a54cefa2c781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:26:29.317928 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 710/1408] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:26:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:26:29.365960 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200889a-04bf-4c0a-aade-674ce816161e None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:26:29.381980 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200889a-04bf-4c0a-aade-674ce816161e None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:26:29.387039 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e149ae-a4b1-4b44-9844-3696347e2e35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:26:29.387363 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e149ae-a4b1-4b44-9844-3696347e2e35 service nova] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:29.387655 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e149ae-a4b1-4b44-9844-3696347e2e35 service nova] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:29.387952 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e149ae-a4b1-4b44-9844-3696347e2e35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:29.397507 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e149ae-a4b1-4b44-9844-3696347e2e35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:26:29.399067 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e149ae-a4b1-4b44-9844-3696347e2e35 service nova] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:26:29.409055 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 699/1409] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:26:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:26:31.891585 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262f010-cd47-464e-be2f-6859dc79c383 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:31.892289 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262f010-cd47-464e-be2f-6859dc79c383 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:31.892289 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262f010-cd47-464e-be2f-6859dc79c383 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:31.894072 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 711/1410] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:26:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:26:31.900979 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a34465-55dd-46c8-b939-7ee84284f648 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:31.901507 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a34465-55dd-46c8-b939-7ee84284f648 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:31.901637 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a34465-55dd-46c8-b939-7ee84284f648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:31.920113 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-88a34465-55dd-46c8-b939-7ee84284f648 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:26:31.921343 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-88a34465-55dd-46c8-b939-7ee84284f648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:26:31.929656 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 700/1411] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:26:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:26:31.977905 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262f010-cd47-464e-be2f-6859dc79c383 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:26:31.993531 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262f010-cd47-464e-be2f-6859dc79c383 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:26:31.999867 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ec2d4-a3c9-4ceb-8586-daf70c7eb03a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:26:32.000537 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ec2d4-a3c9-4ceb-8586-daf70c7eb03a service nova] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:32.000833 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ec2d4-a3c9-4ceb-8586-daf70c7eb03a service nova] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:32.001126 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ec2d4-a3c9-4ceb-8586-daf70c7eb03a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:32.010501 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ec2d4-a3c9-4ceb-8586-daf70c7eb03a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:26:32.012182 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ec2d4-a3c9-4ceb-8586-daf70c7eb03a service nova] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:26:32.022158 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 712/1412] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:26:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:26:34.359515 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ff844-55da-40c1-9948-e6ed17521750 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:34.360487 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ff844-55da-40c1-9948-e6ed17521750 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:34.360926 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ff844-55da-40c1-9948-e6ed17521750 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:34.362958 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 701/1413] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:26:34 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:26:34.370530 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6cc24b-a961-4df4-b33d-853649c0e44f None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:34.371149 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6cc24b-a961-4df4-b33d-853649c0e44f None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:34.371149 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6cc24b-a961-4df4-b33d-853649c0e44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:34.389384 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-7e6cc24b-a961-4df4-b33d-853649c0e44f None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:26:34.390639 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-7e6cc24b-a961-4df4-b33d-853649c0e44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:26:34.399502 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 713/1414] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:26:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:26:34.457951 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ff844-55da-40c1-9948-e6ed17521750 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:26:34.473159 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ff844-55da-40c1-9948-e6ed17521750 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:26:34.479459 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1e1de-efd5-4b1a-a290-ebf02f934ae6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:26:34.480085 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1e1de-efd5-4b1a-a290-ebf02f934ae6 service nova] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:34.480431 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1e1de-efd5-4b1a-a290-ebf02f934ae6 service nova] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:34.480665 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1e1de-efd5-4b1a-a290-ebf02f934ae6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:34.489254 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1e1de-efd5-4b1a-a290-ebf02f934ae6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:26:34.490946 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1e1de-efd5-4b1a-a290-ebf02f934ae6 service nova] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:26:34.501199 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 702/1415] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:26:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:26:36.961672 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776feb0-7931-4f37-ba09-c373d661ceed None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:36.962266 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776feb0-7931-4f37-ba09-c373d661ceed None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:36.962266 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776feb0-7931-4f37-ba09-c373d661ceed None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:36.964015 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 714/1416] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:26:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:26:36.969694 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4acfb-3337-489a-afc4-e5d94f745fdf None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:36.970114 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4acfb-3337-489a-afc4-e5d94f745fdf None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:36.970261 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4acfb-3337-489a-afc4-e5d94f745fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:36.988092 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-41d4acfb-3337-489a-afc4-e5d94f745fdf None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:26:36.989279 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-41d4acfb-3337-489a-afc4-e5d94f745fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:26:36.997766 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 703/1417] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:26:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:26:37.043817 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776feb0-7931-4f37-ba09-c373d661ceed None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:26:37.058691 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776feb0-7931-4f37-ba09-c373d661ceed None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:26:37.064053 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f7328-ddab-4249-adbf-48a366c4e838 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:26:37.064687 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f7328-ddab-4249-adbf-48a366c4e838 service nova] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:37.064972 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f7328-ddab-4249-adbf-48a366c4e838 service nova] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:37.065247 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f7328-ddab-4249-adbf-48a366c4e838 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:37.073732 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f7328-ddab-4249-adbf-48a366c4e838 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:26:37.075311 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f7328-ddab-4249-adbf-48a366c4e838 service nova] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:26:37.084777 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 715/1418] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:26:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:26:38.995584 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283249dd-5a54-4d58-8f3f-e185003cba5a None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:38.996147 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283249dd-5a54-4d58-8f3f-e185003cba5a None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:38.996246 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283249dd-5a54-4d58-8f3f-e185003cba5a None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:38.998167 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 704/1419] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:26:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:26:39.003659 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae208f25-5852-4ee0-bcca-f39ddc8be384 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:39.004077 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae208f25-5852-4ee0-bcca-f39ddc8be384 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:39.004214 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae208f25-5852-4ee0-bcca-f39ddc8be384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:39.022342 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-ae208f25-5852-4ee0-bcca-f39ddc8be384 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:26:39.023488 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-ae208f25-5852-4ee0-bcca-f39ddc8be384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:26:39.031233 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 716/1420] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:26:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:26:39.088289 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae5ada-373a-4340-9422-b16adb6360b5 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:39.088574 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae5ada-373a-4340-9422-b16adb6360b5 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:39.088847 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae5ada-373a-4340-9422-b16adb6360b5 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:39.090695 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 705/1421] 10.222.0.62 () {54 vars in 962 bytes} [Tue Nov 23 19:26:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:26:39.096175 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b692083-0ba1-40a3-9660-902429205c72 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:39.096538 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b692083-0ba1-40a3-9660-902429205c72 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:39.096899 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b692083-0ba1-40a3-9660-902429205c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:39.147189 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-5b692083-0ba1-40a3-9660-902429205c72 None None] MFA Rules not processed for user `544443ed44ef41bcaa86af52926bfd14`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:26:39.148405 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-5b692083-0ba1-40a3-9660-902429205c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:26:39.205131 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 717/1422] 10.222.0.62 () {58 vars in 1059 bytes} [Tue Nov 23 19:26:39 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:26:39.213954 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae5ada-373a-4340-9422-b16adb6360b5 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:26:39.224209 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae5ada-373a-4340-9422-b16adb6360b5 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:26:39.227684 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290e822-53ca-4508-8a53-3c017cdb8b5e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '544443ed44ef41bcaa86af52926bfd14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:26:39.228305 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290e822-53ca-4508-8a53-3c017cdb8b5e service glance] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:39.228586 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290e822-53ca-4508-8a53-3c017cdb8b5e service glance] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:39.228857 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290e822-53ca-4508-8a53-3c017cdb8b5e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:39.240893 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290e822-53ca-4508-8a53-3c017cdb8b5e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:26:39.242414 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290e822-53ca-4508-8a53-3c017cdb8b5e service glance] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:26:39.251654 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 706/1423] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:26:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:26:39.503078 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb6fbf-8d8a-4ad1-94ec-3232fd51ce48 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:39.503368 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb6fbf-8d8a-4ad1-94ec-3232fd51ce48 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:39.503650 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb6fbf-8d8a-4ad1-94ec-3232fd51ce48 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:39.505521 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 718/1424] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:26:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:26:39.513915 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ace6a-663f-411c-b1cd-eadabac66ddd None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:39.514655 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ace6a-663f-411c-b1cd-eadabac66ddd None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:39.515145 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ace6a-663f-411c-b1cd-eadabac66ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:39.534341 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-f20ace6a-663f-411c-b1cd-eadabac66ddd None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:26:39.535608 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-f20ace6a-663f-411c-b1cd-eadabac66ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:26:39.544138 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 707/1425] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:26:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:26:39.593328 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb6fbf-8d8a-4ad1-94ec-3232fd51ce48 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:26:39.608281 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb6fbf-8d8a-4ad1-94ec-3232fd51ce48 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:26:39.613784 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a693c9-459b-4c14-aaad-1a0a8d492a23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:26:39.614436 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a693c9-459b-4c14-aaad-1a0a8d492a23 service nova] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:39.614720 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a693c9-459b-4c14-aaad-1a0a8d492a23 service nova] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:39.615549 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a693c9-459b-4c14-aaad-1a0a8d492a23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:39.624081 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a693c9-459b-4c14-aaad-1a0a8d492a23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:26:39.625962 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a693c9-459b-4c14-aaad-1a0a8d492a23 service nova] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:26:39.635674 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 719/1426] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:26:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:26:40.047618 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbadc5a2-76dd-4702-80be-3b3b73e0c5a8 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:40.048095 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbadc5a2-76dd-4702-80be-3b3b73e0c5a8 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:40.048290 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbadc5a2-76dd-4702-80be-3b3b73e0c5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:40.096450 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-dbadc5a2-76dd-4702-80be-3b3b73e0c5a8 None None] MFA Rules not processed for user `abc393885c6c4cf6bd4dd52f698fc38c`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:26:40.097707 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-dbadc5a2-76dd-4702-80be-3b3b73e0c5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:26:40.159676 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 708/1427] 10.222.0.62 () {58 vars in 1009 bytes} [Tue Nov 23 19:26:40 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:26:40.204440 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64867582-b12a-40c2-bb00-f8e64c3ace26 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:40.204905 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64867582-b12a-40c2-bb00-f8e64c3ace26 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:40.205012 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64867582-b12a-40c2-bb00-f8e64c3ace26 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:40.207047 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 720/1428] 10.222.0.62 () {54 vars in 942 bytes} [Tue Nov 23 19:26:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:26:40.214081 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fee44-8554-48b7-a5b6-32db0a458b0c None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:40.214444 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fee44-8554-48b7-a5b6-32db0a458b0c None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:40.214731 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fee44-8554-48b7-a5b6-32db0a458b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:40.261347 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-7b0fee44-8554-48b7-a5b6-32db0a458b0c None None] MFA Rules not processed for user `87b6ed93587a4c87ad5002fc80b985c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:26:40.262547 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-7b0fee44-8554-48b7-a5b6-32db0a458b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:26:40.332179 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 709/1429] 10.222.0.62 () {58 vars in 1039 bytes} [Tue Nov 23 19:26:40 2021] POST /identity/v3/auth/tokens => generated 3294 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:26:40.342203 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64867582-b12a-40c2-bb00-f8e64c3ace26 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:26:40.355988 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64867582-b12a-40c2-bb00-f8e64c3ace26 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:26:40.360824 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce9b3c-ae70-4d16-a7a6-8759833afb71 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87b6ed93587a4c87ad5002fc80b985c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:26:40.361483 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce9b3c-ae70-4d16-a7a6-8759833afb71 service swift] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:40.361769 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce9b3c-ae70-4d16-a7a6-8759833afb71 service swift] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:40.362047 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce9b3c-ae70-4d16-a7a6-8759833afb71 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:40.370129 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce9b3c-ae70-4d16-a7a6-8759833afb71 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:26:40.371693 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce9b3c-ae70-4d16-a7a6-8759833afb71 service swift] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:26:40.379729 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 721/1430] 10.222.0.62 () {60 vars in 1384 bytes} [Tue Nov 23 19:26:40 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:26:42.050033 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96899ac9-b667-4153-a9b3-9f58eb2201ea None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:42.050650 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96899ac9-b667-4153-a9b3-9f58eb2201ea None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:42.050650 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96899ac9-b667-4153-a9b3-9f58eb2201ea None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:42.052555 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 710/1431] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:26:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:26:42.060267 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7238a-319a-4fde-b607-0b7261f67e0a None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:42.060267 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7238a-319a-4fde-b607-0b7261f67e0a None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:42.060267 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7238a-319a-4fde-b607-0b7261f67e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:42.085335 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-a6b7238a-319a-4fde-b607-0b7261f67e0a None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:26:42.086703 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-a6b7238a-319a-4fde-b607-0b7261f67e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:26:42.095294 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 722/1432] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:26:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:26:42.145073 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96899ac9-b667-4153-a9b3-9f58eb2201ea None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:26:42.161362 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96899ac9-b667-4153-a9b3-9f58eb2201ea None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:26:42.167505 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b7bcf-11df-406d-88c7-ddb5a3c2b8b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:26:42.168243 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b7bcf-11df-406d-88c7-ddb5a3c2b8b5 service nova] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:42.168597 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b7bcf-11df-406d-88c7-ddb5a3c2b8b5 service nova] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:42.168951 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b7bcf-11df-406d-88c7-ddb5a3c2b8b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:42.180276 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b7bcf-11df-406d-88c7-ddb5a3c2b8b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:26:42.183846 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b7bcf-11df-406d-88c7-ddb5a3c2b8b5 service nova] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:26:42.195868 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 711/1433] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:26:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:26:44.616305 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef42a4-4771-4211-a5c3-f27b1e12ef80 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:44.616879 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef42a4-4771-4211-a5c3-f27b1e12ef80 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:44.616879 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef42a4-4771-4211-a5c3-f27b1e12ef80 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:44.618877 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 723/1434] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:26:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:26:44.624857 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea5248-cb8a-4ba9-bd6b-6e0285e16186 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:44.625348 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea5248-cb8a-4ba9-bd6b-6e0285e16186 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:44.625478 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea5248-cb8a-4ba9-bd6b-6e0285e16186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:44.644242 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-b0ea5248-cb8a-4ba9-bd6b-6e0285e16186 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:26:44.645621 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-b0ea5248-cb8a-4ba9-bd6b-6e0285e16186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:26:44.659352 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 712/1435] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:26:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:26:44.707227 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef42a4-4771-4211-a5c3-f27b1e12ef80 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:26:44.725007 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef42a4-4771-4211-a5c3-f27b1e12ef80 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:26:44.730559 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075b3a4-5034-4427-9848-8ff8d8444368 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:26:44.731282 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075b3a4-5034-4427-9848-8ff8d8444368 service nova] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:26:44.731640 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075b3a4-5034-4427-9848-8ff8d8444368 service nova] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:26:44.731982 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075b3a4-5034-4427-9848-8ff8d8444368 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:26:44.741434 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075b3a4-5034-4427-9848-8ff8d8444368 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:26:44.743138 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075b3a4-5034-4427-9848-8ff8d8444368 service nova] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:26:44.753153 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 724/1436] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:26:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:27:04.013652 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29953f-ab65-474d-8b25-2b80a9ad7eae None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:04.014230 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29953f-ab65-474d-8b25-2b80a9ad7eae None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:04.014230 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29953f-ab65-474d-8b25-2b80a9ad7eae None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:04.015989 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 713/1437] 10.222.0.62 () {54 vars in 918 bytes} [Tue Nov 23 19:27:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:27:04.023107 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb477a52-d3dc-41df-b1d6-eb0e13ea4f71 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:04.023541 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb477a52-d3dc-41df-b1d6-eb0e13ea4f71 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:04.023637 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb477a52-d3dc-41df-b1d6-eb0e13ea4f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:04.040849 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-cb477a52-d3dc-41df-b1d6-eb0e13ea4f71 None None] MFA Rules not processed for user `d100a378f1ff441080555bfc2ff4d6ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:27:04.042046 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-cb477a52-d3dc-41df-b1d6-eb0e13ea4f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:27:04.050187 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 725/1438] 10.222.0.62 () {58 vars in 1015 bytes} [Tue Nov 23 19:27:04 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:27:04.065060 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375be03-be95-4b00-8594-2577f08ebd1f None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:04.065351 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375be03-be95-4b00-8594-2577f08ebd1f None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:04.065925 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375be03-be95-4b00-8594-2577f08ebd1f None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:04.067666 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 714/1439] 10.222.0.62 () {54 vars in 918 bytes} [Tue Nov 23 19:27:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:27:04.073482 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800761e0-ccf9-4d9c-ac46-616cc3d4906a None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:04.073772 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800761e0-ccf9-4d9c-ac46-616cc3d4906a None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:04.074051 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800761e0-ccf9-4d9c-ac46-616cc3d4906a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:04.092395 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-800761e0-ccf9-4d9c-ac46-616cc3d4906a None None] MFA Rules not processed for user `6d91fe7f996b48b0bc28e1eadc4f8869`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:27:04.093614 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-800761e0-ccf9-4d9c-ac46-616cc3d4906a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:27:04.103371 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 726/1440] 10.222.0.62 () {58 vars in 1015 bytes} [Tue Nov 23 19:27:04 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:27:06.864618 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98c300-a279-488a-901e-988c27fde325 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:06.865131 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98c300-a279-488a-901e-988c27fde325 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:06.865228 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98c300-a279-488a-901e-988c27fde325 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:06.867936 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 19:27:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:27:06.873764 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb24f6-e886-4d2c-a5b5-2722088b82d8 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:06.874173 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb24f6-e886-4d2c-a5b5-2722088b82d8 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:06.874316 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb24f6-e886-4d2c-a5b5-2722088b82d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:06.891620 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-bddb24f6-e886-4d2c-a5b5-2722088b82d8 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:27:06.892807 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-bddb24f6-e886-4d2c-a5b5-2722088b82d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:27:06.900531 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 19:27:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:27:06.945255 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98c300-a279-488a-901e-988c27fde325 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:27:06.959376 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98c300-a279-488a-901e-988c27fde325 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:27:06.965081 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed542d-df1b-4da9-bf02-8df634cd1d64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:27:06.965730 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed542d-df1b-4da9-bf02-8df634cd1d64 service nova] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:06.966012 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed542d-df1b-4da9-bf02-8df634cd1d64 service nova] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:06.966282 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed542d-df1b-4da9-bf02-8df634cd1d64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:06.974033 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed542d-df1b-4da9-bf02-8df634cd1d64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:27:06.976119 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed542d-df1b-4da9-bf02-8df634cd1d64 service nova] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:27:06.985661 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 716/1443] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:27:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:27:08.470847 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087ff27-9161-4e0d-8df8-9d9502fdf795 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:08.471420 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087ff27-9161-4e0d-8df8-9d9502fdf795 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:08.471420 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087ff27-9161-4e0d-8df8-9d9502fdf795 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:08.473181 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 19:27:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:27:08.479389 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef033897-2779-415a-836e-6b81eeb2470b None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:08.479823 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef033897-2779-415a-836e-6b81eeb2470b None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:08.479960 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef033897-2779-415a-836e-6b81eeb2470b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:08.498144 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-ef033897-2779-415a-836e-6b81eeb2470b None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:27:08.499333 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-ef033897-2779-415a-836e-6b81eeb2470b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:27:08.507007 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 19:27:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:27:08.662507 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087ff27-9161-4e0d-8df8-9d9502fdf795 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:27:08.677131 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087ff27-9161-4e0d-8df8-9d9502fdf795 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:27:08.683288 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a48587-a6e9-4a51-b6c5-0b71cd876ffa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:27:08.683957 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a48587-a6e9-4a51-b6c5-0b71cd876ffa service nova] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:08.684240 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a48587-a6e9-4a51-b6c5-0b71cd876ffa service nova] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:08.684518 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a48587-a6e9-4a51-b6c5-0b71cd876ffa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:08.692687 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a48587-a6e9-4a51-b6c5-0b71cd876ffa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:27:08.694281 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a48587-a6e9-4a51-b6c5-0b71cd876ffa service nova] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:27:08.703482 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 729/1446] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:27:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:27:10.127694 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1196b47-8b3b-4fc1-948b-5cb1bee1d331 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:10.128209 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1196b47-8b3b-4fc1-948b-5cb1bee1d331 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:10.128209 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1196b47-8b3b-4fc1-948b-5cb1bee1d331 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:10.129955 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 19:27:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:27:10.135987 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d86c70-1dea-4e43-b37e-2815b6a239ef None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:10.136396 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d86c70-1dea-4e43-b37e-2815b6a239ef None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:10.136545 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d86c70-1dea-4e43-b37e-2815b6a239ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:10.154872 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-82d86c70-1dea-4e43-b37e-2815b6a239ef None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:27:10.156055 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-82d86c70-1dea-4e43-b37e-2815b6a239ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:27:10.164442 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 19:27:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:27:10.322531 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1196b47-8b3b-4fc1-948b-5cb1bee1d331 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:27:10.336929 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1196b47-8b3b-4fc1-948b-5cb1bee1d331 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:27:10.342201 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d36f2e-5164-48ba-a8ca-c6d530d86738 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:27:10.342821 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d36f2e-5164-48ba-a8ca-c6d530d86738 service nova] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:10.343098 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d36f2e-5164-48ba-a8ca-c6d530d86738 service nova] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:10.343369 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d36f2e-5164-48ba-a8ca-c6d530d86738 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:10.351859 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d36f2e-5164-48ba-a8ca-c6d530d86738 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:27:10.353388 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d36f2e-5164-48ba-a8ca-c6d530d86738 service nova] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:27:10.362484 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 719/1449] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:27:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:27:11.780406 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1534746-5a9a-41f8-ae88-de15bf296aed None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:11.781005 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1534746-5a9a-41f8-ae88-de15bf296aed None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:11.781005 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1534746-5a9a-41f8-ae88-de15bf296aed None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:11.782797 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 19:27:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:27:11.789327 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9026a-2afb-4d94-92d9-4ae6fb73f48b None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:11.789838 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9026a-2afb-4d94-92d9-4ae6fb73f48b None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:11.789932 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9026a-2afb-4d94-92d9-4ae6fb73f48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:11.807900 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-bbe9026a-2afb-4d94-92d9-4ae6fb73f48b None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:27:11.809081 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-bbe9026a-2afb-4d94-92d9-4ae6fb73f48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:27:11.816919 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 19:27:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:27:11.971973 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1534746-5a9a-41f8-ae88-de15bf296aed None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:27:11.986609 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1534746-5a9a-41f8-ae88-de15bf296aed None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:27:11.991867 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf074aca-6475-44e9-bc96-4c6d8bce26e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:27:11.992593 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf074aca-6475-44e9-bc96-4c6d8bce26e4 service nova] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:11.992877 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf074aca-6475-44e9-bc96-4c6d8bce26e4 service nova] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:11.993140 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf074aca-6475-44e9-bc96-4c6d8bce26e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:12.000813 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf074aca-6475-44e9-bc96-4c6d8bce26e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:27:12.002411 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf074aca-6475-44e9-bc96-4c6d8bce26e4 service nova] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:27:12.011310 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 732/1452] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:27:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:27:13.419997 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83334a-2df9-4bcf-a75c-ca2c9ab1782c None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:13.420564 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83334a-2df9-4bcf-a75c-ca2c9ab1782c None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:13.420564 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83334a-2df9-4bcf-a75c-ca2c9ab1782c None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:13.422289 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 19:27:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:27:13.427961 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a411a-8c32-4dc7-a086-ccc685cafa95 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:13.428380 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a411a-8c32-4dc7-a086-ccc685cafa95 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:13.428519 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a411a-8c32-4dc7-a086-ccc685cafa95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:13.447641 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-1e9a411a-8c32-4dc7-a086-ccc685cafa95 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:27:13.448820 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-1e9a411a-8c32-4dc7-a086-ccc685cafa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:27:13.456860 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 19:27:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:27:13.614255 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83334a-2df9-4bcf-a75c-ca2c9ab1782c None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:27:13.628471 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83334a-2df9-4bcf-a75c-ca2c9ab1782c None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:27:13.634529 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea1391-aa4a-45de-8e49-876feff0eae0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:27:13.635157 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea1391-aa4a-45de-8e49-876feff0eae0 service nova] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:13.635436 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea1391-aa4a-45de-8e49-876feff0eae0 service nova] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:13.635713 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea1391-aa4a-45de-8e49-876feff0eae0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:13.643527 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea1391-aa4a-45de-8e49-876feff0eae0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:27:13.645081 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea1391-aa4a-45de-8e49-876feff0eae0 service nova] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:27:13.654733 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 722/1455] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:27:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:27:15.145483 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea2ecf-eafb-41cc-8f24-20c247848d46 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:15.146022 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea2ecf-eafb-41cc-8f24-20c247848d46 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:15.146022 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea2ecf-eafb-41cc-8f24-20c247848d46 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:15.148127 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 19:27:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:27:15.153572 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcbee9-6221-4c45-bd8d-fa3dc2c446b8 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:15.154031 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcbee9-6221-4c45-bd8d-fa3dc2c446b8 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:15.154142 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcbee9-6221-4c45-bd8d-fa3dc2c446b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:15.172810 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-1edcbee9-6221-4c45-bd8d-fa3dc2c446b8 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:27:15.174025 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-1edcbee9-6221-4c45-bd8d-fa3dc2c446b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:27:15.182657 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 19:27:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:27:15.337311 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea2ecf-eafb-41cc-8f24-20c247848d46 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:27:15.351984 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea2ecf-eafb-41cc-8f24-20c247848d46 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:27:15.357235 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922b90f-3498-4b17-8088-cbbb4435750a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:27:15.357917 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922b90f-3498-4b17-8088-cbbb4435750a service nova] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:15.358199 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922b90f-3498-4b17-8088-cbbb4435750a service nova] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:15.358478 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922b90f-3498-4b17-8088-cbbb4435750a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:15.366228 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922b90f-3498-4b17-8088-cbbb4435750a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:27:15.368829 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922b90f-3498-4b17-8088-cbbb4435750a service nova] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:27:15.377884 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 735/1458] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:27:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:27:16.789851 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4f25d-17d2-4fce-8a59-e3bc7abe822e None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:16.790415 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4f25d-17d2-4fce-8a59-e3bc7abe822e None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:16.790415 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4f25d-17d2-4fce-8a59-e3bc7abe822e None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:16.792189 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 19:27:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:27:16.797750 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579c85c-4694-47af-9601-e04241dd5ac9 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:16.798142 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579c85c-4694-47af-9601-e04241dd5ac9 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:16.798314 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579c85c-4694-47af-9601-e04241dd5ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:16.816615 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-d579c85c-4694-47af-9601-e04241dd5ac9 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:27:16.817831 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-d579c85c-4694-47af-9601-e04241dd5ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:27:16.826211 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 19:27:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:27:16.980459 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4f25d-17d2-4fce-8a59-e3bc7abe822e None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:27:16.994901 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4f25d-17d2-4fce-8a59-e3bc7abe822e None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:27:17.000162 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9f48c-49e0-4555-9e28-8e22937da236 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:27:17.000786 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9f48c-49e0-4555-9e28-8e22937da236 service nova] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:17.001069 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9f48c-49e0-4555-9e28-8e22937da236 service nova] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:17.001344 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9f48c-49e0-4555-9e28-8e22937da236 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:17.009951 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9f48c-49e0-4555-9e28-8e22937da236 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:27:17.011508 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9f48c-49e0-4555-9e28-8e22937da236 service nova] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:27:17.020599 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 725/1461] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:27:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:27:18.421043 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fa9a0-62e9-49d7-91f2-4e76cbfca7c1 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:18.421659 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fa9a0-62e9-49d7-91f2-4e76cbfca7c1 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:18.421659 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fa9a0-62e9-49d7-91f2-4e76cbfca7c1 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:18.423416 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 19:27:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:27:18.428759 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38155aae-af30-463e-b369-d691b66f516f None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:18.429680 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38155aae-af30-463e-b369-d691b66f516f None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:18.429918 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38155aae-af30-463e-b369-d691b66f516f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:18.447937 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-38155aae-af30-463e-b369-d691b66f516f None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:27:18.449099 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-38155aae-af30-463e-b369-d691b66f516f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:27:18.456623 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 19:27:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:27:18.608558 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626fa9a0-62e9-49d7-91f2-4e76cbfca7c1 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:27:18.622854 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626fa9a0-62e9-49d7-91f2-4e76cbfca7c1 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:27:18.628119 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fb05f-dc7d-4dfa-81c6-a9c364096471 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:27:18.628739 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fb05f-dc7d-4dfa-81c6-a9c364096471 service nova] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:18.629016 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fb05f-dc7d-4dfa-81c6-a9c364096471 service nova] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:18.629285 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fb05f-dc7d-4dfa-81c6-a9c364096471 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:18.637638 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637fb05f-dc7d-4dfa-81c6-a9c364096471 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:27:18.639183 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637fb05f-dc7d-4dfa-81c6-a9c364096471 service nova] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:27:18.648256 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 738/1464] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:27:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:27:20.086100 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ff850-00c1-4f6d-bc2d-8fd3cf12b28d None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:20.086651 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ff850-00c1-4f6d-bc2d-8fd3cf12b28d None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:20.086651 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ff850-00c1-4f6d-bc2d-8fd3cf12b28d None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:20.088352 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 19:27:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:27:20.093933 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09959a7-992b-4abf-83e8-3e263a7939f7 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:20.094383 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09959a7-992b-4abf-83e8-3e263a7939f7 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:20.094490 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09959a7-992b-4abf-83e8-3e263a7939f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:20.112156 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-d09959a7-992b-4abf-83e8-3e263a7939f7 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:27:20.113359 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-d09959a7-992b-4abf-83e8-3e263a7939f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:27:20.121788 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 19:27:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:27:20.276286 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ff850-00c1-4f6d-bc2d-8fd3cf12b28d None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:27:20.290287 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ff850-00c1-4f6d-bc2d-8fd3cf12b28d None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:27:20.295632 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ff14e-b938-413e-b27f-73f9d956adbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:27:20.296258 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ff14e-b938-413e-b27f-73f9d956adbb service nova] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:20.296541 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ff14e-b938-413e-b27f-73f9d956adbb service nova] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:20.296815 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ff14e-b938-413e-b27f-73f9d956adbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:20.305253 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ff14e-b938-413e-b27f-73f9d956adbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:27:20.306840 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ff14e-b938-413e-b27f-73f9d956adbb service nova] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:27:20.316146 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 728/1467] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:27:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:27:22.512037 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2065b4-a987-4a4e-861c-0b6e89079b78 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:22.512606 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2065b4-a987-4a4e-861c-0b6e89079b78 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:22.512606 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2065b4-a987-4a4e-861c-0b6e89079b78 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:22.514419 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 19:27:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:27:22.520348 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e02309-9c4e-4856-939c-808e3506c1a0 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:22.520753 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e02309-9c4e-4856-939c-808e3506c1a0 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:22.520953 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e02309-9c4e-4856-939c-808e3506c1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:22.539165 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-59e02309-9c4e-4856-939c-808e3506c1a0 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:27:22.540352 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-59e02309-9c4e-4856-939c-808e3506c1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:27:22.548087 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 19:27:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:27:22.588988 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2065b4-a987-4a4e-861c-0b6e89079b78 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:27:22.599399 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2065b4-a987-4a4e-861c-0b6e89079b78 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:27:22.603475 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177c183-d6f1-4bbe-a3b9-3ff433443622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:27:22.604101 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177c183-d6f1-4bbe-a3b9-3ff433443622 service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:22.604384 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177c183-d6f1-4bbe-a3b9-3ff433443622 service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:22.604660 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177c183-d6f1-4bbe-a3b9-3ff433443622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:22.613393 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177c183-d6f1-4bbe-a3b9-3ff433443622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:27:22.614855 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177c183-d6f1-4bbe-a3b9-3ff433443622 service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:27:22.624819 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 741/1470] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:27:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:27:25.040580 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbc2bb-8680-4499-8ab3-260904044eb4 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:25.041144 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbc2bb-8680-4499-8ab3-260904044eb4 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:25.041144 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbc2bb-8680-4499-8ab3-260904044eb4 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:25.042961 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 730/1471] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 19:27:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:27:25.048831 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3772f-bc78-4d82-8d4c-7725a3891329 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:25.049229 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3772f-bc78-4d82-8d4c-7725a3891329 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:25.049392 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3772f-bc78-4d82-8d4c-7725a3891329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:25.067227 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-fda3772f-bc78-4d82-8d4c-7725a3891329 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:27:25.068352 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-fda3772f-bc78-4d82-8d4c-7725a3891329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:27:25.076663 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 742/1472] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 19:27:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:27:25.117367 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbc2bb-8680-4499-8ab3-260904044eb4 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:27:25.127771 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbc2bb-8680-4499-8ab3-260904044eb4 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:27:25.131241 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8761c1-d68b-47a1-acd6-0a1e0d1b6d2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:27:25.131864 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8761c1-d68b-47a1-acd6-0a1e0d1b6d2f service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:25.133045 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8761c1-d68b-47a1-acd6-0a1e0d1b6d2f service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:25.133337 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8761c1-d68b-47a1-acd6-0a1e0d1b6d2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:25.141966 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8761c1-d68b-47a1-acd6-0a1e0d1b6d2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:27:25.143365 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8761c1-d68b-47a1-acd6-0a1e0d1b6d2f service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:27:25.153400 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 731/1473] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:27:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:27:27.817488 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16406bd-a99b-498f-9d25-acb7fec02ce2 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:27.817892 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16406bd-a99b-498f-9d25-acb7fec02ce2 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:27.818043 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16406bd-a99b-498f-9d25-acb7fec02ce2 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:27.820796 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 743/1474] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 19:27:27 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:27:27.826709 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5bec6-9187-4d0d-bdbb-da92b5b2c11e None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:27.827113 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5bec6-9187-4d0d-bdbb-da92b5b2c11e None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:27.827264 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5bec6-9187-4d0d-bdbb-da92b5b2c11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:27.845122 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-05d5bec6-9187-4d0d-bdbb-da92b5b2c11e None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:27:27.846358 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-05d5bec6-9187-4d0d-bdbb-da92b5b2c11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:27:27.855188 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 732/1475] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 19:27:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:27:27.895903 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16406bd-a99b-498f-9d25-acb7fec02ce2 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:27:27.906820 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16406bd-a99b-498f-9d25-acb7fec02ce2 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:27:27.910341 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1a26c-402f-44af-bb21-84f7c487688f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:27:27.910970 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1a26c-402f-44af-bb21-84f7c487688f service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:27.911254 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1a26c-402f-44af-bb21-84f7c487688f service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:27.911533 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1a26c-402f-44af-bb21-84f7c487688f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:27.928624 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1a26c-402f-44af-bb21-84f7c487688f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:27:27.930833 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1a26c-402f-44af-bb21-84f7c487688f service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:27:27.946222 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 744/1476] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:27:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:27:30.358150 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f678c0-7ed3-4bb8-95ad-e66988236e87 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:30.358723 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f678c0-7ed3-4bb8-95ad-e66988236e87 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:30.358723 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f678c0-7ed3-4bb8-95ad-e66988236e87 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:30.360445 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 733/1477] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 19:27:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:27:30.366420 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735a549-eff8-48de-bb02-cae72430ca86 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:30.367428 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735a549-eff8-48de-bb02-cae72430ca86 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:30.367545 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735a549-eff8-48de-bb02-cae72430ca86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:30.385322 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-a735a549-eff8-48de-bb02-cae72430ca86 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:27:30.386576 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-a735a549-eff8-48de-bb02-cae72430ca86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:27:30.394232 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 745/1478] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 19:27:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:27:30.433999 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f678c0-7ed3-4bb8-95ad-e66988236e87 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:27:30.445192 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f678c0-7ed3-4bb8-95ad-e66988236e87 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:27:30.448675 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d81952-de54-4e5c-b84f-da6db22961b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:27:30.449302 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d81952-de54-4e5c-b84f-da6db22961b6 service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:30.449615 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d81952-de54-4e5c-b84f-da6db22961b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:30.449888 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d81952-de54-4e5c-b84f-da6db22961b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:30.458513 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d81952-de54-4e5c-b84f-da6db22961b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:27:30.459926 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d81952-de54-4e5c-b84f-da6db22961b6 service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:27:30.470089 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 734/1479] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:27:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:27:32.849600 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1174af-51c4-4008-b727-23838ecf7e86 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:32.850093 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1174af-51c4-4008-b727-23838ecf7e86 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:32.850223 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1174af-51c4-4008-b727-23838ecf7e86 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:32.852530 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 746/1480] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 19:27:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:27:32.858764 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3f0a4-2efb-457d-88f3-fbfa3b812c56 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:32.859236 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3f0a4-2efb-457d-88f3-fbfa3b812c56 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:32.859372 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3f0a4-2efb-457d-88f3-fbfa3b812c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:32.876934 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-1bf3f0a4-2efb-457d-88f3-fbfa3b812c56 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:27:32.878176 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-1bf3f0a4-2efb-457d-88f3-fbfa3b812c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:27:32.886010 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 735/1481] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 19:27:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:27:32.925773 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1174af-51c4-4008-b727-23838ecf7e86 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:27:32.936521 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1174af-51c4-4008-b727-23838ecf7e86 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:27:32.939997 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b90318-8850-4951-82cd-0b7ae3d1f6b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:27:32.940617 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b90318-8850-4951-82cd-0b7ae3d1f6b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:32.940897 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b90318-8850-4951-82cd-0b7ae3d1f6b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:32.941452 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b90318-8850-4951-82cd-0b7ae3d1f6b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:32.950488 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b90318-8850-4951-82cd-0b7ae3d1f6b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:27:32.951899 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b90318-8850-4951-82cd-0b7ae3d1f6b9 service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:27:32.961916 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 747/1482] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:27:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:27:35.268728 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13320725-e778-41d6-9c36-d428dcd9fb55 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:35.269278 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13320725-e778-41d6-9c36-d428dcd9fb55 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:35.269278 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13320725-e778-41d6-9c36-d428dcd9fb55 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:35.271134 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 736/1483] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 19:27:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:27:35.277257 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3a996-6858-4d09-a99c-f1a5a44a0208 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:35.277670 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3a996-6858-4d09-a99c-f1a5a44a0208 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:35.277860 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3a996-6858-4d09-a99c-f1a5a44a0208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:35.295719 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-65d3a996-6858-4d09-a99c-f1a5a44a0208 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:27:35.296907 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-65d3a996-6858-4d09-a99c-f1a5a44a0208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:27:35.305229 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 748/1484] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 19:27:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:27:35.345373 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13320725-e778-41d6-9c36-d428dcd9fb55 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:27:35.356934 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13320725-e778-41d6-9c36-d428dcd9fb55 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:27:35.360475 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f220cc-a5d0-4d7d-8035-6fbc05f053b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:27:35.361098 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f220cc-a5d0-4d7d-8035-6fbc05f053b3 service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:35.361379 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f220cc-a5d0-4d7d-8035-6fbc05f053b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:35.361684 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f220cc-a5d0-4d7d-8035-6fbc05f053b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:35.371509 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f220cc-a5d0-4d7d-8035-6fbc05f053b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:27:35.372894 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f220cc-a5d0-4d7d-8035-6fbc05f053b3 service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:27:35.381854 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 737/1485] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:27:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:27:37.707754 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e337e-e8cf-4d3e-938f-b0a3f8157efd None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:37.708320 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e337e-e8cf-4d3e-938f-b0a3f8157efd None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:37.708320 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e337e-e8cf-4d3e-938f-b0a3f8157efd None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:37.710142 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 749/1486] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 19:27:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:27:37.720876 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf20f28-7255-48f2-bb34-d97f8b4d4b3a None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:37.720876 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf20f28-7255-48f2-bb34-d97f8b4d4b3a None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:37.720876 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf20f28-7255-48f2-bb34-d97f8b4d4b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:37.735254 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-bcf20f28-7255-48f2-bb34-d97f8b4d4b3a None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:27:37.736439 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-bcf20f28-7255-48f2-bb34-d97f8b4d4b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:27:37.745129 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 738/1487] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 19:27:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:27:37.783894 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e337e-e8cf-4d3e-938f-b0a3f8157efd None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:27:37.795307 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e337e-e8cf-4d3e-938f-b0a3f8157efd None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:27:37.798885 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536bcd3a-1937-4f74-bbb3-952b3819589e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:27:37.799518 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bcd3a-1937-4f74-bbb3-952b3819589e service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:37.799826 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bcd3a-1937-4f74-bbb3-952b3819589e service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:37.800100 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bcd3a-1937-4f74-bbb3-952b3819589e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:37.809799 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536bcd3a-1937-4f74-bbb3-952b3819589e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:27:37.811227 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536bcd3a-1937-4f74-bbb3-952b3819589e service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:27:37.820815 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 750/1488] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:27:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:27:40.128334 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e9e99-85f4-4b1e-aca9-39bcc8f8fc51 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:40.128865 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e9e99-85f4-4b1e-aca9-39bcc8f8fc51 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:40.128865 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e9e99-85f4-4b1e-aca9-39bcc8f8fc51 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:40.130631 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 739/1489] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 19:27:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:27:40.137059 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81049e14-eadd-4eea-bf25-bb1331b95918 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:40.137504 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81049e14-eadd-4eea-bf25-bb1331b95918 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:40.137636 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81049e14-eadd-4eea-bf25-bb1331b95918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:40.154960 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-81049e14-eadd-4eea-bf25-bb1331b95918 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:27:40.156148 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-81049e14-eadd-4eea-bf25-bb1331b95918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:27:40.164016 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 751/1490] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 19:27:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:27:40.203202 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e9e99-85f4-4b1e-aca9-39bcc8f8fc51 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:27:40.213695 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e9e99-85f4-4b1e-aca9-39bcc8f8fc51 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:27:40.217150 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be11fca-b6f9-4691-b2bf-d4751ab0018c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:27:40.217812 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be11fca-b6f9-4691-b2bf-d4751ab0018c service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:40.218093 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be11fca-b6f9-4691-b2bf-d4751ab0018c service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:40.218369 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be11fca-b6f9-4691-b2bf-d4751ab0018c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:40.227228 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be11fca-b6f9-4691-b2bf-d4751ab0018c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:27:40.228649 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be11fca-b6f9-4691-b2bf-d4751ab0018c service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:27:40.238145 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 740/1491] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:27:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:27:42.478676 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8e089-4578-4a78-a134-b20a2c4ddfde None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:42.479275 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8e089-4578-4a78-a134-b20a2c4ddfde None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:42.479275 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8e089-4578-4a78-a134-b20a2c4ddfde None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:42.481060 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 752/1492] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 19:27:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:27:42.486860 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba3a27-b010-426d-a251-cd2d7c27cd5a None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:42.487259 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba3a27-b010-426d-a251-cd2d7c27cd5a None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:42.487422 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba3a27-b010-426d-a251-cd2d7c27cd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:42.505461 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-36ba3a27-b010-426d-a251-cd2d7c27cd5a None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:27:42.506652 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-36ba3a27-b010-426d-a251-cd2d7c27cd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:27:42.515179 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 741/1493] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 19:27:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:27:42.552248 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8e089-4578-4a78-a134-b20a2c4ddfde None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:27:42.563701 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8e089-4578-4a78-a134-b20a2c4ddfde None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:27:42.567459 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939af340-3bfb-4acd-9035-9068f3a2ee3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:27:42.568091 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939af340-3bfb-4acd-9035-9068f3a2ee3d service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:42.568373 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939af340-3bfb-4acd-9035-9068f3a2ee3d service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:42.568648 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939af340-3bfb-4acd-9035-9068f3a2ee3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:42.577868 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939af340-3bfb-4acd-9035-9068f3a2ee3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:27:42.579286 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939af340-3bfb-4acd-9035-9068f3a2ee3d service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:27:42.589227 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 753/1494] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:27:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:27:44.844006 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4287a92-27da-4535-b2fd-03587509cd23 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:44.844544 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4287a92-27da-4535-b2fd-03587509cd23 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:44.844544 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4287a92-27da-4535-b2fd-03587509cd23 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:44.846365 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 742/1495] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 19:27:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:27:44.852836 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6361d-f414-4057-8b52-9c00881814ff None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:44.853246 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6361d-f414-4057-8b52-9c00881814ff None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:44.853385 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6361d-f414-4057-8b52-9c00881814ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:44.871429 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-6ca6361d-f414-4057-8b52-9c00881814ff None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:27:44.872601 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-6ca6361d-f414-4057-8b52-9c00881814ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:27:44.880172 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 754/1496] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 19:27:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:27:44.918696 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4287a92-27da-4535-b2fd-03587509cd23 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:27:44.929064 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4287a92-27da-4535-b2fd-03587509cd23 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:27:44.933199 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0dd8da-a61e-4f56-838b-da7df2d1e569 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:27:44.933870 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0dd8da-a61e-4f56-838b-da7df2d1e569 service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:27:44.934156 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0dd8da-a61e-4f56-838b-da7df2d1e569 service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:27:44.934436 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0dd8da-a61e-4f56-838b-da7df2d1e569 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:27:44.943448 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0dd8da-a61e-4f56-838b-da7df2d1e569 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:27:44.944966 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0dd8da-a61e-4f56-838b-da7df2d1e569 service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:27:44.955907 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 743/1497] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:27:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:28:03.506012 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0aeb24-9bb7-4923-9e50-708a0860cbbb None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:28:03.506602 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0aeb24-9bb7-4923-9e50-708a0860cbbb None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:28:03.506602 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0aeb24-9bb7-4923-9e50-708a0860cbbb None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:28:03.508351 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 755/1498] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:28:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:28:03.514134 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abd25b-41f0-4f19-a288-fc4a21512ddf None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:28:03.514564 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abd25b-41f0-4f19-a288-fc4a21512ddf None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:28:03.514677 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abd25b-41f0-4f19-a288-fc4a21512ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:28:03.532526 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-b2abd25b-41f0-4f19-a288-fc4a21512ddf None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:28:03.533719 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-b2abd25b-41f0-4f19-a288-fc4a21512ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:28:03.541800 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 744/1499] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:28:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:28:03.590579 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be97428-d7a8-4c2d-9645-6521d40bdbcb None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:28:03.590865 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be97428-d7a8-4c2d-9645-6521d40bdbcb None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:28:03.591140 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be97428-d7a8-4c2d-9645-6521d40bdbcb None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:28:03.592951 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 756/1500] 10.222.0.62 () {54 vars in 962 bytes} [Tue Nov 23 19:28:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:28:03.598264 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94655055-b69b-4a00-8d05-d0d94331309b None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:28:03.598553 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94655055-b69b-4a00-8d05-d0d94331309b None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:28:03.598831 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94655055-b69b-4a00-8d05-d0d94331309b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:28:03.617691 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-94655055-b69b-4a00-8d05-d0d94331309b None None] MFA Rules not processed for user `544443ed44ef41bcaa86af52926bfd14`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:28:03.619067 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-94655055-b69b-4a00-8d05-d0d94331309b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:28:03.625251 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 745/1501] 10.222.0.62 () {58 vars in 1059 bytes} [Tue Nov 23 19:28:03 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:28:03.632842 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be97428-d7a8-4c2d-9645-6521d40bdbcb None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:28:03.643297 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be97428-d7a8-4c2d-9645-6521d40bdbcb None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:28:03.646770 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2e6dc-a697-4edd-881d-8a5a3996e719 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '544443ed44ef41bcaa86af52926bfd14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:28:03.647386 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2e6dc-a697-4edd-881d-8a5a3996e719 service glance] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:28:03.647666 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2e6dc-a697-4edd-881d-8a5a3996e719 service glance] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:28:03.647939 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2e6dc-a697-4edd-881d-8a5a3996e719 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:28:03.657016 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2e6dc-a697-4edd-881d-8a5a3996e719 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:28:03.658464 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2e6dc-a697-4edd-881d-8a5a3996e719 service glance] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:28:03.668177 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 757/1502] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:28:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:28:06.027943 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebb629-643d-4785-ab00-32e23ad517e2 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:28:06.028528 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebb629-643d-4785-ab00-32e23ad517e2 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:28:06.028528 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebb629-643d-4785-ab00-32e23ad517e2 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:28:06.030305 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 746/1503] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:28:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:28:06.036106 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642be154-c88a-45cd-9ae5-a853df18f3f7 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:28:06.036543 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642be154-c88a-45cd-9ae5-a853df18f3f7 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:28:06.036649 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642be154-c88a-45cd-9ae5-a853df18f3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:28:06.054602 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-642be154-c88a-45cd-9ae5-a853df18f3f7 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:28:06.055765 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-642be154-c88a-45cd-9ae5-a853df18f3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:28:06.063326 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 758/1504] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:28:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:28:06.088566 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebb629-643d-4785-ab00-32e23ad517e2 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:28:06.100573 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebb629-643d-4785-ab00-32e23ad517e2 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:28:06.106059 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee720e14-877e-4b8d-850f-be2edba764bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:28:06.106698 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee720e14-877e-4b8d-850f-be2edba764bb admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:28:06.106985 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee720e14-877e-4b8d-850f-be2edba764bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:28:06.107266 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee720e14-877e-4b8d-850f-be2edba764bb admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:28:06.108004 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee720e14-877e-4b8d-850f-be2edba764bb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:28:06.109861 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee720e14-877e-4b8d-850f-be2edba764bb admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:28:06.130140 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 747/1505] 10.222.0.62 () {56 vars in 1108 bytes} [Tue Nov 23 19:28:06 2021] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:28:08.434561 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff8ce6-8c00-4df3-9175-a4aa325e2e18 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:28:08.435134 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff8ce6-8c00-4df3-9175-a4aa325e2e18 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:28:08.435134 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff8ce6-8c00-4df3-9175-a4aa325e2e18 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:28:08.436925 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 759/1506] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:28:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:28:08.443074 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa1273-5536-4823-a37d-0d8305bd87be None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:28:08.443497 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa1273-5536-4823-a37d-0d8305bd87be None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:28:08.443635 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa1273-5536-4823-a37d-0d8305bd87be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:28:08.461096 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-dcfa1273-5536-4823-a37d-0d8305bd87be None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:28:08.463041 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-dcfa1273-5536-4823-a37d-0d8305bd87be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:28:08.470706 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 748/1507] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:28:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:28:08.515087 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff8ce6-8c00-4df3-9175-a4aa325e2e18 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:28:08.529528 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff8ce6-8c00-4df3-9175-a4aa325e2e18 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:28:08.534846 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a32c1-c899-4f04-aa04-e5ab749d83a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:28:08.535468 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a32c1-c899-4f04-aa04-e5ab749d83a7 service nova] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:28:08.535748 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a32c1-c899-4f04-aa04-e5ab749d83a7 service nova] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:28:08.536021 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a32c1-c899-4f04-aa04-e5ab749d83a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:28:08.544046 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a32c1-c899-4f04-aa04-e5ab749d83a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:28:08.545629 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a32c1-c899-4f04-aa04-e5ab749d83a7 service nova] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:28:08.554589 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 760/1508] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:28:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:28:10.966854 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac4cac-8660-4b24-87c2-b45cd87d8474 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:28:10.967390 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac4cac-8660-4b24-87c2-b45cd87d8474 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:28:10.967390 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac4cac-8660-4b24-87c2-b45cd87d8474 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:28:10.969195 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 749/1509] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:28:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:28:10.974816 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c61bf-2aaf-4ca7-87c8-ceffae15552c None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:28:10.975214 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c61bf-2aaf-4ca7-87c8-ceffae15552c None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:28:10.975365 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c61bf-2aaf-4ca7-87c8-ceffae15552c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:28:10.993280 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-3c2c61bf-2aaf-4ca7-87c8-ceffae15552c None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:28:10.994520 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-3c2c61bf-2aaf-4ca7-87c8-ceffae15552c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:28:11.002347 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 761/1510] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:28:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:28:11.039243 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac4cac-8660-4b24-87c2-b45cd87d8474 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:28:11.050382 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac4cac-8660-4b24-87c2-b45cd87d8474 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:28:11.053874 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ad983-1b23-46ee-9309-935a93494ace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:28:11.054508 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ad983-1b23-46ee-9309-935a93494ace service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:28:11.054789 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ad983-1b23-46ee-9309-935a93494ace service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:28:11.055067 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ad983-1b23-46ee-9309-935a93494ace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:28:11.063962 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ad983-1b23-46ee-9309-935a93494ace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:28:11.065315 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ad983-1b23-46ee-9309-935a93494ace service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:28:11.074733 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 750/1511] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:28:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:28:13.401174 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1345f-e307-4456-a9d3-6ef88d58fe3d None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:28:13.401774 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1345f-e307-4456-a9d3-6ef88d58fe3d None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:28:13.401774 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1345f-e307-4456-a9d3-6ef88d58fe3d None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:28:13.403545 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 762/1512] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:28:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:28:13.409285 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13881c4d-f775-46cd-8ee8-acee4e0203c1 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:28:13.409742 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13881c4d-f775-46cd-8ee8-acee4e0203c1 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:28:13.409913 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13881c4d-f775-46cd-8ee8-acee4e0203c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:28:13.427307 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-13881c4d-f775-46cd-8ee8-acee4e0203c1 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:28:13.428514 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-13881c4d-f775-46cd-8ee8-acee4e0203c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:28:13.436675 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 751/1513] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:28:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:28:13.475873 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1345f-e307-4456-a9d3-6ef88d58fe3d None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:28:13.486598 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1345f-e307-4456-a9d3-6ef88d58fe3d None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:28:13.490057 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68d93b-e09f-4667-ba7c-9ea8044b26da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:28:13.490684 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68d93b-e09f-4667-ba7c-9ea8044b26da service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:28:13.490966 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68d93b-e09f-4667-ba7c-9ea8044b26da service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:28:13.491239 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68d93b-e09f-4667-ba7c-9ea8044b26da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:28:13.500395 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68d93b-e09f-4667-ba7c-9ea8044b26da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:28:13.501847 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68d93b-e09f-4667-ba7c-9ea8044b26da service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:28:13.511495 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 763/1514] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:28:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:28:15.947901 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0d77b-cf7f-4ed6-9e79-668bfc5fdb3b None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:28:15.948495 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0d77b-cf7f-4ed6-9e79-668bfc5fdb3b None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:28:15.948495 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0d77b-cf7f-4ed6-9e79-668bfc5fdb3b None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:28:15.950271 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 752/1515] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:28:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:28:15.956173 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab68ead-7202-4b2f-8328-9f999c95c366 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:28:15.956583 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab68ead-7202-4b2f-8328-9f999c95c366 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:28:15.956766 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab68ead-7202-4b2f-8328-9f999c95c366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:28:15.974579 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-aab68ead-7202-4b2f-8328-9f999c95c366 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:28:15.975798 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-aab68ead-7202-4b2f-8328-9f999c95c366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:28:15.984243 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 764/1516] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:28:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:28:16.027142 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0d77b-cf7f-4ed6-9e79-668bfc5fdb3b None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:28:16.037571 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0d77b-cf7f-4ed6-9e79-668bfc5fdb3b None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:28:16.041720 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd90cd1-37ca-4dab-b469-a1fbccf4ffe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:28:16.042343 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd90cd1-37ca-4dab-b469-a1fbccf4ffe2 service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:28:16.042622 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd90cd1-37ca-4dab-b469-a1fbccf4ffe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:28:16.042895 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd90cd1-37ca-4dab-b469-a1fbccf4ffe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:28:16.051532 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd90cd1-37ca-4dab-b469-a1fbccf4ffe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:28:16.052930 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd90cd1-37ca-4dab-b469-a1fbccf4ffe2 service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:28:16.062808 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 753/1517] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:28:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:28:18.636774 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a183c3-3575-48f9-b9e4-69bb42dfdeb8 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:28:18.637373 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a183c3-3575-48f9-b9e4-69bb42dfdeb8 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:28:18.637373 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a183c3-3575-48f9-b9e4-69bb42dfdeb8 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:28:18.639124 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 765/1518] 10.222.0.62 () {54 vars in 926 bytes} [Tue Nov 23 19:28:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:28:18.644827 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e240e-4187-4f5e-9079-31e632c04e20 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:28:18.645275 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e240e-4187-4f5e-9079-31e632c04e20 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:28:18.645378 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e240e-4187-4f5e-9079-31e632c04e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:28:18.662851 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-856e240e-4187-4f5e-9079-31e632c04e20 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:28:18.664051 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-856e240e-4187-4f5e-9079-31e632c04e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:28:18.672242 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 754/1519] 10.222.0.62 () {58 vars in 1023 bytes} [Tue Nov 23 19:28:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:28:18.714654 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a183c3-3575-48f9-b9e4-69bb42dfdeb8 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:28:18.723763 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a183c3-3575-48f9-b9e4-69bb42dfdeb8 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:28:18.727237 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99347546-1940-4521-8d14-9b1fbce83e40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:28:18.727867 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99347546-1940-4521-8d14-9b1fbce83e40 service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:28:18.728143 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99347546-1940-4521-8d14-9b1fbce83e40 service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:28:18.728457 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99347546-1940-4521-8d14-9b1fbce83e40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:28:18.736989 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99347546-1940-4521-8d14-9b1fbce83e40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:28:18.738428 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99347546-1940-4521-8d14-9b1fbce83e40 service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:28:18.748113 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 766/1520] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:28:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:29:47.074805 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79606982-96e9-41b4-a84c-47162f11502e None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:29:47.075526 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79606982-96e9-41b4-a84c-47162f11502e None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:29:47.075526 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79606982-96e9-41b4-a84c-47162f11502e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:29:47.092788 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-79606982-96e9-41b4-a84c-47162f11502e None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:29:47.093989 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-79606982-96e9-41b4-a84c-47162f11502e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:29:47.101613 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 755/1521] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:29:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:29:47.109364 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496caaf-cd3b-4ae2-8618-2928b2bcb7b4 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:29:47.109882 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496caaf-cd3b-4ae2-8618-2928b2bcb7b4 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:29:47.109983 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496caaf-cd3b-4ae2-8618-2928b2bcb7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:29:47.127618 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-c496caaf-cd3b-4ae2-8618-2928b2bcb7b4 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:29:47.128774 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-c496caaf-cd3b-4ae2-8618-2928b2bcb7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:29:47.136923 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 767/1522] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:29:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:29:47.141328 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79606982-96e9-41b4-a84c-47162f11502e None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:29:47.150699 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79606982-96e9-41b4-a84c-47162f11502e None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:29:47.155346 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114709ba-5132-4282-87d9-075835462cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:29:47.155991 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114709ba-5132-4282-87d9-075835462cda admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:29:47.156276 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114709ba-5132-4282-87d9-075835462cda admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:29:47.156552 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114709ba-5132-4282-87d9-075835462cda admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:29:47.157312 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114709ba-5132-4282-87d9-075835462cda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:29:47.157664 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114709ba-5132-4282-87d9-075835462cda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:29:47.159232 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114709ba-5132-4282-87d9-075835462cda admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:29:47.170395 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 756/1523] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:29:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:29:47.178155 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496caaf-cd3b-4ae2-8618-2928b2bcb7b4 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:29:47.187937 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496caaf-cd3b-4ae2-8618-2928b2bcb7b4 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:29:47.192913 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900dfafb-7266-4297-9c87-1dcc7dc2a4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:29:47.193852 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900dfafb-7266-4297-9c87-1dcc7dc2a4ff admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:29:47.194137 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900dfafb-7266-4297-9c87-1dcc7dc2a4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:29:47.194409 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900dfafb-7266-4297-9c87-1dcc7dc2a4ff admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:29:47.195108 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900dfafb-7266-4297-9c87-1dcc7dc2a4ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:29:47.197020 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900dfafb-7266-4297-9c87-1dcc7dc2a4ff admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:29:47.349734 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 768/1524] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:29:47 2021] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:29:47.352843 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114709ba-5132-4282-87d9-075835462cda admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:29:47.363528 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114709ba-5132-4282-87d9-075835462cda admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:29:47.423482 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4913b-b936-4ad7-a68f-72ad0613332f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:29:47.424146 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4913b-b936-4ad7-a68f-72ad0613332f admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:29:47.424428 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4913b-b936-4ad7-a68f-72ad0613332f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:29:47.424702 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4913b-b936-4ad7-a68f-72ad0613332f admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:29:47.425515 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4913b-b936-4ad7-a68f-72ad0613332f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:29:47.427393 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4913b-b936-4ad7-a68f-72ad0613332f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:29:47.519900 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 757/1525] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:29:47 2021] POST /identity/v3/users => generated 290 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:29:47.529578 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900dfafb-7266-4297-9c87-1dcc7dc2a4ff admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:29:47.539606 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900dfafb-7266-4297-9c87-1dcc7dc2a4ff admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:29:47.544317 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee8a74-0320-4814-90ae-878e8ba8ec42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:29:47.544967 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee8a74-0320-4814-90ae-878e8ba8ec42 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:29:47.545252 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee8a74-0320-4814-90ae-878e8ba8ec42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:29:47.545561 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee8a74-0320-4814-90ae-878e8ba8ec42 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:29:47.546299 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee8a74-0320-4814-90ae-878e8ba8ec42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:29:47.547882 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee8a74-0320-4814-90ae-878e8ba8ec42 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:29:47.560842 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 769/1526] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:29:47 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:29:47.564799 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4913b-b936-4ad7-a68f-72ad0613332f admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:29:47.575434 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4913b-b936-4ad7-a68f-72ad0613332f admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:29:47.579979 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bbc61-6671-4d5c-aad6-d17ef36f8a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:29:47.580627 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bbc61-6671-4d5c-aad6-d17ef36f8a63 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:29:47.580906 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bbc61-6671-4d5c-aad6-d17ef36f8a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:29:47.581177 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bbc61-6671-4d5c-aad6-d17ef36f8a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:29:47.581941 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618bbc61-6671-4d5c-aad6-d17ef36f8a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:29:47.583500 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618bbc61-6671-4d5c-aad6-d17ef36f8a63 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:29:47.596999 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 758/1527] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:29:47 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:29:47.601101 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee8a74-0320-4814-90ae-878e8ba8ec42 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:29:47.610895 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee8a74-0320-4814-90ae-878e8ba8ec42 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:29:47.615377 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3becad1-31dd-4fd4-a3d4-ce6d699405fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:29:47.616244 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3becad1-31dd-4fd4-a3d4-ce6d699405fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:29:47.616527 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3becad1-31dd-4fd4-a3d4-ce6d699405fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:29:47.616801 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3becad1-31dd-4fd4-a3d4-ce6d699405fd admin admin] PATH_INFO: `/v3/projects/e82efd17d79a4de7a069e03ccf260985/users/668fd1a5e24c45549247902f28a7223e/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:29:47.630974 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3becad1-31dd-4fd4-a3d4-ce6d699405fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e82efd17d79a4de7a069e03ccf260985, user_id=668fd1a5e24c45549247902f28a7223e, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:29:47.633610 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3becad1-31dd-4fd4-a3d4-ce6d699405fd admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:29:47.685865 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 770/1528] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:29:47 2021] PUT /identity/v3/projects/e82efd17d79a4de7a069e03ccf260985/users/668fd1a5e24c45549247902f28a7223e/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:29:47.697163 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f72b4-2e54-4592-bfaf-61063d3bc502 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:29:47.697856 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f72b4-2e54-4592-bfaf-61063d3bc502 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:29:47.698138 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f72b4-2e54-4592-bfaf-61063d3bc502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:29:47.724904 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-5f5f72b4-2e54-4592-bfaf-61063d3bc502 None None] MFA Rules not processed for user `668fd1a5e24c45549247902f28a7223e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:29:47.726666 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-5f5f72b4-2e54-4592-bfaf-61063d3bc502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:29:47.789741 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 759/1529] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:29:47 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:29:47.801363 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3becad1-31dd-4fd4-a3d4-ce6d699405fd admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:29:47.872885 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3becad1-31dd-4fd4-a3d4-ce6d699405fd admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:29:47.878299 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73178ac1-0e77-4f23-9c4e-6b920b56b284 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:29:47.878950 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73178ac1-0e77-4f23-9c4e-6b920b56b284 service nova] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:29:47.879233 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73178ac1-0e77-4f23-9c4e-6b920b56b284 service nova] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:29:47.879510 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73178ac1-0e77-4f23-9c4e-6b920b56b284 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:29:47.887775 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73178ac1-0e77-4f23-9c4e-6b920b56b284 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:29:47.889353 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73178ac1-0e77-4f23-9c4e-6b920b56b284 service nova] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:29:47.897899 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 771/1530] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:29:47 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:29:47.966628 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11f3b1-c1e8-4df5-b3cb-f612458432cf None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:29:47.966922 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11f3b1-c1e8-4df5-b3cb-f612458432cf None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:29:47.967204 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11f3b1-c1e8-4df5-b3cb-f612458432cf None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:29:47.968888 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 760/1531] 10.222.0.62 () {52 vars in 829 bytes} [Tue Nov 23 19:29:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:29:47.972584 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73178ac1-0e77-4f23-9c4e-6b920b56b284 service nova] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:29:48.030889 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73178ac1-0e77-4f23-9c4e-6b920b56b284 service nova] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:29:48.035378 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c14fc-eb53-45c9-b4af-8b57fea41ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:29:48.036244 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c14fc-eb53-45c9-b4af-8b57fea41ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:29:48.036526 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c14fc-eb53-45c9-b4af-8b57fea41ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:29:48.036802 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c14fc-eb53-45c9-b4af-8b57fea41ebb admin admin] PATH_INFO: `/v3/users/668fd1a5e24c45549247902f28a7223e` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:29:48.038022 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c14fc-eb53-45c9-b4af-8b57fea41ebb admin admin] RBAC: Authorizing `identity:delete_user(user_id=668fd1a5e24c45549247902f28a7223e)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:29:48.039039 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING py.warnings [None req-ac3c14fc-eb53-45c9-b4af-8b57fea41ebb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:29:48.039039 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: warnings.warn(msg) Nov 23 19:29:48.039039 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: Nov 23 19:29:48.040231 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c14fc-eb53-45c9-b4af-8b57fea41ebb admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:29:48.210565 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-ac3c14fc-eb53-45c9-b4af-8b57fea41ebb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '668fd1a5e24c45549247902f28a7223e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:29:48.211207 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-ac3c14fc-eb53-45c9-b4af-8b57fea41ebb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '668fd1a5e24c45549247902f28a7223e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:29:48.223068 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-ac3c14fc-eb53-45c9-b4af-8b57fea41ebb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '668fd1a5e24c45549247902f28a7223e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:29:48.223822 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-ac3c14fc-eb53-45c9-b4af-8b57fea41ebb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '668fd1a5e24c45549247902f28a7223e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:29:48.244769 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-ac3c14fc-eb53-45c9-b4af-8b57fea41ebb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '668fd1a5e24c45549247902f28a7223e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:29:48.319203 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 772/1532] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:29:47 2021] DELETE /identity/v3/users/668fd1a5e24c45549247902f28a7223e => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:29:48.323590 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5273679-66bf-4b5f-826c-d79add303a8d None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:29:48.324727 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5273679-66bf-4b5f-826c-d79add303a8d None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:29:48.324727 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5273679-66bf-4b5f-826c-d79add303a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:29:48.343699 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-c5273679-66bf-4b5f-826c-d79add303a8d None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:29:48.344957 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-c5273679-66bf-4b5f-826c-d79add303a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:29:48.400628 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 761/1533] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:29:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:29:48.411146 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c14fc-eb53-45c9-b4af-8b57fea41ebb admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:29:48.412606 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-ac3c14fc-eb53-45c9-b4af-8b57fea41ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:29:48.468680 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c14fc-eb53-45c9-b4af-8b57fea41ebb admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:29:48.472152 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdbca4a-1576-4506-b1a3-f7ffed8382b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:29:48.472790 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbca4a-1576-4506-b1a3-f7ffed8382b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:29:48.473076 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbca4a-1576-4506-b1a3-f7ffed8382b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:29:48.473386 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbca4a-1576-4506-b1a3-f7ffed8382b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:29:48.482291 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdbca4a-1576-4506-b1a3-f7ffed8382b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:29:48.483713 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdbca4a-1576-4506-b1a3-f7ffed8382b9 service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:29:48.492884 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 773/1534] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:29:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:29:48.911014 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5273679-66bf-4b5f-826c-d79add303a8d None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:29:48.912434 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-c5273679-66bf-4b5f-826c-d79add303a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:29:48.924652 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5273679-66bf-4b5f-826c-d79add303a8d None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:29:48.929577 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af0b88-1030-403f-a9e2-28565e8b80df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:29:48.930638 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af0b88-1030-403f-a9e2-28565e8b80df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:29:48.930925 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af0b88-1030-403f-a9e2-28565e8b80df admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:29:48.931226 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af0b88-1030-403f-a9e2-28565e8b80df admin admin] PATH_INFO: `/v3/projects/e82efd17d79a4de7a069e03ccf260985` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:29:48.932473 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af0b88-1030-403f-a9e2-28565e8b80df admin admin] RBAC: Authorizing `identity:delete_project(project_id=e82efd17d79a4de7a069e03ccf260985)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:29:48.933701 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING py.warnings [None req-30af0b88-1030-403f-a9e2-28565e8b80df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:29:48.933701 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: warnings.warn(msg) Nov 23 19:29:48.933701 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: Nov 23 19:29:48.938315 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af0b88-1030-403f-a9e2-28565e8b80df admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:29:49.029366 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-30af0b88-1030-403f-a9e2-28565e8b80df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e82efd17d79a4de7a069e03ccf260985', 'request_id': 'req-30af0b88-1030-403f-a9e2-28565e8b80df'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:29:49.035116 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-30af0b88-1030-403f-a9e2-28565e8b80df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e82efd17d79a4de7a069e03ccf260985', 'request_id': 'req-30af0b88-1030-403f-a9e2-28565e8b80df'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:29:49.048812 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-30af0b88-1030-403f-a9e2-28565e8b80df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e82efd17d79a4de7a069e03ccf260985', 'request_id': 'req-30af0b88-1030-403f-a9e2-28565e8b80df'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:29:49.135947 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-30af0b88-1030-403f-a9e2-28565e8b80df admin admin] The token cache is being invalidate because project e82efd17d79a4de7a069e03ccf260985 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:29:49.136236 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-30af0b88-1030-403f-a9e2-28565e8b80df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:29:49.137361 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-30af0b88-1030-403f-a9e2-28565e8b80df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:29:49.139033 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 762/1535] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:29:48 2021] DELETE /identity/v3/projects/e82efd17d79a4de7a069e03ccf260985 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:31:23.020796 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d8bf7-58b4-486e-88ee-b622695b542e None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:31:23.021287 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d8bf7-58b4-486e-88ee-b622695b542e None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:31:23.021429 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d8bf7-58b4-486e-88ee-b622695b542e None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:31:23.023220 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 774/1536] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 19:31:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:31:23.028639 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0660679-c924-4441-8d2b-00c9210168ed None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:31:23.029096 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0660679-c924-4441-8d2b-00c9210168ed None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:31:23.029306 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0660679-c924-4441-8d2b-00c9210168ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:31:23.047443 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-b0660679-c924-4441-8d2b-00c9210168ed None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:31:23.048649 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-b0660679-c924-4441-8d2b-00c9210168ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:31:23.106018 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 763/1537] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 19:31:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:31:23.230723 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e378d3-e255-405f-9f25-9fc8cac14f85 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:31:23.231007 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e378d3-e255-405f-9f25-9fc8cac14f85 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:31:23.231283 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e378d3-e255-405f-9f25-9fc8cac14f85 None None] PATH_INFO: `/v3` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:31:23.232569 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 775/1538] 10.222.0.41 () {54 vars in 925 bytes} [Tue Nov 23 19:31:23 2021] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:31:23.240094 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ab16b-9a47-4ddb-bb73-7b55108eb725 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:31:23.240389 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ab16b-9a47-4ddb-bb73-7b55108eb725 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:31:23.240666 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ab16b-9a47-4ddb-bb73-7b55108eb725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:31:23.259144 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-613ab16b-9a47-4ddb-bb73-7b55108eb725 None None] MFA Rules not processed for user `d100a378f1ff441080555bfc2ff4d6ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:31:23.260183 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e378d3-e255-405f-9f25-9fc8cac14f85 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:31:23.260943 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-613ab16b-9a47-4ddb-bb73-7b55108eb725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:31:23.261825 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-96e378d3-e255-405f-9f25-9fc8cac14f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:31:23.323933 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 764/1539] 10.222.0.41 () {58 vars in 1015 bytes} [Tue Nov 23 19:31:23 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:31:23.334986 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e378d3-e255-405f-9f25-9fc8cac14f85 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:31:23.341048 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e72866-2fbc-4240-94cb-2d4073ff4c90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:31:23.341722 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e72866-2fbc-4240-94cb-2d4073ff4c90 service nova] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:31:23.342001 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e72866-2fbc-4240-94cb-2d4073ff4c90 service nova] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:31:23.342271 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e72866-2fbc-4240-94cb-2d4073ff4c90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:31:23.350185 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e72866-2fbc-4240-94cb-2d4073ff4c90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:31:23.351746 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e72866-2fbc-4240-94cb-2d4073ff4c90 service nova] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:31:23.360803 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 776/1540] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:31:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:31:24.770776 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df944600-f4f8-403c-b085-dc3a3918ccd5 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:31:24.771402 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df944600-f4f8-403c-b085-dc3a3918ccd5 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:31:24.771402 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df944600-f4f8-403c-b085-dc3a3918ccd5 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:31:24.773117 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 765/1541] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 19:31:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:31:24.779006 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeda5f4-e48b-45ea-90a7-b026d6d0f939 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:31:24.779479 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeda5f4-e48b-45ea-90a7-b026d6d0f939 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:31:24.779587 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeda5f4-e48b-45ea-90a7-b026d6d0f939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:31:24.797583 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-eaeda5f4-e48b-45ea-90a7-b026d6d0f939 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:31:24.799123 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-eaeda5f4-e48b-45ea-90a7-b026d6d0f939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:31:24.808301 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 777/1542] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 19:31:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:31:24.967493 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df944600-f4f8-403c-b085-dc3a3918ccd5 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:31:24.982498 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df944600-f4f8-403c-b085-dc3a3918ccd5 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:31:24.988042 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c593d09-d0a3-4a62-ab18-eb9b0ef49ae7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:31:24.988673 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c593d09-d0a3-4a62-ab18-eb9b0ef49ae7 service nova] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:31:24.988951 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c593d09-d0a3-4a62-ab18-eb9b0ef49ae7 service nova] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:31:24.989226 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c593d09-d0a3-4a62-ab18-eb9b0ef49ae7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:31:24.998351 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c593d09-d0a3-4a62-ab18-eb9b0ef49ae7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:31:25.003961 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c593d09-d0a3-4a62-ab18-eb9b0ef49ae7 service nova] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:31:25.008976 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 766/1543] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:31:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:31:27.457750 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50b941-6d0a-4074-8563-1247a22d2479 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:31:27.458195 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50b941-6d0a-4074-8563-1247a22d2479 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:31:27.458298 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50b941-6d0a-4074-8563-1247a22d2479 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:31:27.460114 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 778/1544] 10.222.0.62 () {54 vars in 960 bytes} [Tue Nov 23 19:31:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:31:27.466064 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601455d-52ac-4f55-ae02-136c82ca2a1b None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:31:27.471181 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601455d-52ac-4f55-ae02-136c82ca2a1b None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:31:27.471181 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601455d-52ac-4f55-ae02-136c82ca2a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:31:27.486315 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-f601455d-52ac-4f55-ae02-136c82ca2a1b None None] MFA Rules not processed for user `d100a378f1ff441080555bfc2ff4d6ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:31:27.487521 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-f601455d-52ac-4f55-ae02-136c82ca2a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:31:27.496839 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 767/1545] 10.222.0.62 () {58 vars in 1057 bytes} [Tue Nov 23 19:31:27 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:31:27.504557 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae50b941-6d0a-4074-8563-1247a22d2479 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:31:27.518019 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae50b941-6d0a-4074-8563-1247a22d2479 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:31:27.522828 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9dead-2739-4d70-aacf-80c4d0eae133 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd100a378f1ff441080555bfc2ff4d6ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:31:27.523480 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9dead-2739-4d70-aacf-80c4d0eae133 service placement] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:31:27.523758 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9dead-2739-4d70-aacf-80c4d0eae133 service placement] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:31:27.524033 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9dead-2739-4d70-aacf-80c4d0eae133 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:31:27.532079 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b9dead-2739-4d70-aacf-80c4d0eae133 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:31:27.533691 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b9dead-2739-4d70-aacf-80c4d0eae133 service placement] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:31:27.543430 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 779/1546] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:31:27 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:31:36.837696 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8b497-46a8-4e16-aa35-0c2779a53145 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:31:36.838210 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8b497-46a8-4e16-aa35-0c2779a53145 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:31:36.838320 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8b497-46a8-4e16-aa35-0c2779a53145 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:31:36.840616 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 768/1547] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 19:31:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:31:36.846422 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70337edd-5449-4146-b552-079ffe1e3703 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:31:36.846858 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70337edd-5449-4146-b552-079ffe1e3703 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:31:36.846963 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70337edd-5449-4146-b552-079ffe1e3703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:31:36.865105 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-70337edd-5449-4146-b552-079ffe1e3703 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:31:36.866310 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-70337edd-5449-4146-b552-079ffe1e3703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:31:36.874268 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 780/1548] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 19:31:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:31:37.029386 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8b497-46a8-4e16-aa35-0c2779a53145 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:31:37.043648 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8b497-46a8-4e16-aa35-0c2779a53145 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:31:37.048927 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09334141-a6ca-4f9a-b498-5831be9a997d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:31:37.049591 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09334141-a6ca-4f9a-b498-5831be9a997d service nova] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:31:37.049885 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09334141-a6ca-4f9a-b498-5831be9a997d service nova] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:31:37.050165 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09334141-a6ca-4f9a-b498-5831be9a997d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:31:37.058257 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09334141-a6ca-4f9a-b498-5831be9a997d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:31:37.059762 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09334141-a6ca-4f9a-b498-5831be9a997d service nova] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:31:37.068840 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 769/1549] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:31:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:31:38.460122 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b820bc-dcec-4c57-a2c8-4c194682f4fd None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:31:38.460693 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b820bc-dcec-4c57-a2c8-4c194682f4fd None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:31:38.460693 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b820bc-dcec-4c57-a2c8-4c194682f4fd None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:31:38.462528 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 781/1550] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 23 19:31:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:31:38.469016 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2bdb7-17e7-4604-a5a6-a1ffdec7fcbe None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:31:38.469487 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2bdb7-17e7-4604-a5a6-a1ffdec7fcbe None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:31:38.469616 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2bdb7-17e7-4604-a5a6-a1ffdec7fcbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:31:38.487152 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-fff2bdb7-17e7-4604-a5a6-a1ffdec7fcbe None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:31:38.488336 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-fff2bdb7-17e7-4604-a5a6-a1ffdec7fcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:31:38.495976 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 770/1551] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 23 19:31:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:31:38.651681 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b820bc-dcec-4c57-a2c8-4c194682f4fd None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:31:38.666489 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b820bc-dcec-4c57-a2c8-4c194682f4fd None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:31:38.671996 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b920824-bfee-42e9-8559-562ee779e0ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:31:38.672626 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b920824-bfee-42e9-8559-562ee779e0ac service nova] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:31:38.672908 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b920824-bfee-42e9-8559-562ee779e0ac service nova] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:31:38.673183 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b920824-bfee-42e9-8559-562ee779e0ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:31:38.681161 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b920824-bfee-42e9-8559-562ee779e0ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:31:38.682805 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b920824-bfee-42e9-8559-562ee779e0ac service nova] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:31:38.692462 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 782/1552] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:31:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:31:42.773684 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eedbc2-f4c8-4886-8b9b-a17753e15ede None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:31:42.774273 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eedbc2-f4c8-4886-8b9b-a17753e15ede None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:31:42.774273 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eedbc2-f4c8-4886-8b9b-a17753e15ede None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:31:42.776126 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 771/1553] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 19:31:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:31:42.782469 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcba49-087c-41e2-8452-b2ba4221ebdb None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:31:42.782925 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcba49-087c-41e2-8452-b2ba4221ebdb None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:31:42.783045 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcba49-087c-41e2-8452-b2ba4221ebdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:31:42.801141 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-a8dcba49-087c-41e2-8452-b2ba4221ebdb None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:31:42.802365 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-a8dcba49-087c-41e2-8452-b2ba4221ebdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:31:42.810121 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 783/1554] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 19:31:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:31:42.849549 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eedbc2-f4c8-4886-8b9b-a17753e15ede None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:31:42.851210 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-34eedbc2-f4c8-4886-8b9b-a17753e15ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:31:42.907304 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eedbc2-f4c8-4886-8b9b-a17753e15ede None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:31:42.910782 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbecf90-9c9d-48ae-92d8-50c8bb27e653 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:31:42.911414 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbecf90-9c9d-48ae-92d8-50c8bb27e653 service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:31:42.911696 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbecf90-9c9d-48ae-92d8-50c8bb27e653 service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:31:42.911998 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbecf90-9c9d-48ae-92d8-50c8bb27e653 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:31:42.921668 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbecf90-9c9d-48ae-92d8-50c8bb27e653 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:31:42.923074 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbecf90-9c9d-48ae-92d8-50c8bb27e653 service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:31:42.932074 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 772/1555] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:31:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:31:45.191394 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a80a2-62e8-419a-a879-b438c30e3e57 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:31:45.191931 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a80a2-62e8-419a-a879-b438c30e3e57 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:31:45.191931 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a80a2-62e8-419a-a879-b438c30e3e57 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:31:45.193705 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 784/1556] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 19:31:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:31:45.200197 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d7d65-4d4b-40ef-adff-4f6e8c6fd659 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:31:45.200679 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d7d65-4d4b-40ef-adff-4f6e8c6fd659 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:31:45.200777 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d7d65-4d4b-40ef-adff-4f6e8c6fd659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:31:45.218824 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-bc3d7d65-4d4b-40ef-adff-4f6e8c6fd659 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:31:45.220021 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-bc3d7d65-4d4b-40ef-adff-4f6e8c6fd659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:31:45.227628 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 773/1557] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 19:31:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:31:45.266399 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a80a2-62e8-419a-a879-b438c30e3e57 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:31:45.277131 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a80a2-62e8-419a-a879-b438c30e3e57 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:31:45.280811 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb4a22-6aa1-4cfb-887f-138dca37b55c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:31:45.281461 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb4a22-6aa1-4cfb-887f-138dca37b55c service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:31:45.281748 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb4a22-6aa1-4cfb-887f-138dca37b55c service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:31:45.282023 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb4a22-6aa1-4cfb-887f-138dca37b55c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:31:45.291168 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb4a22-6aa1-4cfb-887f-138dca37b55c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:31:45.292585 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb4a22-6aa1-4cfb-887f-138dca37b55c service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:31:45.302776 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 785/1558] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:31:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:31:48.975956 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d737f5-c06f-452f-addf-91e7491c4fcd None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:31:48.976527 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d737f5-c06f-452f-addf-91e7491c4fcd None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:31:48.976527 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d737f5-c06f-452f-addf-91e7491c4fcd None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:31:48.978364 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 774/1559] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 19:31:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:31:48.984842 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bf611-651f-4212-b241-a29e3bacfb0b None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:31:48.985292 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bf611-651f-4212-b241-a29e3bacfb0b None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:31:48.985401 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bf611-651f-4212-b241-a29e3bacfb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:31:49.003751 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-bd3bf611-651f-4212-b241-a29e3bacfb0b None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:31:49.004926 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-bd3bf611-651f-4212-b241-a29e3bacfb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:31:49.012711 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 786/1560] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 19:31:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:31:49.064449 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d737f5-c06f-452f-addf-91e7491c4fcd None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:31:49.066096 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-63d737f5-c06f-452f-addf-91e7491c4fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:31:49.123577 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d737f5-c06f-452f-addf-91e7491c4fcd None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:31:49.127166 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a785f2-6b62-47ce-8360-227cc2be46a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:31:49.127802 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a785f2-6b62-47ce-8360-227cc2be46a9 service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:31:49.128085 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a785f2-6b62-47ce-8360-227cc2be46a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:31:49.128361 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a785f2-6b62-47ce-8360-227cc2be46a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:31:49.137167 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a785f2-6b62-47ce-8360-227cc2be46a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:31:49.138616 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a785f2-6b62-47ce-8360-227cc2be46a9 service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:31:49.147742 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 775/1561] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:31:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:31:51.397662 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a053db-de38-4f98-afc2-8021d69db3f3 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:31:51.398276 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a053db-de38-4f98-afc2-8021d69db3f3 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:31:51.398276 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a053db-de38-4f98-afc2-8021d69db3f3 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:31:51.400085 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 787/1562] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 23 19:31:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:31:51.406302 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeccbeb-39fd-474c-92ff-dba65ca10319 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:31:51.406758 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeccbeb-39fd-474c-92ff-dba65ca10319 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:31:51.406866 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeccbeb-39fd-474c-92ff-dba65ca10319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:31:51.424776 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-bdeccbeb-39fd-474c-92ff-dba65ca10319 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:31:51.425999 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-bdeccbeb-39fd-474c-92ff-dba65ca10319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:31:51.433713 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 776/1563] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 23 19:31:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:31:51.483709 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cc75d-0c1c-4e39-9501-1b25098af444 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:31:51.483990 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cc75d-0c1c-4e39-9501-1b25098af444 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:31:51.484265 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cc75d-0c1c-4e39-9501-1b25098af444 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:31:51.486055 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 788/1564] 10.222.0.62 () {54 vars in 963 bytes} [Tue Nov 23 19:31:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:31:51.491436 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3213c0-1366-41dc-86bc-7e42a8077554 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:31:51.491725 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3213c0-1366-41dc-86bc-7e42a8077554 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:31:51.492002 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3213c0-1366-41dc-86bc-7e42a8077554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:31:51.511057 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-ab3213c0-1366-41dc-86bc-7e42a8077554 None None] MFA Rules not processed for user `9845615593004371a592e46701b5ece6`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:31:51.512252 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-ab3213c0-1366-41dc-86bc-7e42a8077554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:31:51.519179 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 777/1565] 10.222.0.62 () {58 vars in 1060 bytes} [Tue Nov 23 19:31:51 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:31:51.527163 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cc75d-0c1c-4e39-9501-1b25098af444 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:31:51.538310 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cc75d-0c1c-4e39-9501-1b25098af444 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:31:51.541748 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db674e-899a-4bf7-bab5-4797baea5a5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:31:51.542364 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db674e-899a-4bf7-bab5-4797baea5a5e service cinder] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:31:51.542640 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db674e-899a-4bf7-bab5-4797baea5a5e service cinder] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:31:51.542911 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db674e-899a-4bf7-bab5-4797baea5a5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:31:51.551537 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db674e-899a-4bf7-bab5-4797baea5a5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:31:51.552935 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db674e-899a-4bf7-bab5-4797baea5a5e service cinder] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:31:51.562570 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 789/1566] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:31:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:33:15.577752 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf2d9d-49d6-437a-91c4-3479de6e3a6a None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:15.578391 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba587b-9ea3-48e1-88a8-1a5e533b369b None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:15.578780 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf2d9d-49d6-437a-91c4-3479de6e3a6a None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:15.578873 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba587b-9ea3-48e1-88a8-1a5e533b369b None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:15.578956 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf2d9d-49d6-437a-91c4-3479de6e3a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:15.579042 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba587b-9ea3-48e1-88a8-1a5e533b369b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:15.603929 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-fcba587b-9ea3-48e1-88a8-1a5e533b369b None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:15.605310 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-fcba587b-9ea3-48e1-88a8-1a5e533b369b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:15.606400 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-20cf2d9d-49d6-437a-91c4-3479de6e3a6a None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:15.607565 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-20cf2d9d-49d6-437a-91c4-3479de6e3a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:15.616375 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 790/1567] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:15.618850 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 778/1568] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:15.625147 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65148c8f-cf7c-4e30-a3ab-f0a35bacdf82 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:15.625602 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65148c8f-cf7c-4e30-a3ab-f0a35bacdf82 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:15.625885 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65148c8f-cf7c-4e30-a3ab-f0a35bacdf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:15.628711 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81fcd0-75b4-46b7-8bb5-f206058170e5 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:15.629000 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81fcd0-75b4-46b7-8bb5-f206058170e5 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:15.629277 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81fcd0-75b4-46b7-8bb5-f206058170e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:15.652435 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-65148c8f-cf7c-4e30-a3ab-f0a35bacdf82 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:15.654269 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-65148c8f-cf7c-4e30-a3ab-f0a35bacdf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:15.666621 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-6a81fcd0-75b4-46b7-8bb5-f206058170e5 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:15.667840 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-6a81fcd0-75b4-46b7-8bb5-f206058170e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:15.672352 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 791/1569] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:15.674451 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53162f68-332f-4142-b767-adf9538e4d72 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:15.674838 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53162f68-332f-4142-b767-adf9538e4d72 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:15.675128 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53162f68-332f-4142-b767-adf9538e4d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:15.683346 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 779/1570] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:33:15.684308 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81fcd0-75b4-46b7-8bb5-f206058170e5 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:15.694683 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81fcd0-75b4-46b7-8bb5-f206058170e5 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:15.704447 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-53162f68-332f-4142-b767-adf9538e4d72 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:15.706686 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501a2ab-ba9d-4dc8-9db9-2703eeb8c944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:15.707209 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-53162f68-332f-4142-b767-adf9538e4d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:15.707338 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501a2ab-ba9d-4dc8-9db9-2703eeb8c944 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:15.707623 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501a2ab-ba9d-4dc8-9db9-2703eeb8c944 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:15.707891 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501a2ab-ba9d-4dc8-9db9-2703eeb8c944 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:15.708621 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501a2ab-ba9d-4dc8-9db9-2703eeb8c944 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:33:15.708923 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501a2ab-ba9d-4dc8-9db9-2703eeb8c944 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:15.712486 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501a2ab-ba9d-4dc8-9db9-2703eeb8c944 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:15.726791 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 792/1571] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:15.728352 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b5081-9251-4e6d-b2c3-960b63dbd64c None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:15.729905 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b5081-9251-4e6d-b2c3-960b63dbd64c None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:15.730643 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b5081-9251-4e6d-b2c3-960b63dbd64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:15.732762 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 780/1572] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:33:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:33:15.736061 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501a2ab-ba9d-4dc8-9db9-2703eeb8c944 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:15.747817 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501a2ab-ba9d-4dc8-9db9-2703eeb8c944 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:15.753382 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742272ed-0e41-463c-88c3-5b8398c9f068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:15.754392 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742272ed-0e41-463c-88c3-5b8398c9f068 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:15.754871 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742272ed-0e41-463c-88c3-5b8398c9f068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:15.755340 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742272ed-0e41-463c-88c3-5b8398c9f068 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:15.756259 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742272ed-0e41-463c-88c3-5b8398c9f068 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:33:15.756758 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742272ed-0e41-463c-88c3-5b8398c9f068 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:15.758639 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742272ed-0e41-463c-88c3-5b8398c9f068 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:15.759206 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-0d3b5081-9251-4e6d-b2c3-960b63dbd64c None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:15.760540 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-0d3b5081-9251-4e6d-b2c3-960b63dbd64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:15.771107 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 793/1573] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:15.772603 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0b795-d458-45bc-9684-c553421616af None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:15.772897 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0b795-d458-45bc-9684-c553421616af None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:15.773174 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0b795-d458-45bc-9684-c553421616af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:15.774856 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 781/1574] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:33:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:33:15.776552 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8aaf5-32f7-4475-a9bd-570320fda525 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:15.777073 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8aaf5-32f7-4475-a9bd-570320fda525 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:15.777601 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8aaf5-32f7-4475-a9bd-570320fda525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:15.796344 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-dbd8aaf5-32f7-4475-a9bd-570320fda525 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:15.797434 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-6bc0b795-d458-45bc-9684-c553421616af None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:15.798100 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-dbd8aaf5-32f7-4475-a9bd-570320fda525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:15.798798 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-6bc0b795-d458-45bc-9684-c553421616af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:15.813798 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 794/1575] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:15.814469 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0b795-d458-45bc-9684-c553421616af None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:15.825366 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0b795-d458-45bc-9684-c553421616af None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:15.827988 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 782/1576] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:15.829231 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6742ea-745b-4d74-8d58-a4fad92cce2e None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:15.829560 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6742ea-745b-4d74-8d58-a4fad92cce2e None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:15.829845 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6742ea-745b-4d74-8d58-a4fad92cce2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:15.831098 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02adf4-eece-4136-b0a3-4141e0d33a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:15.831836 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02adf4-eece-4136-b0a3-4141e0d33a59 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:15.832142 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02adf4-eece-4136-b0a3-4141e0d33a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:15.832393 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02adf4-eece-4136-b0a3-4141e0d33a59 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:15.833137 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02adf4-eece-4136-b0a3-4141e0d33a59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:15.835097 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02adf4-eece-4136-b0a3-4141e0d33a59 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:15.848139 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-db6742ea-745b-4d74-8d58-a4fad92cce2e None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:15.849336 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-db6742ea-745b-4d74-8d58-a4fad92cce2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:15.856998 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 783/1577] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:15.859060 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ebda4-29d7-4ceb-8bc0-2ec004d7e9f1 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:15.859376 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ebda4-29d7-4ceb-8bc0-2ec004d7e9f1 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:15.859656 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ebda4-29d7-4ceb-8bc0-2ec004d7e9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:15.879532 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-dc7ebda4-29d7-4ceb-8bc0-2ec004d7e9f1 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:15.880127 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-dc7ebda4-29d7-4ceb-8bc0-2ec004d7e9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:15.888305 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 784/1578] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:15.890248 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ebda4-29d7-4ceb-8bc0-2ec004d7e9f1 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:15.903673 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ebda4-29d7-4ceb-8bc0-2ec004d7e9f1 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:15.909463 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0ca3a-3e31-431a-93d0-e1f1637cb03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:15.910154 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0ca3a-3e31-431a-93d0-e1f1637cb03c admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:15.910462 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0ca3a-3e31-431a-93d0-e1f1637cb03c admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:15.910711 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0ca3a-3e31-431a-93d0-e1f1637cb03c admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:15.911485 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0ca3a-3e31-431a-93d0-e1f1637cb03c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:15.914018 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0ca3a-3e31-431a-93d0-e1f1637cb03c admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:16.177674 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 795/1579] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:33:15 2021] POST /identity/v3/projects => generated 365 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:16.178887 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315c134-5c3a-49f8-8330-5654c367ddfc None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:16.179191 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315c134-5c3a-49f8-8330-5654c367ddfc None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:16.179455 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315c134-5c3a-49f8-8330-5654c367ddfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:16.197584 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-9315c134-5c3a-49f8-8330-5654c367ddfc None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:16.199027 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-9315c134-5c3a-49f8-8330-5654c367ddfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:16.239710 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 785/1580] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:33:15 2021] POST /identity/v3/projects => generated 377 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:16.241021 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e22a6-03a9-4399-aec7-d2f3ceb1ee6b None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:16.241307 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e22a6-03a9-4399-aec7-d2f3ceb1ee6b None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:16.241614 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e22a6-03a9-4399-aec7-d2f3ceb1ee6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:16.257706 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 796/1581] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:16.259016 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621a6d0-2ab1-40bb-969d-ed8f00ef1280 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:16.259308 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621a6d0-2ab1-40bb-969d-ed8f00ef1280 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:16.259592 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621a6d0-2ab1-40bb-969d-ed8f00ef1280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:16.259706 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-d96e22a6-03a9-4399-aec7-d2f3ceb1ee6b None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:16.260845 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-d96e22a6-03a9-4399-aec7-d2f3ceb1ee6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:16.277098 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-e621a6d0-2ab1-40bb-969d-ed8f00ef1280 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:16.278309 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-e621a6d0-2ab1-40bb-969d-ed8f00ef1280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:16.319198 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 786/1582] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:16.319986 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e22a6-03a9-4399-aec7-d2f3ceb1ee6b None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:16.329106 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e22a6-03a9-4399-aec7-d2f3ceb1ee6b None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:16.333854 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbce39-1861-42ca-b001-9491a7408d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:16.334494 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbce39-1861-42ca-b001-9491a7408d94 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:16.334977 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbce39-1861-42ca-b001-9491a7408d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:16.335340 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbce39-1861-42ca-b001-9491a7408d94 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:16.335990 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 797/1583] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:16.341796 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fbce39-1861-42ca-b001-9491a7408d94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:33:16.341796 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fbce39-1861-42ca-b001-9491a7408d94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:16.341989 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb7545-634c-41ab-aef7-afe35ec6953c None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:16.341989 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb7545-634c-41ab-aef7-afe35ec6953c None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:16.341989 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb7545-634c-41ab-aef7-afe35ec6953c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:16.342301 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fbce39-1861-42ca-b001-9491a7408d94 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:16.359258 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 787/1584] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:33:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:33:16.359258 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbce39-1861-42ca-b001-9491a7408d94 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:16.359559 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-1acb7545-634c-41ab-aef7-afe35ec6953c None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:16.360210 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-1acb7545-634c-41ab-aef7-afe35ec6953c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:16.363268 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbce39-1861-42ca-b001-9491a7408d94 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:16.367730 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce70bf2-7bc8-41b0-82bf-87715eb92b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:16.368489 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce70bf2-7bc8-41b0-82bf-87715eb92b05 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:16.368779 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce70bf2-7bc8-41b0-82bf-87715eb92b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:16.369057 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce70bf2-7bc8-41b0-82bf-87715eb92b05 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:16.369372 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 798/1585] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:16.369823 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce70bf2-7bc8-41b0-82bf-87715eb92b05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:33:16.370131 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce70bf2-7bc8-41b0-82bf-87715eb92b05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:16.370235 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb7545-634c-41ab-aef7-afe35ec6953c None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:16.371687 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce70bf2-7bc8-41b0-82bf-87715eb92b05 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:16.379743 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb7545-634c-41ab-aef7-afe35ec6953c None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:16.384249 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 788/1586] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:33:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:33:16.384385 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c91b91-f29e-4dbf-ba50-6c817634f48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:16.384996 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c91b91-f29e-4dbf-ba50-6c817634f48b admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:16.385133 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce70bf2-7bc8-41b0-82bf-87715eb92b05 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:16.385283 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c91b91-f29e-4dbf-ba50-6c817634f48b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:16.385572 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c91b91-f29e-4dbf-ba50-6c817634f48b admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:16.386263 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c91b91-f29e-4dbf-ba50-6c817634f48b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:16.388145 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c91b91-f29e-4dbf-ba50-6c817634f48b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:16.395532 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce70bf2-7bc8-41b0-82bf-87715eb92b05 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:16.400173 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e202085-63a1-4c2c-8a77-ad146d060965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:16.400818 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e202085-63a1-4c2c-8a77-ad146d060965 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:16.401101 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e202085-63a1-4c2c-8a77-ad146d060965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:16.401377 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e202085-63a1-4c2c-8a77-ad146d060965 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:16.402129 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e202085-63a1-4c2c-8a77-ad146d060965 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:16.403985 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e202085-63a1-4c2c-8a77-ad146d060965 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:16.546742 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 799/1587] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:33:16 2021] POST /identity/v3/users => generated 283 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:16.548041 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06f8fb-c239-4ab2-8a43-50340b8215ed None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:16.548353 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06f8fb-c239-4ab2-8a43-50340b8215ed None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:16.548636 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06f8fb-c239-4ab2-8a43-50340b8215ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:16.566462 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-3c06f8fb-c239-4ab2-8a43-50340b8215ed None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:16.567657 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-3c06f8fb-c239-4ab2-8a43-50340b8215ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:16.575795 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 800/1588] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:16.576555 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06f8fb-c239-4ab2-8a43-50340b8215ed None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:16.587423 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06f8fb-c239-4ab2-8a43-50340b8215ed None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:16.588392 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 789/1589] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:33:16 2021] POST /identity/v3/users => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:16.589754 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13dbd77-e8f6-4c94-9e63-5d126e42c887 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:16.590169 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13dbd77-e8f6-4c94-9e63-5d126e42c887 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:16.590455 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13dbd77-e8f6-4c94-9e63-5d126e42c887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:16.592666 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3584d3-2019-483c-8743-ef8a1481faa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:16.593322 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3584d3-2019-483c-8743-ef8a1481faa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:16.593624 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3584d3-2019-483c-8743-ef8a1481faa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:16.593897 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3584d3-2019-483c-8743-ef8a1481faa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:16.594631 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3584d3-2019-483c-8743-ef8a1481faa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:33:16.594975 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3584d3-2019-483c-8743-ef8a1481faa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:16.597373 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3584d3-2019-483c-8743-ef8a1481faa2 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:16.608768 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-f13dbd77-e8f6-4c94-9e63-5d126e42c887 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:16.608941 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 801/1590] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:33:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:33:16.609622 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3584d3-2019-483c-8743-ef8a1481faa2 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:16.610195 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-f13dbd77-e8f6-4c94-9e63-5d126e42c887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:16.618175 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 790/1591] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:16.618974 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3584d3-2019-483c-8743-ef8a1481faa2 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:16.619096 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13dbd77-e8f6-4c94-9e63-5d126e42c887 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:16.623597 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293bfa9-1376-47e6-bb41-399c62c049ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:16.624230 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293bfa9-1376-47e6-bb41-399c62c049ba admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:16.624516 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293bfa9-1376-47e6-bb41-399c62c049ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:16.624793 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293bfa9-1376-47e6-bb41-399c62c049ba admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:16.625515 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b293bfa9-1376-47e6-bb41-399c62c049ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:16.627375 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b293bfa9-1376-47e6-bb41-399c62c049ba admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:16.628901 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13dbd77-e8f6-4c94-9e63-5d126e42c887 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:16.633507 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64757956-3c48-4a10-8f3b-610e8714b54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:16.634143 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64757956-3c48-4a10-8f3b-610e8714b54f admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:16.634519 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64757956-3c48-4a10-8f3b-610e8714b54f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:16.634799 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64757956-3c48-4a10-8f3b-610e8714b54f admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:16.635525 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64757956-3c48-4a10-8f3b-610e8714b54f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:33:16.635841 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64757956-3c48-4a10-8f3b-610e8714b54f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:16.637422 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64757956-3c48-4a10-8f3b-610e8714b54f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:16.649248 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 791/1592] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:33:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:33:16.653778 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64757956-3c48-4a10-8f3b-610e8714b54f admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:16.660193 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64757956-3c48-4a10-8f3b-610e8714b54f admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:16.664742 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2a662-edf6-4fdc-97b4-23214d5d781e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:16.665398 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2a662-edf6-4fdc-97b4-23214d5d781e admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:16.665774 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2a662-edf6-4fdc-97b4-23214d5d781e admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:16.666057 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2a662-edf6-4fdc-97b4-23214d5d781e admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:16.666749 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d2a662-edf6-4fdc-97b4-23214d5d781e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:16.668577 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d2a662-edf6-4fdc-97b4-23214d5d781e admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:16.711794 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 802/1593] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:33:16 2021] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:16.711794 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293bfa9-1376-47e6-bb41-399c62c049ba admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:16.767091 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293bfa9-1376-47e6-bb41-399c62c049ba admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:16.775069 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 792/1594] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:33:16 2021] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:16.775214 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f15d5f-0428-4f1f-968d-3833232e8e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:16.775333 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2a662-edf6-4fdc-97b4-23214d5d781e admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:16.775412 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f15d5f-0428-4f1f-968d-3833232e8e07 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:16.775412 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f15d5f-0428-4f1f-968d-3833232e8e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:16.775412 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f15d5f-0428-4f1f-968d-3833232e8e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:16.775412 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f15d5f-0428-4f1f-968d-3833232e8e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:16.775710 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f15d5f-0428-4f1f-968d-3833232e8e07 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:16.790177 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 803/1595] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:16 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:16.790177 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f15d5f-0428-4f1f-968d-3833232e8e07 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:16.798121 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f15d5f-0428-4f1f-968d-3833232e8e07 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:16.840607 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2a662-edf6-4fdc-97b4-23214d5d781e admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:16.845226 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc3eea-a30a-4956-9373-b5a3ec67e7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:16.845925 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc3eea-a30a-4956-9373-b5a3ec67e7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:16.846329 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc3eea-a30a-4956-9373-b5a3ec67e7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:16.847243 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc3eea-a30a-4956-9373-b5a3ec67e7d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:16.847985 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc3eea-a30a-4956-9373-b5a3ec67e7d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:33:16.848296 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc3eea-a30a-4956-9373-b5a3ec67e7d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:16.849903 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc3eea-a30a-4956-9373-b5a3ec67e7d5 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:16.854222 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a701b-9ef8-4fd2-8ae1-33a30d2f4656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:16.854881 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a701b-9ef8-4fd2-8ae1-33a30d2f4656 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:16.855158 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a701b-9ef8-4fd2-8ae1-33a30d2f4656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:16.855428 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a701b-9ef8-4fd2-8ae1-33a30d2f4656 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:16.856159 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a701b-9ef8-4fd2-8ae1-33a30d2f4656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:16.857803 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a701b-9ef8-4fd2-8ae1-33a30d2f4656 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:16.860876 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 793/1596] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:33:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:33:16.861940 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc3eea-a30a-4956-9373-b5a3ec67e7d5 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:16.869117 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 804/1597] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:16 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:16.869961 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a701b-9ef8-4fd2-8ae1-33a30d2f4656 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:16.879228 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc3eea-a30a-4956-9373-b5a3ec67e7d5 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:16.881427 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a701b-9ef8-4fd2-8ae1-33a30d2f4656 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:16.883900 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5050ee-35ed-468f-b611-c27278e785e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:16.884552 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5050ee-35ed-468f-b611-c27278e785e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:16.884837 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5050ee-35ed-468f-b611-c27278e785e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:16.885261 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5050ee-35ed-468f-b611-c27278e785e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:16.886002 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5050ee-35ed-468f-b611-c27278e785e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:16.886129 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff1e9a-cc69-439d-aed3-baec4d530b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:16.886770 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff1e9a-cc69-439d-aed3-baec4d530b55 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:16.887055 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff1e9a-cc69-439d-aed3-baec4d530b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:16.887333 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff1e9a-cc69-439d-aed3-baec4d530b55 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:16.887879 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5050ee-35ed-468f-b611-c27278e785e7 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:16.888092 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff1e9a-cc69-439d-aed3-baec4d530b55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:33:16.888401 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff1e9a-cc69-439d-aed3-baec4d530b55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:16.890029 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff1e9a-cc69-439d-aed3-baec4d530b55 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:16.902364 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 805/1598] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:33:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:33:16.903151 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff1e9a-cc69-439d-aed3-baec4d530b55 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:16.913056 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff1e9a-cc69-439d-aed3-baec4d530b55 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:16.917608 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a0860-3349-4ee4-9c56-466e00839c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:16.918234 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a0860-3349-4ee4-9c56-466e00839c98 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:16.918519 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a0860-3349-4ee4-9c56-466e00839c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:16.918796 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a0860-3349-4ee4-9c56-466e00839c98 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:16.919484 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a0860-3349-4ee4-9c56-466e00839c98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:16.921333 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a0860-3349-4ee4-9c56-466e00839c98 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:16.982118 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 794/1599] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:33:16 2021] POST /identity/v3/projects => generated 393 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:16.983046 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5050ee-35ed-468f-b611-c27278e785e7 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:17.011088 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 806/1600] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:33:16 2021] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:17.011881 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a0860-3349-4ee4-9c56-466e00839c98 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:17.044301 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5050ee-35ed-468f-b611-c27278e785e7 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:17.070993 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a0860-3349-4ee4-9c56-466e00839c98 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:17.075898 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf52b82-cbdf-43e1-913b-c4cf52bbafca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:17.076585 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf52b82-cbdf-43e1-913b-c4cf52bbafca admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:17.076867 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf52b82-cbdf-43e1-913b-c4cf52bbafca admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:17.077148 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf52b82-cbdf-43e1-913b-c4cf52bbafca admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:17.077882 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf52b82-cbdf-43e1-913b-c4cf52bbafca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:17.079794 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf52b82-cbdf-43e1-913b-c4cf52bbafca admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:17.098693 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b191885-4c5b-4269-b066-84a350b3c3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:17.108871 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b191885-4c5b-4269-b066-84a350b3c3e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:17.108871 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b191885-4c5b-4269-b066-84a350b3c3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:17.108871 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b191885-4c5b-4269-b066-84a350b3c3e0 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:17.108871 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b191885-4c5b-4269-b066-84a350b3c3e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:17.108871 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b191885-4c5b-4269-b066-84a350b3c3e0 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:17.182359 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 807/1601] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:33:17 2021] POST /identity/v3/users => generated 287 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:17.183207 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf52b82-cbdf-43e1-913b-c4cf52bbafca admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:17.196516 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 795/1602] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:33:16 2021] POST /identity/v3/users => generated 287 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:17.196516 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b191885-4c5b-4269-b066-84a350b3c3e0 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:17.196850 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf52b82-cbdf-43e1-913b-c4cf52bbafca admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:17.201289 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734a61f-db08-4dac-88f9-7fd52d109e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:17.206034 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734a61f-db08-4dac-88f9-7fd52d109e7b admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:17.206034 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734a61f-db08-4dac-88f9-7fd52d109e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:17.206034 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734a61f-db08-4dac-88f9-7fd52d109e7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:17.206034 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734a61f-db08-4dac-88f9-7fd52d109e7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:17.206581 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b191885-4c5b-4269-b066-84a350b3c3e0 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:17.206719 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734a61f-db08-4dac-88f9-7fd52d109e7b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:17.209112 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd35f6-4408-4544-b486-172e3ba85315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:17.209822 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd35f6-4408-4544-b486-172e3ba85315 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:17.210226 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd35f6-4408-4544-b486-172e3ba85315 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:17.210509 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd35f6-4408-4544-b486-172e3ba85315 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:17.211208 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd35f6-4408-4544-b486-172e3ba85315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:17.213179 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd35f6-4408-4544-b486-172e3ba85315 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:17.216751 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 808/1603] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:17 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:17.217597 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734a61f-db08-4dac-88f9-7fd52d109e7b admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:17.227627 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734a61f-db08-4dac-88f9-7fd52d109e7b admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:17.232336 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7d0d4-573e-4292-b5a2-1aff417e86f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:17.233003 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7d0d4-573e-4292-b5a2-1aff417e86f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:17.233288 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7d0d4-573e-4292-b5a2-1aff417e86f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:17.233595 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7d0d4-573e-4292-b5a2-1aff417e86f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:17.234347 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7d0d4-573e-4292-b5a2-1aff417e86f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:17.235945 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7d0d4-573e-4292-b5a2-1aff417e86f4 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:17.246514 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 809/1604] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:17 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:17.247286 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7d0d4-573e-4292-b5a2-1aff417e86f4 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:17.256469 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7d0d4-573e-4292-b5a2-1aff417e86f4 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:17.260975 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa3623-aaaa-4132-a4fb-973393b8a4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:17.261607 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa3623-aaaa-4132-a4fb-973393b8a4a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:17.261890 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa3623-aaaa-4132-a4fb-973393b8a4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:17.262167 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa3623-aaaa-4132-a4fb-973393b8a4a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:17.262854 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa3623-aaaa-4132-a4fb-973393b8a4a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:17.264746 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa3623-aaaa-4132-a4fb-973393b8a4a6 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:17.279694 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 796/1605] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:33:17 2021] POST /identity/v3/projects => generated 389 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:17.280592 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd35f6-4408-4544-b486-172e3ba85315 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:17.342277 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd35f6-4408-4544-b486-172e3ba85315 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:17.347607 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e34183-0439-47cc-8177-741f4002e00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:17.348516 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e34183-0439-47cc-8177-741f4002e00a admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:17.348652 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e34183-0439-47cc-8177-741f4002e00a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:17.348839 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e34183-0439-47cc-8177-741f4002e00a admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:17.349572 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e34183-0439-47cc-8177-741f4002e00a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:17.351463 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e34183-0439-47cc-8177-741f4002e00a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:17.387950 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 810/1606] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:33:17 2021] POST /identity/v3/projects => generated 387 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:17.388850 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa3623-aaaa-4132-a4fb-973393b8a4a6 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:17.444424 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 797/1607] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:33:17 2021] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:17.445678 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e34183-0439-47cc-8177-741f4002e00a admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:17.445947 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa3623-aaaa-4132-a4fb-973393b8a4a6 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:17.451051 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226be59-8536-4d31-bd88-2d3808da76eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:17.451717 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226be59-8536-4d31-bd88-2d3808da76eb admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:17.452000 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226be59-8536-4d31-bd88-2d3808da76eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:17.452276 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226be59-8536-4d31-bd88-2d3808da76eb admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:17.452975 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226be59-8536-4d31-bd88-2d3808da76eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:17.455097 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226be59-8536-4d31-bd88-2d3808da76eb admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:17.456494 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e34183-0439-47cc-8177-741f4002e00a admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:17.461199 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab7bad-a364-49d1-985b-a684213f0dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:17.461899 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab7bad-a364-49d1-985b-a684213f0dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:17.462181 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab7bad-a364-49d1-985b-a684213f0dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:17.464723 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab7bad-a364-49d1-985b-a684213f0dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:17.464723 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab7bad-a364-49d1-985b-a684213f0dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:17.464723 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab7bad-a364-49d1-985b-a684213f0dd1 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:17.475300 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 798/1608] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:17 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:17.476076 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab7bad-a364-49d1-985b-a684213f0dd1 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:17.485261 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab7bad-a364-49d1-985b-a684213f0dd1 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:17.490103 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab803c-6513-4870-9c44-3f70500e0c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:17.490719 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab803c-6513-4870-9c44-3f70500e0c11 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:17.491019 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab803c-6513-4870-9c44-3f70500e0c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:17.491270 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab803c-6513-4870-9c44-3f70500e0c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:17.491982 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab803c-6513-4870-9c44-3f70500e0c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:17.493556 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab803c-6513-4870-9c44-3f70500e0c11 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:17.503451 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 799/1609] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:17 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:17.504171 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab803c-6513-4870-9c44-3f70500e0c11 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:17.512827 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab803c-6513-4870-9c44-3f70500e0c11 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:17.517203 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c72a52-ed3e-4898-ae94-ef9a8264017a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:17.518047 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c72a52-ed3e-4898-ae94-ef9a8264017a admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:17.518932 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c72a52-ed3e-4898-ae94-ef9a8264017a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:17.519293 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c72a52-ed3e-4898-ae94-ef9a8264017a admin admin] PATH_INFO: `/v3/projects/3f785c5b833646fe8bd3d132c0f01a4c/users/00e9c953d31a48679656f22425088f18/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:17.532922 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c72a52-ed3e-4898-ae94-ef9a8264017a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f785c5b833646fe8bd3d132c0f01a4c, user_id=00e9c953d31a48679656f22425088f18, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:17.535567 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 811/1610] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:33:17 2021] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:17.535824 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c72a52-ed3e-4898-ae94-ef9a8264017a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:17.536562 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226be59-8536-4d31-bd88-2d3808da76eb admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:17.546338 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226be59-8536-4d31-bd88-2d3808da76eb admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:17.552208 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df16e6-ef1d-4a54-b5eb-fdaa090cbf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:17.553080 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df16e6-ef1d-4a54-b5eb-fdaa090cbf8e admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:17.553362 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df16e6-ef1d-4a54-b5eb-fdaa090cbf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:17.553667 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df16e6-ef1d-4a54-b5eb-fdaa090cbf8e admin admin] PATH_INFO: `/v3/projects/69ab6d68b3f1442f9785568cd27eb367/users/b034e29cb93348b38688f6f02c328cdb/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:17.568861 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df16e6-ef1d-4a54-b5eb-fdaa090cbf8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=69ab6d68b3f1442f9785568cd27eb367, user_id=b034e29cb93348b38688f6f02c328cdb, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:17.571544 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df16e6-ef1d-4a54-b5eb-fdaa090cbf8e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:17.604184 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 800/1611] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:33:17 2021] PUT /identity/v3/projects/3f785c5b833646fe8bd3d132c0f01a4c/users/00e9c953d31a48679656f22425088f18/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:17.604989 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c72a52-ed3e-4898-ae94-ef9a8264017a admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:17.622628 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 812/1612] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:33:17 2021] PUT /identity/v3/projects/69ab6d68b3f1442f9785568cd27eb367/users/b034e29cb93348b38688f6f02c328cdb/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:17.626402 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df16e6-ef1d-4a54-b5eb-fdaa090cbf8e admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:17.665538 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c72a52-ed3e-4898-ae94-ef9a8264017a admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:17.684646 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df16e6-ef1d-4a54-b5eb-fdaa090cbf8e admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:17.689038 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a61310-63ff-4cde-b7c7-a408b40ce96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:17.689730 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a61310-63ff-4cde-b7c7-a408b40ce96e admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:17.690589 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a61310-63ff-4cde-b7c7-a408b40ce96e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:17.691098 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a61310-63ff-4cde-b7c7-a408b40ce96e admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:17.691857 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a61310-63ff-4cde-b7c7-a408b40ce96e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:17.693836 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a61310-63ff-4cde-b7c7-a408b40ce96e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:17.719671 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd5b4a-4998-4eae-bdc6-5a5fb1d35bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:17.720337 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd5b4a-4998-4eae-bdc6-5a5fb1d35bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:17.720620 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd5b4a-4998-4eae-bdc6-5a5fb1d35bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:17.720897 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd5b4a-4998-4eae-bdc6-5a5fb1d35bc3 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:17.722202 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd5b4a-4998-4eae-bdc6-5a5fb1d35bc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:17.724108 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd5b4a-4998-4eae-bdc6-5a5fb1d35bc3 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:17.746038 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 813/1613] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:33:17 2021] POST /identity/v3/users => generated 294 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:17.746851 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a61310-63ff-4cde-b7c7-a408b40ce96e admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:17.756188 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a61310-63ff-4cde-b7c7-a408b40ce96e admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:17.761031 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16e060-1e0d-4a88-b0bb-81f9c35b3d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:17.761718 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16e060-1e0d-4a88-b0bb-81f9c35b3d75 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:17.762004 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16e060-1e0d-4a88-b0bb-81f9c35b3d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:17.762317 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16e060-1e0d-4a88-b0bb-81f9c35b3d75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:17.763053 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16e060-1e0d-4a88-b0bb-81f9c35b3d75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:17.764654 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16e060-1e0d-4a88-b0bb-81f9c35b3d75 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:17.774617 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 814/1614] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:17 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:17.776261 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16e060-1e0d-4a88-b0bb-81f9c35b3d75 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:17.785294 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16e060-1e0d-4a88-b0bb-81f9c35b3d75 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:17.790291 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726e905-3c6c-4e2b-b71e-5370707b260f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:17.793427 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726e905-3c6c-4e2b-b71e-5370707b260f admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:17.793427 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726e905-3c6c-4e2b-b71e-5370707b260f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:17.793427 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726e905-3c6c-4e2b-b71e-5370707b260f admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:17.793427 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0726e905-3c6c-4e2b-b71e-5370707b260f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:17.793776 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 801/1615] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:33:17 2021] POST /identity/v3/users => generated 295 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:17.793776 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd5b4a-4998-4eae-bdc6-5a5fb1d35bc3 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:17.793914 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0726e905-3c6c-4e2b-b71e-5370707b260f admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:17.803492 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd5b4a-4998-4eae-bdc6-5a5fb1d35bc3 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:17.807924 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 815/1616] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:17 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:17.807924 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726e905-3c6c-4e2b-b71e-5370707b260f admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:17.811823 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a5970-fb99-45a2-9492-fd76fb92af32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:17.812493 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a5970-fb99-45a2-9492-fd76fb92af32 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:17.812782 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a5970-fb99-45a2-9492-fd76fb92af32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:17.813056 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a5970-fb99-45a2-9492-fd76fb92af32 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:17.813869 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a5970-fb99-45a2-9492-fd76fb92af32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:17.815965 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a5970-fb99-45a2-9492-fd76fb92af32 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:17.816093 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726e905-3c6c-4e2b-b71e-5370707b260f admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:17.820652 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfaf92-91ca-45a7-9530-43591e7916eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:17.821301 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfaf92-91ca-45a7-9530-43591e7916eb admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:17.821617 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfaf92-91ca-45a7-9530-43591e7916eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:17.821895 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfaf92-91ca-45a7-9530-43591e7916eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:17.822624 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cfaf92-91ca-45a7-9530-43591e7916eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:17.824439 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cfaf92-91ca-45a7-9530-43591e7916eb admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:17.826362 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 802/1617] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:17 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:17.827577 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c874e64-cccf-4049-a4e3-eaf174d6a245 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:17.827866 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c874e64-cccf-4049-a4e3-eaf174d6a245 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:17.828142 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c874e64-cccf-4049-a4e3-eaf174d6a245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:17.836478 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 816/1618] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:17 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:17.838087 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a504e-86e1-41a3-9356-7e6a1fd3759d None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:17.838375 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a504e-86e1-41a3-9356-7e6a1fd3759d None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:17.838650 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a504e-86e1-41a3-9356-7e6a1fd3759d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:17.854345 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-7c874e64-cccf-4049-a4e3-eaf174d6a245 None None] MFA Rules not processed for user `00e9c953d31a48679656f22425088f18`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:17.854604 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-582a504e-86e1-41a3-9356-7e6a1fd3759d None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:17.855484 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-7c874e64-cccf-4049-a4e3-eaf174d6a245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:17.855752 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-582a504e-86e1-41a3-9356-7e6a1fd3759d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:17.863481 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 817/1619] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:17.864552 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a504e-86e1-41a3-9356-7e6a1fd3759d None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:17.875619 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a504e-86e1-41a3-9356-7e6a1fd3759d None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:17.881354 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94041013-c306-4be7-ad00-ae05c83f1a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:17.882053 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94041013-c306-4be7-ad00-ae05c83f1a86 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:17.882336 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94041013-c306-4be7-ad00-ae05c83f1a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:17.882613 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94041013-c306-4be7-ad00-ae05c83f1a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:17.883351 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94041013-c306-4be7-ad00-ae05c83f1a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:17.884939 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94041013-c306-4be7-ad00-ae05c83f1a86 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:17.897906 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 818/1620] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:17 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:17.897906 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94041013-c306-4be7-ad00-ae05c83f1a86 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:17.905143 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94041013-c306-4be7-ad00-ae05c83f1a86 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:17.910556 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e61f57-98cc-49bc-9c04-833618e2ce08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:17.911185 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e61f57-98cc-49bc-9c04-833618e2ce08 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:17.911465 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e61f57-98cc-49bc-9c04-833618e2ce08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:17.911753 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e61f57-98cc-49bc-9c04-833618e2ce08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:17.912472 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e61f57-98cc-49bc-9c04-833618e2ce08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:17.914126 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e61f57-98cc-49bc-9c04-833618e2ce08 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:17.921887 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 803/1621] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:17 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:17.922787 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c874e64-cccf-4049-a4e3-eaf174d6a245 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:17.927573 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 819/1622] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:17 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:17.927573 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e61f57-98cc-49bc-9c04-833618e2ce08 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:17.935162 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e61f57-98cc-49bc-9c04-833618e2ce08 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:17.935311 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c874e64-cccf-4049-a4e3-eaf174d6a245 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:17.939621 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146c1b2-3ff4-4dc9-a472-5eddd73641b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:17.939779 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86edf5-79ac-4717-a80b-a33266a86336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:17.940308 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146c1b2-3ff4-4dc9-a472-5eddd73641b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:17.940591 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146c1b2-3ff4-4dc9-a472-5eddd73641b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:17.940686 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86edf5-79ac-4717-a80b-a33266a86336 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:17.940866 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146c1b2-3ff4-4dc9-a472-5eddd73641b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:17.940968 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86edf5-79ac-4717-a80b-a33266a86336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:17.941194 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86edf5-79ac-4717-a80b-a33266a86336 admin admin] PATH_INFO: `/v3/projects/33923edb4748417790aab15a429ac0ff/users/0caceb64430f4508b9dcc8e60c318ac5/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:17.941626 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146c1b2-3ff4-4dc9-a472-5eddd73641b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:17.943320 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146c1b2-3ff4-4dc9-a472-5eddd73641b2 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:17.953342 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 804/1623] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:17 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:17.954299 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146c1b2-3ff4-4dc9-a472-5eddd73641b2 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:17.955505 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86edf5-79ac-4717-a80b-a33266a86336 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33923edb4748417790aab15a429ac0ff, user_id=0caceb64430f4508b9dcc8e60c318ac5, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:17.958211 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86edf5-79ac-4717-a80b-a33266a86336 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:17.963662 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146c1b2-3ff4-4dc9-a472-5eddd73641b2 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:17.968266 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb7656-9964-4817-ab27-a145157ed2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:17.973620 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb7656-9964-4817-ab27-a145157ed2de admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:17.973620 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb7656-9964-4817-ab27-a145157ed2de admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:17.973620 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb7656-9964-4817-ab27-a145157ed2de admin admin] PATH_INFO: `/v3/projects/141fa94a9f464d909a64362e4a068a3b/users/53a5ac4a8dab4e8f926f009e35ef8a26/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:17.984323 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb7656-9964-4817-ab27-a145157ed2de admin admin] RBAC: Authorizing `identity:create_grant(project_id=141fa94a9f464d909a64362e4a068a3b, user_id=53a5ac4a8dab4e8f926f009e35ef8a26, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:17.987647 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb7656-9964-4817-ab27-a145157ed2de admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:18.067309 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 820/1624] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:33:17 2021] PUT /identity/v3/projects/33923edb4748417790aab15a429ac0ff/users/0caceb64430f4508b9dcc8e60c318ac5/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:18.068213 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86edf5-79ac-4717-a80b-a33266a86336 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:18.078127 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 805/1625] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:33:17 2021] PUT /identity/v3/projects/141fa94a9f464d909a64362e4a068a3b/users/53a5ac4a8dab4e8f926f009e35ef8a26/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:18.082483 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb7656-9964-4817-ab27-a145157ed2de admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:18.133859 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb7656-9964-4817-ab27-a145157ed2de admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:18.135849 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86edf5-79ac-4717-a80b-a33266a86336 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:18.137622 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7a325-25af-4fe6-a504-c70ae62d2708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:18.138375 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7a325-25af-4fe6-a504-c70ae62d2708 service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:18.138670 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7a325-25af-4fe6-a504-c70ae62d2708 service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:18.138949 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7a325-25af-4fe6-a504-c70ae62d2708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:18.189992 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d874002-1be1-439d-a5d5-8a46bc763582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:18.190831 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d874002-1be1-439d-a5d5-8a46bc763582 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:18.191119 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d874002-1be1-439d-a5d5-8a46bc763582 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:18.191395 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d874002-1be1-439d-a5d5-8a46bc763582 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:18.192139 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d874002-1be1-439d-a5d5-8a46bc763582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:18.193746 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d874002-1be1-439d-a5d5-8a46bc763582 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:18.197469 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7a325-25af-4fe6-a504-c70ae62d2708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:18.199200 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7a325-25af-4fe6-a504-c70ae62d2708 service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:18.203503 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 821/1626] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:18 2021] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:18.204286 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d874002-1be1-439d-a5d5-8a46bc763582 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:18.210137 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 806/1627] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:33:18.211157 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7a325-25af-4fe6-a504-c70ae62d2708 service neutron] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:18.214224 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d874002-1be1-439d-a5d5-8a46bc763582 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:18.218988 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48a2d9-1de0-4cd9-80f1-fc33e97ff8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:18.219642 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48a2d9-1de0-4cd9-80f1-fc33e97ff8d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:18.219923 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48a2d9-1de0-4cd9-80f1-fc33e97ff8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:18.220168 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7a325-25af-4fe6-a504-c70ae62d2708 service neutron] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:18.220288 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48a2d9-1de0-4cd9-80f1-fc33e97ff8d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:18.221082 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48a2d9-1de0-4cd9-80f1-fc33e97ff8d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:18.223289 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48a2d9-1de0-4cd9-80f1-fc33e97ff8d8 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:18.226706 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aca93d-dbd2-4bc0-92db-0c69610e8366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:18.227363 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aca93d-dbd2-4bc0-92db-0c69610e8366 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:18.227646 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aca93d-dbd2-4bc0-92db-0c69610e8366 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:18.227921 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aca93d-dbd2-4bc0-92db-0c69610e8366 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:18.228624 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aca93d-dbd2-4bc0-92db-0c69610e8366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:18.230591 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aca93d-dbd2-4bc0-92db-0c69610e8366 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:18.233459 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 822/1628] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:18 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:18.234338 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48a2d9-1de0-4cd9-80f1-fc33e97ff8d8 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:18.245020 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48a2d9-1de0-4cd9-80f1-fc33e97ff8d8 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:18.249749 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a5479-839c-4a0a-acd9-7b5a60d178d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:18.251781 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a5479-839c-4a0a-acd9-7b5a60d178d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:18.251781 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a5479-839c-4a0a-acd9-7b5a60d178d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:18.251781 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a5479-839c-4a0a-acd9-7b5a60d178d6 admin admin] PATH_INFO: `/v3/projects/c15ab51e579448cfb7a4b3e4f8049687/users/4638e688aedc44e6b55166a9276a4c80/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:18.265647 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a5479-839c-4a0a-acd9-7b5a60d178d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c15ab51e579448cfb7a4b3e4f8049687, user_id=4638e688aedc44e6b55166a9276a4c80, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:18.268829 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a5479-839c-4a0a-acd9-7b5a60d178d6 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:18.314011 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 807/1629] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:33:18 2021] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:18.314984 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aca93d-dbd2-4bc0-92db-0c69610e8366 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:18.370854 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 823/1630] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:33:18 2021] PUT /identity/v3/projects/c15ab51e579448cfb7a4b3e4f8049687/users/4638e688aedc44e6b55166a9276a4c80/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:18.372992 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37d38d-740a-49e8-b7c4-cb949e29a06a None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:18.373490 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37d38d-740a-49e8-b7c4-cb949e29a06a None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:18.373925 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37d38d-740a-49e8-b7c4-cb949e29a06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:18.379931 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aca93d-dbd2-4bc0-92db-0c69610e8366 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:18.403165 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-4c37d38d-740a-49e8-b7c4-cb949e29a06a None None] MFA Rules not processed for user `0caceb64430f4508b9dcc8e60c318ac5`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:18.404361 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-4c37d38d-740a-49e8-b7c4-cb949e29a06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:18.437550 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53f11f-ee8d-4f2e-a4ec-a7aabbd816b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:18.438371 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53f11f-ee8d-4f2e-a4ec-a7aabbd816b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:18.438752 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53f11f-ee8d-4f2e-a4ec-a7aabbd816b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:18.439130 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53f11f-ee8d-4f2e-a4ec-a7aabbd816b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:18.440527 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53f11f-ee8d-4f2e-a4ec-a7aabbd816b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:18.442851 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53f11f-ee8d-4f2e-a4ec-a7aabbd816b0 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:18.454508 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 808/1631] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:18 2021] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:18.456803 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c94e10-674a-4354-b31c-38332c62005e None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:18.457073 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c94e10-674a-4354-b31c-38332c62005e None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:18.457355 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c94e10-674a-4354-b31c-38332c62005e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:18.488873 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 824/1632] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:18 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:18.489505 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37d38d-740a-49e8-b7c4-cb949e29a06a None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:18.490153 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-65c94e10-674a-4354-b31c-38332c62005e None None] MFA Rules not processed for user `53a5ac4a8dab4e8f926f009e35ef8a26`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:18.491502 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-65c94e10-674a-4354-b31c-38332c62005e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:18.500468 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37d38d-740a-49e8-b7c4-cb949e29a06a None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:18.505344 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9161d5-ee7e-4a24-a93f-4b6b3c1fbb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:18.506252 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9161d5-ee7e-4a24-a93f-4b6b3c1fbb6e admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:18.506531 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9161d5-ee7e-4a24-a93f-4b6b3c1fbb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:18.506804 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9161d5-ee7e-4a24-a93f-4b6b3c1fbb6e admin admin] PATH_INFO: `/v3/projects/90c36f903ecc4c8f9f00800e54daf910/users/bd9c5861abcd4e22b48f20cbfe98e734/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:18.523470 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9161d5-ee7e-4a24-a93f-4b6b3c1fbb6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=90c36f903ecc4c8f9f00800e54daf910, user_id=bd9c5861abcd4e22b48f20cbfe98e734, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:18.526999 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9161d5-ee7e-4a24-a93f-4b6b3c1fbb6e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:18.563369 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 809/1633] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:18 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:18.564186 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c94e10-674a-4354-b31c-38332c62005e None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:18.575046 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c94e10-674a-4354-b31c-38332c62005e None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:18.579586 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b00c4-9602-4cb2-9a9d-f638695def4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:18.580468 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b00c4-9602-4cb2-9a9d-f638695def4e admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:18.581374 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b00c4-9602-4cb2-9a9d-f638695def4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:18.581853 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b00c4-9602-4cb2-9a9d-f638695def4e admin admin] PATH_INFO: `/v3/projects/4b0a9c91e7894d16b675e67539d818d6/users/203f5f33dd5046e0897cfc299cc2caee/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:18.592365 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 825/1634] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:33:18 2021] PUT /identity/v3/projects/90c36f903ecc4c8f9f00800e54daf910/users/bd9c5861abcd4e22b48f20cbfe98e734/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:18.593165 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9161d5-ee7e-4a24-a93f-4b6b3c1fbb6e admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:18.596324 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b00c4-9602-4cb2-9a9d-f638695def4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b0a9c91e7894d16b675e67539d818d6, user_id=203f5f33dd5046e0897cfc299cc2caee, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:18.598991 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b00c4-9602-4cb2-9a9d-f638695def4e admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:18.650266 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 810/1635] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:33:18 2021] PUT /identity/v3/projects/4b0a9c91e7894d16b675e67539d818d6/users/203f5f33dd5046e0897cfc299cc2caee/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:18.651578 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdebff-e45c-49db-8653-d8e36407b480 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:18.651894 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdebff-e45c-49db-8653-d8e36407b480 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:18.652137 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdebff-e45c-49db-8653-d8e36407b480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:18.671366 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-81fdebff-e45c-49db-8653-d8e36407b480 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:18.672500 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-81fdebff-e45c-49db-8653-d8e36407b480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:18.682171 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9161d5-ee7e-4a24-a93f-4b6b3c1fbb6e admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:18.736884 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 811/1636] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:18.738545 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdebff-e45c-49db-8653-d8e36407b480 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:18.749842 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdebff-e45c-49db-8653-d8e36407b480 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:18.755155 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628f414-6779-4c0b-a898-072317b5d39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:18.756126 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628f414-6779-4c0b-a898-072317b5d39f admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:18.756476 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628f414-6779-4c0b-a898-072317b5d39f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:18.756820 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628f414-6779-4c0b-a898-072317b5d39f admin admin] PATH_INFO: `/v3/projects/2d925fb59ba34355aa85758374d76928/users/8cabe29657c04e1da5b3a13cd2cdf77e/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:18.758461 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a885bf-564a-4abd-8a57-36719640a1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:18.759467 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a885bf-564a-4abd-8a57-36719640a1a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:18.759467 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a885bf-564a-4abd-8a57-36719640a1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:18.759861 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a885bf-564a-4abd-8a57-36719640a1a2 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:18.760936 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a885bf-564a-4abd-8a57-36719640a1a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:18.764078 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a885bf-564a-4abd-8a57-36719640a1a2 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:18.772201 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628f414-6779-4c0b-a898-072317b5d39f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d925fb59ba34355aa85758374d76928, user_id=8cabe29657c04e1da5b3a13cd2cdf77e, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:18.781517 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628f414-6779-4c0b-a898-072317b5d39f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:18.884871 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 826/1637] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:33:18 2021] POST /identity/v3/users => generated 289 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:18.886151 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09c07a-d97c-40f5-8690-64763634839f None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:18.886442 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09c07a-d97c-40f5-8690-64763634839f None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:18.886716 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09c07a-d97c-40f5-8690-64763634839f None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:18.888405 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 827/1638] 10.222.0.62 () {54 vars in 961 bytes} [Tue Nov 23 19:33:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:33:18.889682 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e28210-10d9-4cd5-beb7-fdc22f8fe362 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:18.889967 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e28210-10d9-4cd5-beb7-fdc22f8fe362 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:18.890242 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e28210-10d9-4cd5-beb7-fdc22f8fe362 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:18.897559 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 828/1639] 10.222.0.62 () {54 vars in 961 bytes} [Tue Nov 23 19:33:18 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:33:18.899052 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf6feb-8247-4a54-b7bb-f7896911c621 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:18.899340 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf6feb-8247-4a54-b7bb-f7896911c621 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:18.899620 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf6feb-8247-4a54-b7bb-f7896911c621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:18.914749 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 812/1640] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:33:18 2021] PUT /identity/v3/projects/2d925fb59ba34355aa85758374d76928/users/8cabe29657c04e1da5b3a13cd2cdf77e/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:18.919594 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b844c5-5e92-4d85-825a-479c70518813 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:18.919882 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b844c5-5e92-4d85-825a-479c70518813 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:18.920157 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b844c5-5e92-4d85-825a-479c70518813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:18.929176 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-1daf6feb-8247-4a54-b7bb-f7896911c621 None None] MFA Rules not processed for user `bd9c5861abcd4e22b48f20cbfe98e734`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:18.930440 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-1daf6feb-8247-4a54-b7bb-f7896911c621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:18.952562 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-82b844c5-5e92-4d85-825a-479c70518813 None None] MFA Rules not processed for user `203f5f33dd5046e0897cfc299cc2caee`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:18.953796 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-82b844c5-5e92-4d85-825a-479c70518813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:18.998236 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 829/1641] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:18 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:18.999325 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf6feb-8247-4a54-b7bb-f7896911c621 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:19.000608 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-1daf6feb-8247-4a54-b7bb-f7896911c621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:19.017731 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 813/1642] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:18 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:19.019553 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b844c5-5e92-4d85-825a-479c70518813 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:19.059525 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf6feb-8247-4a54-b7bb-f7896911c621 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:19.063508 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4717e5e-c5da-4c9f-aa31-0c7e6945799e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:19.064175 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4717e5e-c5da-4c9f-aa31-0c7e6945799e service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:19.064468 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4717e5e-c5da-4c9f-aa31-0c7e6945799e service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:19.064748 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4717e5e-c5da-4c9f-aa31-0c7e6945799e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:19.084956 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b844c5-5e92-4d85-825a-479c70518813 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:19.090187 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70beb9-3c5d-4bbe-a8b9-ffae25fabb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:19.090979 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70beb9-3c5d-4bbe-a8b9-ffae25fabb43 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:19.091139 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70beb9-3c5d-4bbe-a8b9-ffae25fabb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:19.091481 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70beb9-3c5d-4bbe-a8b9-ffae25fabb43 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:19.092158 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70beb9-3c5d-4bbe-a8b9-ffae25fabb43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:19.093780 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70beb9-3c5d-4bbe-a8b9-ffae25fabb43 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:19.109627 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 814/1643] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:19 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:19.109627 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bca2c-7e6d-4173-86c9-842371a1cddb None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:19.109627 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bca2c-7e6d-4173-86c9-842371a1cddb None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:19.109627 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bca2c-7e6d-4173-86c9-842371a1cddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:19.127343 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-130bca2c-7e6d-4173-86c9-842371a1cddb None None] MFA Rules not processed for user `6d91fe7f996b48b0bc28e1eadc4f8869`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:19.128680 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-130bca2c-7e6d-4173-86c9-842371a1cddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:19.135561 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4717e5e-c5da-4c9f-aa31-0c7e6945799e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:19.136990 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4717e5e-c5da-4c9f-aa31-0c7e6945799e service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:19.147369 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 830/1644] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:33:19.148701 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d975adc-7e90-4947-b5c4-970c8cb8c7c6 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:19.148983 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d975adc-7e90-4947-b5c4-970c8cb8c7c6 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:19.149252 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d975adc-7e90-4947-b5c4-970c8cb8c7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:19.166625 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-1d975adc-7e90-4947-b5c4-970c8cb8c7c6 None None] MFA Rules not processed for user `6d91fe7f996b48b0bc28e1eadc4f8869`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:19.167890 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-1d975adc-7e90-4947-b5c4-970c8cb8c7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:19.210387 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 815/1645] 10.222.0.62 () {58 vars in 1058 bytes} [Tue Nov 23 19:33:19 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:19.211754 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d129cd-d5dc-42c3-bf1b-71781ecc46c0 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:19.212146 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d129cd-d5dc-42c3-bf1b-71781ecc46c0 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:19.212428 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d129cd-d5dc-42c3-bf1b-71781ecc46c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:19.230856 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-78d129cd-d5dc-42c3-bf1b-71781ecc46c0 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:19.232083 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-78d129cd-d5dc-42c3-bf1b-71781ecc46c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:19.238934 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 831/1646] 10.222.0.62 () {58 vars in 1058 bytes} [Tue Nov 23 19:33:19 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:19.239736 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d975adc-7e90-4947-b5c4-970c8cb8c7c6 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:19.240171 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 816/1647] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:19.240926 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d129cd-d5dc-42c3-bf1b-71781ecc46c0 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:19.252226 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d975adc-7e90-4947-b5c4-970c8cb8c7c6 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:19.253510 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d129cd-d5dc-42c3-bf1b-71781ecc46c0 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:19.257181 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128ef96-74b9-4eef-b649-e8efa15a90ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:19.257854 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128ef96-74b9-4eef-b649-e8efa15a90ea admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:19.258135 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128ef96-74b9-4eef-b649-e8efa15a90ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:19.259783 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06106b-cdcb-404f-9ac5-d2d9ce01a6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:19.259893 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128ef96-74b9-4eef-b649-e8efa15a90ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:19.259893 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128ef96-74b9-4eef-b649-e8efa15a90ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:19.260038 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06106b-cdcb-404f-9ac5-d2d9ce01a6df admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:19.260038 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06106b-cdcb-404f-9ac5-d2d9ce01a6df admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:19.260038 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06106b-cdcb-404f-9ac5-d2d9ce01a6df admin admin] PATH_INFO: `/v3/projects/b85fbc4d72d54c95847f8e04dc7cb64d/users/b6d7f210e55b409f8108e3c7a70ce69e/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:19.260944 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128ef96-74b9-4eef-b649-e8efa15a90ea admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:19.274582 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06106b-cdcb-404f-9ac5-d2d9ce01a6df admin admin] RBAC: Authorizing `identity:create_grant(project_id=b85fbc4d72d54c95847f8e04dc7cb64d, user_id=b6d7f210e55b409f8108e3c7a70ce69e, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:19.277295 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06106b-cdcb-404f-9ac5-d2d9ce01a6df admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:19.358866 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 832/1648] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:33:19 2021] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:19.358866 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128ef96-74b9-4eef-b649-e8efa15a90ea admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:19.413868 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 817/1649] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:33:19 2021] PUT /identity/v3/projects/b85fbc4d72d54c95847f8e04dc7cb64d/users/b6d7f210e55b409f8108e3c7a70ce69e/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:19.413868 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06106b-cdcb-404f-9ac5-d2d9ce01a6df admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:19.444288 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128ef96-74b9-4eef-b649-e8efa15a90ea admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:19.511773 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06106b-cdcb-404f-9ac5-d2d9ce01a6df admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:19.525166 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030ea0e-6a32-4296-aab0-84a112c2f4ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:19.525166 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030ea0e-6a32-4296-aab0-84a112c2f4ac service nova] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:19.525166 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030ea0e-6a32-4296-aab0-84a112c2f4ac service nova] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:19.525166 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030ea0e-6a32-4296-aab0-84a112c2f4ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:19.550223 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecc037-2809-4ee6-982d-e21494f7796c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:19.551028 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecc037-2809-4ee6-982d-e21494f7796c service nova] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:19.551364 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecc037-2809-4ee6-982d-e21494f7796c service nova] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:19.551715 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecc037-2809-4ee6-982d-e21494f7796c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:19.613678 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030ea0e-6a32-4296-aab0-84a112c2f4ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:19.615329 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030ea0e-6a32-4296-aab0-84a112c2f4ac service nova] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:19.624919 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 818/1650] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:19 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:33:19.625586 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030ea0e-6a32-4296-aab0-84a112c2f4ac service nova] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:19.639616 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ecc037-2809-4ee6-982d-e21494f7796c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:19.641926 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ecc037-2809-4ee6-982d-e21494f7796c service nova] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:19.653914 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 833/1651] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:19 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:33:19.654755 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecc037-2809-4ee6-982d-e21494f7796c service nova] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:19.707988 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030ea0e-6a32-4296-aab0-84a112c2f4ac service nova] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:19.712274 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b8fce-50ab-4fc4-a3cc-192c26a67a19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:19.713007 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b8fce-50ab-4fc4-a3cc-192c26a67a19 service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:19.713370 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b8fce-50ab-4fc4-a3cc-192c26a67a19 service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:19.713781 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b8fce-50ab-4fc4-a3cc-192c26a67a19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:19.728308 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecc037-2809-4ee6-982d-e21494f7796c service nova] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:19.733485 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e69e30-abee-488a-93c0-97f948120077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:19.734153 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e69e30-abee-488a-93c0-97f948120077 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:19.734434 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e69e30-abee-488a-93c0-97f948120077 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:19.734706 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e69e30-abee-488a-93c0-97f948120077 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:19.735405 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e69e30-abee-488a-93c0-97f948120077 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:19.738167 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e69e30-abee-488a-93c0-97f948120077 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:19.782730 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b8fce-50ab-4fc4-a3cc-192c26a67a19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:19.787599 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b8fce-50ab-4fc4-a3cc-192c26a67a19 service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:19.800017 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 819/1652] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:33:19.800934 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b8fce-50ab-4fc4-a3cc-192c26a67a19 service neutron] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:19.813576 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b8fce-50ab-4fc4-a3cc-192c26a67a19 service neutron] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:19.817764 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc835115-f2d9-4de6-8028-f635702e0c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:19.818811 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc835115-f2d9-4de6-8028-f635702e0c9d admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:19.819535 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc835115-f2d9-4de6-8028-f635702e0c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:19.820040 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc835115-f2d9-4de6-8028-f635702e0c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:19.820984 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc835115-f2d9-4de6-8028-f635702e0c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:19.823030 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc835115-f2d9-4de6-8028-f635702e0c9d admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:19.836571 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 820/1653] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:19 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:19.838983 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c34e9-89b2-4611-b3e7-7dc5cfcbee81 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:19.844732 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c34e9-89b2-4611-b3e7-7dc5cfcbee81 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:19.844732 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c34e9-89b2-4611-b3e7-7dc5cfcbee81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:19.844962 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 834/1654] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:33:19 2021] POST /identity/v3/users => generated 294 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:19.849740 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e69e30-abee-488a-93c0-97f948120077 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:19.862488 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e69e30-abee-488a-93c0-97f948120077 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:19.867327 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab679972-2341-439d-8521-685dd3422f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:19.868215 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab679972-2341-439d-8521-685dd3422f8b admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:19.868491 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab679972-2341-439d-8521-685dd3422f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:19.868759 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab679972-2341-439d-8521-685dd3422f8b admin admin] PATH_INFO: `/v3/projects/b85fbc4d72d54c95847f8e04dc7cb64d/users/b6d7f210e55b409f8108e3c7a70ce69e/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:19.872127 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab679972-2341-439d-8521-685dd3422f8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b85fbc4d72d54c95847f8e04dc7cb64d, user_id=b6d7f210e55b409f8108e3c7a70ce69e, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:19.874357 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-2b3c34e9-89b2-4611-b3e7-7dc5cfcbee81 None None] MFA Rules not processed for user `b034e29cb93348b38688f6f02c328cdb`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:19.875549 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-2b3c34e9-89b2-4611-b3e7-7dc5cfcbee81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:19.880800 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab679972-2341-439d-8521-685dd3422f8b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:19.908535 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 835/1655] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:33:19 2021] PUT /identity/v3/projects/b85fbc4d72d54c95847f8e04dc7cb64d/users/b6d7f210e55b409f8108e3c7a70ce69e/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:19.919558 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab679972-2341-439d-8521-685dd3422f8b admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:19.987631 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 821/1656] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:19 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:19.989285 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c4ff4-0d78-4aa6-b1ee-1e0ade8381d6 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:19.990458 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c4ff4-0d78-4aa6-b1ee-1e0ade8381d6 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:19.990721 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c4ff4-0d78-4aa6-b1ee-1e0ade8381d6 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:19.996007 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 822/1657] 10.222.0.62 () {54 vars in 912 bytes} [Tue Nov 23 19:33:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:33:19.998574 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd523ad-e9f9-4290-9f26-a54690dca379 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:19.999008 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd523ad-e9f9-4290-9f26-a54690dca379 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:19.999291 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd523ad-e9f9-4290-9f26-a54690dca379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:20.017388 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab679972-2341-439d-8521-685dd3422f8b admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:20.024077 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b4a06-23e3-421d-8f2e-0f39f3f99c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:20.025002 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b4a06-23e3-421d-8f2e-0f39f3f99c9f admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:20.025293 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b4a06-23e3-421d-8f2e-0f39f3f99c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:20.025607 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b4a06-23e3-421d-8f2e-0f39f3f99c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:20.026395 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b4a06-23e3-421d-8f2e-0f39f3f99c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:20.027990 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b4a06-23e3-421d-8f2e-0f39f3f99c9f admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:20.028132 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-5bd523ad-e9f9-4290-9f26-a54690dca379 None None] MFA Rules not processed for user `b6d7f210e55b409f8108e3c7a70ce69e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:20.029348 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-5bd523ad-e9f9-4290-9f26-a54690dca379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:20.040197 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 836/1658] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:19 2021] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:20.041187 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b4a06-23e3-421d-8f2e-0f39f3f99c9f admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:20.108842 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 823/1659] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:19 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:20.111127 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650df1cd-b424-448f-89ec-0e99208b1792 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:20.111127 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650df1cd-b424-448f-89ec-0e99208b1792 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:20.111434 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650df1cd-b424-448f-89ec-0e99208b1792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:20.131602 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b4a06-23e3-421d-8f2e-0f39f3f99c9f admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:20.133558 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-650df1cd-b424-448f-89ec-0e99208b1792 None None] MFA Rules not processed for user `6d91fe7f996b48b0bc28e1eadc4f8869`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:20.133672 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-650df1cd-b424-448f-89ec-0e99208b1792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:20.138725 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b5a00-0e17-42be-bed7-d9bef938e85c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:20.139381 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b5a00-0e17-42be-bed7-d9bef938e85c service nova] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:20.139657 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b5a00-0e17-42be-bed7-d9bef938e85c service nova] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:20.139929 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b5a00-0e17-42be-bed7-d9bef938e85c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:20.143977 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 824/1660] 10.222.0.62 () {58 vars in 1009 bytes} [Tue Nov 23 19:33:20 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:20.145946 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafafb0-6442-4bf8-830c-2016ecc59dd6 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:20.146297 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafafb0-6442-4bf8-830c-2016ecc59dd6 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:20.146650 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafafb0-6442-4bf8-830c-2016ecc59dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:20.172850 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-9dafafb0-6442-4bf8-830c-2016ecc59dd6 None None] MFA Rules not processed for user `b034e29cb93348b38688f6f02c328cdb`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:20.174892 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-9dafafb0-6442-4bf8-830c-2016ecc59dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:20.232549 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b5a00-0e17-42be-bed7-d9bef938e85c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:20.234393 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b5a00-0e17-42be-bed7-d9bef938e85c service nova] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:20.247062 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 837/1661] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:20 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:33:20.247623 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 825/1662] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:20 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:20.247980 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b5a00-0e17-42be-bed7-d9bef938e85c service nova] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:20.253737 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafafb0-6442-4bf8-830c-2016ecc59dd6 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:20.260733 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b5a00-0e17-42be-bed7-d9bef938e85c service nova] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:20.266530 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b2b11-842a-46b6-aa05-fc04294fb232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:20.267389 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b2b11-842a-46b6-aa05-fc04294fb232 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:20.267727 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b2b11-842a-46b6-aa05-fc04294fb232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:20.268059 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b2b11-842a-46b6-aa05-fc04294fb232 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:20.269608 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b2b11-842a-46b6-aa05-fc04294fb232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:20.271498 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b2b11-842a-46b6-aa05-fc04294fb232 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:20.287360 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 838/1663] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:20 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:20.288504 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b2b11-842a-46b6-aa05-fc04294fb232 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:20.327775 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafafb0-6442-4bf8-830c-2016ecc59dd6 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:20.332152 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4075c-8abb-4ab1-86c4-ccebe80d177d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:20.332857 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4075c-8abb-4ab1-86c4-ccebe80d177d service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:20.338832 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4075c-8abb-4ab1-86c4-ccebe80d177d service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:20.338832 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4075c-8abb-4ab1-86c4-ccebe80d177d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:20.343083 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4075c-8abb-4ab1-86c4-ccebe80d177d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:20.344505 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4075c-8abb-4ab1-86c4-ccebe80d177d service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:20.355345 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b2b11-842a-46b6-aa05-fc04294fb232 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:20.355635 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 826/1664] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:20 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:33:20.356223 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4075c-8abb-4ab1-86c4-ccebe80d177d service cinder] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:20.374777 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ba64d-12bd-4546-8ceb-357feb841a9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:20.374777 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ba64d-12bd-4546-8ceb-357feb841a9a service cinder] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:20.374777 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ba64d-12bd-4546-8ceb-357feb841a9a service cinder] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:20.374777 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ba64d-12bd-4546-8ceb-357feb841a9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:20.375123 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4075c-8abb-4ab1-86c4-ccebe80d177d service cinder] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:20.375123 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7594ad-4680-4ca8-a1f5-d6f6760b218a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:20.375123 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7594ad-4680-4ca8-a1f5-d6f6760b218a admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:20.375123 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7594ad-4680-4ca8-a1f5-d6f6760b218a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:20.375563 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7594ad-4680-4ca8-a1f5-d6f6760b218a admin admin] PATH_INFO: `/v3/projects/07548b25b4604684bb008b31cc4aea18/users/384aa4a772f4473aae3b6d37fa039822/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:20.378805 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ba64d-12bd-4546-8ceb-357feb841a9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:20.380273 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ba64d-12bd-4546-8ceb-357feb841a9a service cinder] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:20.389208 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7594ad-4680-4ca8-a1f5-d6f6760b218a admin admin] RBAC: Authorizing `identity:create_grant(project_id=07548b25b4604684bb008b31cc4aea18, user_id=384aa4a772f4473aae3b6d37fa039822, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:20.392298 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 839/1665] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:20 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:33:20.397663 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331242a0-17aa-492c-9e22-6febbfe77103 None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:20.397663 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331242a0-17aa-492c-9e22-6febbfe77103 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:20.397663 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331242a0-17aa-492c-9e22-6febbfe77103 None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:20.398764 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7594ad-4680-4ca8-a1f5-d6f6760b218a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:20.398874 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 840/1666] 10.222.0.62 () {54 vars in 912 bytes} [Tue Nov 23 19:33:20 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:33:20.405737 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae96ab-3f1b-4ad6-9d4c-dc5ddd80fc55 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:20.406129 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae96ab-3f1b-4ad6-9d4c-dc5ddd80fc55 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:20.406622 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae96ab-3f1b-4ad6-9d4c-dc5ddd80fc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:20.426427 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-c3ae96ab-3f1b-4ad6-9d4c-dc5ddd80fc55 None None] MFA Rules not processed for user `6d91fe7f996b48b0bc28e1eadc4f8869`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:20.427764 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-c3ae96ab-3f1b-4ad6-9d4c-dc5ddd80fc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:20.437302 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 841/1667] 10.222.0.62 () {58 vars in 1009 bytes} [Tue Nov 23 19:33:20 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:33:20.494514 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae96ab-3f1b-4ad6-9d4c-dc5ddd80fc55 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:20.507835 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae96ab-3f1b-4ad6-9d4c-dc5ddd80fc55 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:20.522378 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 827/1668] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:33:20 2021] PUT /identity/v3/projects/07548b25b4604684bb008b31cc4aea18/users/384aa4a772f4473aae3b6d37fa039822/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:20.524745 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cee8c6-3018-4bb4-9666-0c9118c2324e None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:20.525034 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cee8c6-3018-4bb4-9666-0c9118c2324e None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:20.525365 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cee8c6-3018-4bb4-9666-0c9118c2324e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:20.583190 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-81cee8c6-3018-4bb4-9666-0c9118c2324e None None] MFA Rules not processed for user `384aa4a772f4473aae3b6d37fa039822`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:20.584892 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-81cee8c6-3018-4bb4-9666-0c9118c2324e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:20.602322 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981ca51-15c0-4d3b-b55e-01639e2f09db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:20.602980 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981ca51-15c0-4d3b-b55e-01639e2f09db service cinder] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:20.603261 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981ca51-15c0-4d3b-b55e-01639e2f09db service cinder] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:20.603531 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981ca51-15c0-4d3b-b55e-01639e2f09db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:20.663862 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 828/1669] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:20 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:20.668221 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cee8c6-3018-4bb4-9666-0c9118c2324e None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:20.673681 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981ca51-15c0-4d3b-b55e-01639e2f09db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:20.676141 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981ca51-15c0-4d3b-b55e-01639e2f09db service cinder] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:20.695668 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 842/1670] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:20 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:33:20.756559 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cee8c6-3018-4bb4-9666-0c9118c2324e None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:20.772784 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701b30f-a880-46c8-9748-e012a926ba7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:20.773487 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701b30f-a880-46c8-9748-e012a926ba7d admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:20.776280 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701b30f-a880-46c8-9748-e012a926ba7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:20.776605 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701b30f-a880-46c8-9748-e012a926ba7d admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:20.777342 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a701b30f-a880-46c8-9748-e012a926ba7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:20.779295 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a701b30f-a880-46c8-9748-e012a926ba7d admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:20.864451 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 829/1671] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:33:20 2021] POST /identity/v3/projects => generated 387 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:20.868428 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981ca51-15c0-4d3b-b55e-01639e2f09db service cinder] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:20.881049 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981ca51-15c0-4d3b-b55e-01639e2f09db service cinder] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:20.976688 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c2bc3-2118-470c-a45a-e66fe04cc18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:20.977443 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c2bc3-2118-470c-a45a-e66fe04cc18c admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:20.978839 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c2bc3-2118-470c-a45a-e66fe04cc18c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:20.979134 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c2bc3-2118-470c-a45a-e66fe04cc18c admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:20.981124 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c2bc3-2118-470c-a45a-e66fe04cc18c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:20.985731 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c2bc3-2118-470c-a45a-e66fe04cc18c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:21.078158 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 843/1672] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:33:20 2021] POST /identity/v3/users => generated 300 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:33:21.078884 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701b30f-a880-46c8-9748-e012a926ba7d admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:21.091502 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701b30f-a880-46c8-9748-e012a926ba7d admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:21.095256 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf30479-1757-4855-95b4-f05e61c6c456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:21.095934 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf30479-1757-4855-95b4-f05e61c6c456 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:21.096220 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf30479-1757-4855-95b4-f05e61c6c456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:21.096614 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf30479-1757-4855-95b4-f05e61c6c456 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:21.097365 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf30479-1757-4855-95b4-f05e61c6c456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:21.098976 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf30479-1757-4855-95b4-f05e61c6c456 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:21.110362 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 830/1673] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:21 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:33:21.115053 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c2bc3-2118-470c-a45a-e66fe04cc18c admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:21.124712 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c2bc3-2118-470c-a45a-e66fe04cc18c admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:21.129793 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da545331-b21d-48ab-9138-3b71417bd22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:21.130661 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da545331-b21d-48ab-9138-3b71417bd22c admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:21.130940 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da545331-b21d-48ab-9138-3b71417bd22c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:21.131212 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da545331-b21d-48ab-9138-3b71417bd22c admin admin] PATH_INFO: `/v3/projects/c1409c65f74f477498196c51abaf49d0/users/0f960df5d21243aabd9a680a58170952/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:21.145992 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da545331-b21d-48ab-9138-3b71417bd22c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1409c65f74f477498196c51abaf49d0, user_id=0f960df5d21243aabd9a680a58170952, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:21.148649 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da545331-b21d-48ab-9138-3b71417bd22c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:21.222565 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 844/1674] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:33:21 2021] PUT /identity/v3/projects/c1409c65f74f477498196c51abaf49d0/users/0f960df5d21243aabd9a680a58170952/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:33:21.226463 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf30479-1757-4855-95b4-f05e61c6c456 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:21.237794 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf30479-1757-4855-95b4-f05e61c6c456 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:21.376984 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedc6a2-563f-4a83-a741-9cce7adf0965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:21.377845 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedc6a2-563f-4a83-a741-9cce7adf0965 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:21.378483 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedc6a2-563f-4a83-a741-9cce7adf0965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:21.378483 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedc6a2-563f-4a83-a741-9cce7adf0965 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:21.379220 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dedc6a2-563f-4a83-a741-9cce7adf0965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:21.380904 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dedc6a2-563f-4a83-a741-9cce7adf0965 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:21.391777 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 831/1675] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:21 2021] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:21.396877 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da545331-b21d-48ab-9138-3b71417bd22c admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:21.408092 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da545331-b21d-48ab-9138-3b71417bd22c admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:21.415264 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee55299-15c7-4461-8fd8-f116e73e089c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:21.417263 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee55299-15c7-4461-8fd8-f116e73e089c admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:21.417806 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee55299-15c7-4461-8fd8-f116e73e089c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:21.418321 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee55299-15c7-4461-8fd8-f116e73e089c admin admin] PATH_INFO: `/v3/projects/c1409c65f74f477498196c51abaf49d0/users/0f960df5d21243aabd9a680a58170952/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:21.420981 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee55299-15c7-4461-8fd8-f116e73e089c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1409c65f74f477498196c51abaf49d0, user_id=0f960df5d21243aabd9a680a58170952, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:21.425184 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee55299-15c7-4461-8fd8-f116e73e089c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:21.436945 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 845/1676] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:33:21 2021] PUT /identity/v3/projects/c1409c65f74f477498196c51abaf49d0/users/0f960df5d21243aabd9a680a58170952/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:33:21.493347 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4184bd9-f71b-434c-8f02-3c86043bfe9d None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:21.493969 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4184bd9-f71b-434c-8f02-3c86043bfe9d None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:21.494422 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4184bd9-f71b-434c-8f02-3c86043bfe9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:21.543611 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-c4184bd9-f71b-434c-8f02-3c86043bfe9d None None] MFA Rules not processed for user `0f960df5d21243aabd9a680a58170952`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:21.545269 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-c4184bd9-f71b-434c-8f02-3c86043bfe9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:21.640494 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee55299-15c7-4461-8fd8-f116e73e089c admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:21.695443 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 832/1677] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:21 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:21.695443 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4184bd9-f71b-434c-8f02-3c86043bfe9d None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:21.755469 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee55299-15c7-4461-8fd8-f116e73e089c admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:21.760711 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080dc437-7630-45a2-a730-49173e77778d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:21.761906 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dc437-7630-45a2-a730-49173e77778d service cinder] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:21.762347 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dc437-7630-45a2-a730-49173e77778d service cinder] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:21.784563 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dc437-7630-45a2-a730-49173e77778d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:21.882386 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080dc437-7630-45a2-a730-49173e77778d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:21.883882 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080dc437-7630-45a2-a730-49173e77778d service cinder] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:21.895355 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 846/1678] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:21 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:33:21.897701 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080dc437-7630-45a2-a730-49173e77778d service cinder] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:21.904895 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080dc437-7630-45a2-a730-49173e77778d service cinder] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:21.914047 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb95f0-0f8d-459d-bce1-fe2390454e18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:21.914721 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb95f0-0f8d-459d-bce1-fe2390454e18 service cinder] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:21.915006 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb95f0-0f8d-459d-bce1-fe2390454e18 service cinder] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:21.915288 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb95f0-0f8d-459d-bce1-fe2390454e18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:21.928669 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4184bd9-f71b-434c-8f02-3c86043bfe9d None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:21.936738 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb95f0-0f8d-459d-bce1-fe2390454e18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:21.943301 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb95f0-0f8d-459d-bce1-fe2390454e18 service cinder] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:21.950074 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3b1fc-99ea-46bf-8d86-6e3117eabff8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:21.951256 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3b1fc-99ea-46bf-8d86-6e3117eabff8 service nova] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:21.951702 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3b1fc-99ea-46bf-8d86-6e3117eabff8 service nova] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:21.952387 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3b1fc-99ea-46bf-8d86-6e3117eabff8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:21.961660 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 847/1679] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:21 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:33:22.125200 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3b1fc-99ea-46bf-8d86-6e3117eabff8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:22.128956 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3b1fc-99ea-46bf-8d86-6e3117eabff8 service nova] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:22.149484 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 833/1680] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:21 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:33:22.720181 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb95f0-0f8d-459d-bce1-fe2390454e18 service cinder] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:22.949115 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb95f0-0f8d-459d-bce1-fe2390454e18 service cinder] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:22.949115 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080db41-75a7-401a-8233-188522c6fe05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:22.949115 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080db41-75a7-401a-8233-188522c6fe05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:22.949115 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080db41-75a7-401a-8233-188522c6fe05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:22.950655 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080db41-75a7-401a-8233-188522c6fe05 admin admin] PATH_INFO: `/v3/users/0caceb64430f4508b9dcc8e60c318ac5` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:22.950655 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080db41-75a7-401a-8233-188522c6fe05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0caceb64430f4508b9dcc8e60c318ac5)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:22.950655 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080db41-75a7-401a-8233-188522c6fe05 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:22.951096 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580905bc-2700-448e-afab-c52530d05876 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:22.951096 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580905bc-2700-448e-afab-c52530d05876 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:22.951096 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580905bc-2700-448e-afab-c52530d05876 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:22.951096 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 834/1681] 10.222.0.62 () {54 vars in 912 bytes} [Tue Nov 23 19:33:22 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:33:22.951096 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9c7f1-2e29-40ae-99a9-419adf5c6986 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:22.951096 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9c7f1-2e29-40ae-99a9-419adf5c6986 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:22.951848 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9c7f1-2e29-40ae-99a9-419adf5c6986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:22.951848 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-b3b9c7f1-2e29-40ae-99a9-419adf5c6986 None None] MFA Rules not processed for user `f1ef2ac0a788451eb50fa80f559f808f`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:22.951848 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-b3b9c7f1-2e29-40ae-99a9-419adf5c6986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:23.016825 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 835/1682] 10.222.0.62 () {58 vars in 1009 bytes} [Tue Nov 23 19:33:22 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:33:23.118956 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-c080db41-75a7-401a-8233-188522c6fe05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0caceb64430f4508b9dcc8e60c318ac5'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:23.120037 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-c080db41-75a7-401a-8233-188522c6fe05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0caceb64430f4508b9dcc8e60c318ac5'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:23.130469 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-c080db41-75a7-401a-8233-188522c6fe05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0caceb64430f4508b9dcc8e60c318ac5'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:23.131652 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-c080db41-75a7-401a-8233-188522c6fe05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0caceb64430f4508b9dcc8e60c318ac5'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:23.146406 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-c080db41-75a7-401a-8233-188522c6fe05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0caceb64430f4508b9dcc8e60c318ac5'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:23.162819 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b9c7f1-2e29-40ae-99a9-419adf5c6986 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:23.171514 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b9c7f1-2e29-40ae-99a9-419adf5c6986 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:23.176422 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621ec81-380b-4acc-8977-f559e5638225 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:23.177261 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621ec81-380b-4acc-8977-f559e5638225 service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:23.177600 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621ec81-380b-4acc-8977-f559e5638225 service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:23.177879 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621ec81-380b-4acc-8977-f559e5638225 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:23.180994 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-1621ec81-380b-4acc-8977-f559e5638225 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:23.198896 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621ec81-380b-4acc-8977-f559e5638225 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:23.200854 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621ec81-380b-4acc-8977-f559e5638225 service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:23.214015 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 836/1683] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:23 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:33:23.219170 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 848/1684] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:33:22 2021] DELETE /identity/v3/users/0caceb64430f4508b9dcc8e60c318ac5 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:23.223793 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee960c-2a55-4e1c-8cf7-18820a127498 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:23.224329 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee960c-2a55-4e1c-8cf7-18820a127498 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:23.224762 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee960c-2a55-4e1c-8cf7-18820a127498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:23.251055 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-bcee960c-2a55-4e1c-8cf7-18820a127498 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:23.252490 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-bcee960c-2a55-4e1c-8cf7-18820a127498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:23.369785 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 837/1685] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:23.384179 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080db41-75a7-401a-8233-188522c6fe05 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:23.386075 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-c080db41-75a7-401a-8233-188522c6fe05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:23.557279 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080db41-75a7-401a-8233-188522c6fe05 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:23.563565 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e8451-11ec-4570-9344-f2b2fd9cae37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:23.564934 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e8451-11ec-4570-9344-f2b2fd9cae37 service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:23.564934 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e8451-11ec-4570-9344-f2b2fd9cae37 service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:23.564934 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e8451-11ec-4570-9344-f2b2fd9cae37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:23.584655 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e8451-11ec-4570-9344-f2b2fd9cae37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:23.584655 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e8451-11ec-4570-9344-f2b2fd9cae37 service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:23.593394 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 849/1686] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:33:23.692380 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee960c-2a55-4e1c-8cf7-18820a127498 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:23.694200 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-bcee960c-2a55-4e1c-8cf7-18820a127498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:23.855920 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee960c-2a55-4e1c-8cf7-18820a127498 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:23.867074 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69efb8c-332c-440b-9d80-870234a3ab5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:23.867764 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69efb8c-332c-440b-9d80-870234a3ab5c service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:23.868051 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69efb8c-332c-440b-9d80-870234a3ab5c service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:23.868331 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69efb8c-332c-440b-9d80-870234a3ab5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:23.882536 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-e69efb8c-332c-440b-9d80-870234a3ab5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:23.992818 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69efb8c-332c-440b-9d80-870234a3ab5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:23.994515 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69efb8c-332c-440b-9d80-870234a3ab5c service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:24.006889 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 838/1687] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:23 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:33:24.427370 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e8451-11ec-4570-9344-f2b2fd9cae37 service neutron] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:24.429572 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-a48e8451-11ec-4570-9344-f2b2fd9cae37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:24.522832 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69efb8c-332c-440b-9d80-870234a3ab5c service cinder] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:24.524542 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-e69efb8c-332c-440b-9d80-870234a3ab5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:24.556189 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69efb8c-332c-440b-9d80-870234a3ab5c service cinder] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:24.576139 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493cb90-e26a-421d-90f1-fccf973509dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:24.577367 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493cb90-e26a-421d-90f1-fccf973509dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:24.577777 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493cb90-e26a-421d-90f1-fccf973509dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:24.578156 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493cb90-e26a-421d-90f1-fccf973509dd admin admin] PATH_INFO: `/v3/projects/33923edb4748417790aab15a429ac0ff` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:24.579591 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e493cb90-e26a-421d-90f1-fccf973509dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=33923edb4748417790aab15a429ac0ff)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:24.584865 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e493cb90-e26a-421d-90f1-fccf973509dd admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:24.626045 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e8451-11ec-4570-9344-f2b2fd9cae37 service neutron] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:24.635123 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28845c-e346-474a-b478-c5573ab026d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd100a378f1ff441080555bfc2ff4d6ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:24.635955 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28845c-e346-474a-b478-c5573ab026d7 service placement] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:24.636303 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28845c-e346-474a-b478-c5573ab026d7 service placement] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:24.636986 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28845c-e346-474a-b478-c5573ab026d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:24.641241 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-9d28845c-e346-474a-b478-c5573ab026d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:24.671651 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28845c-e346-474a-b478-c5573ab026d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:24.675298 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28845c-e346-474a-b478-c5573ab026d7 service placement] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:24.693844 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 850/1688] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:24 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:33:24.764882 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-e493cb90-e26a-421d-90f1-fccf973509dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33923edb4748417790aab15a429ac0ff', 'request_id': 'req-e493cb90-e26a-421d-90f1-fccf973509dd'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:24.793617 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-e493cb90-e26a-421d-90f1-fccf973509dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33923edb4748417790aab15a429ac0ff', 'request_id': 'req-e493cb90-e26a-421d-90f1-fccf973509dd'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:24.817116 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-e493cb90-e26a-421d-90f1-fccf973509dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33923edb4748417790aab15a429ac0ff', 'request_id': 'req-e493cb90-e26a-421d-90f1-fccf973509dd'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:24.963834 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-e493cb90-e26a-421d-90f1-fccf973509dd admin admin] The token cache is being invalidate because project 33923edb4748417790aab15a429ac0ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:33:24.964393 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-e493cb90-e26a-421d-90f1-fccf973509dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:24.966156 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-e493cb90-e26a-421d-90f1-fccf973509dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:24.967430 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 839/1689] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:33:24 2021] DELETE /identity/v3/projects/33923edb4748417790aab15a429ac0ff => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:24.974063 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938cb0f4-79bd-4df6-8fd1-1406ebd2a189 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:24.974363 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938cb0f4-79bd-4df6-8fd1-1406ebd2a189 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:24.974645 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938cb0f4-79bd-4df6-8fd1-1406ebd2a189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:25.016508 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-938cb0f4-79bd-4df6-8fd1-1406ebd2a189 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:25.019254 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-938cb0f4-79bd-4df6-8fd1-1406ebd2a189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:25.127179 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 851/1690] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:25.128823 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ded15-e84a-4406-b4a4-7e32fc1d9f43 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:25.128823 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ded15-e84a-4406-b4a4-7e32fc1d9f43 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:25.130093 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ded15-e84a-4406-b4a4-7e32fc1d9f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:25.172209 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-8a9ded15-e84a-4406-b4a4-7e32fc1d9f43 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:25.176379 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-8a9ded15-e84a-4406-b4a4-7e32fc1d9f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:25.198092 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 840/1691] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:33:25.203616 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938cb0f4-79bd-4df6-8fd1-1406ebd2a189 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:25.215358 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938cb0f4-79bd-4df6-8fd1-1406ebd2a189 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:25.248355 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d06cdf-70fd-49d2-9056-3c90de3dd208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:25.249253 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d06cdf-70fd-49d2-9056-3c90de3dd208 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:25.249555 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d06cdf-70fd-49d2-9056-3c90de3dd208 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:25.250094 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d06cdf-70fd-49d2-9056-3c90de3dd208 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:25.250722 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d06cdf-70fd-49d2-9056-3c90de3dd208 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:33:25.251532 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d06cdf-70fd-49d2-9056-3c90de3dd208 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:25.253175 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d06cdf-70fd-49d2-9056-3c90de3dd208 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:25.278026 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 852/1692] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:33:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:33:25.278477 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ded15-e84a-4406-b4a4-7e32fc1d9f43 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:25.290454 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ded15-e84a-4406-b4a4-7e32fc1d9f43 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:25.299301 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbec68-f3a3-4181-8061-0a2669af2146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:25.300476 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbec68-f3a3-4181-8061-0a2669af2146 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:25.300763 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbec68-f3a3-4181-8061-0a2669af2146 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:25.301382 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbec68-f3a3-4181-8061-0a2669af2146 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:25.302245 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cbec68-f3a3-4181-8061-0a2669af2146 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:25.304137 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cbec68-f3a3-4181-8061-0a2669af2146 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:25.325779 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d06cdf-70fd-49d2-9056-3c90de3dd208 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:25.327862 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-b7d06cdf-70fd-49d2-9056-3c90de3dd208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:25.367214 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d06cdf-70fd-49d2-9056-3c90de3dd208 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:25.404275 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f722d-b3f5-4d89-ac02-39d6bc308ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:25.404275 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f722d-b3f5-4d89-ac02-39d6bc308ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:25.404275 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f722d-b3f5-4d89-ac02-39d6bc308ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:25.404275 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f722d-b3f5-4d89-ac02-39d6bc308ed5 admin admin] PATH_INFO: `/v3/users/53a5ac4a8dab4e8f926f009e35ef8a26` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:25.405671 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f722d-b3f5-4d89-ac02-39d6bc308ed5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53a5ac4a8dab4e8f926f009e35ef8a26)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:25.407844 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f722d-b3f5-4d89-ac02-39d6bc308ed5 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:25.429626 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 841/1693] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:33:25 2021] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:25.436702 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbec68-f3a3-4181-8061-0a2669af2146 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:25.676233 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbec68-f3a3-4181-8061-0a2669af2146 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:25.695364 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c636a-cded-47e5-ad8c-17104f8297e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:25.700345 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c636a-cded-47e5-ad8c-17104f8297e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:25.700650 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c636a-cded-47e5-ad8c-17104f8297e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:25.700931 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c636a-cded-47e5-ad8c-17104f8297e8 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:25.701689 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c636a-cded-47e5-ad8c-17104f8297e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:25.708085 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c636a-cded-47e5-ad8c-17104f8297e8 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:25.726512 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-0a1f722d-b3f5-4d89-ac02-39d6bc308ed5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53a5ac4a8dab4e8f926f009e35ef8a26'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:25.727353 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-0a1f722d-b3f5-4d89-ac02-39d6bc308ed5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53a5ac4a8dab4e8f926f009e35ef8a26'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:25.746261 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-0a1f722d-b3f5-4d89-ac02-39d6bc308ed5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53a5ac4a8dab4e8f926f009e35ef8a26'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:25.746991 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-0a1f722d-b3f5-4d89-ac02-39d6bc308ed5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53a5ac4a8dab4e8f926f009e35ef8a26'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:25.794418 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-0a1f722d-b3f5-4d89-ac02-39d6bc308ed5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53a5ac4a8dab4e8f926f009e35ef8a26'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:25.852676 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 842/1694] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:33:25 2021] POST /identity/v3/users => generated 293 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:33:25.857120 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c636a-cded-47e5-ad8c-17104f8297e8 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:25.859120 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-7c6c636a-cded-47e5-ad8c-17104f8297e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:25.879969 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c636a-cded-47e5-ad8c-17104f8297e8 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:25.891966 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 853/1695] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:33:25 2021] DELETE /identity/v3/users/53a5ac4a8dab4e8f926f009e35ef8a26 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:33:25.897786 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5bafd-a41a-481f-bf30-28af7ff21baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:25.898025 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c592f-0fa5-4fc1-9600-bff56d456757 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:25.898165 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c592f-0fa5-4fc1-9600-bff56d456757 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:25.898616 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c592f-0fa5-4fc1-9600-bff56d456757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:25.898755 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5bafd-a41a-481f-bf30-28af7ff21baf admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:25.898916 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5bafd-a41a-481f-bf30-28af7ff21baf admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:25.899204 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5bafd-a41a-481f-bf30-28af7ff21baf admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:25.899945 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5bafd-a41a-481f-bf30-28af7ff21baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:25.901906 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5bafd-a41a-481f-bf30-28af7ff21baf admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:25.924136 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 843/1696] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:25 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:33:25.931271 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5bafd-a41a-481f-bf30-28af7ff21baf admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:25.934474 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-db9c592f-0fa5-4fc1-9600-bff56d456757 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:25.941287 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-db9c592f-0fa5-4fc1-9600-bff56d456757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:25.943477 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5bafd-a41a-481f-bf30-28af7ff21baf admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:26.069291 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132c8a5-c169-400f-a87a-2bc239b13378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:26.070019 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132c8a5-c169-400f-a87a-2bc239b13378 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:26.070306 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132c8a5-c169-400f-a87a-2bc239b13378 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:26.070593 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132c8a5-c169-400f-a87a-2bc239b13378 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:26.071345 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132c8a5-c169-400f-a87a-2bc239b13378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:26.072968 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132c8a5-c169-400f-a87a-2bc239b13378 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:26.122755 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 844/1697] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:25 2021] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:26.122755 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132c8a5-c169-400f-a87a-2bc239b13378 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:26.123545 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 854/1698] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:26.146067 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132c8a5-c169-400f-a87a-2bc239b13378 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:26.165079 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392514be-d0f1-46dc-a42e-fbe5ef2f74f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:26.166027 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392514be-d0f1-46dc-a42e-fbe5ef2f74f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:26.166315 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392514be-d0f1-46dc-a42e-fbe5ef2f74f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:26.166597 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392514be-d0f1-46dc-a42e-fbe5ef2f74f9 admin admin] PATH_INFO: `/v3/projects/e336b3b6f4df41f59c8bf29d15c75be0/users/586e35d22d144d629673099869e71087/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:26.199059 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392514be-d0f1-46dc-a42e-fbe5ef2f74f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e336b3b6f4df41f59c8bf29d15c75be0, user_id=586e35d22d144d629673099869e71087, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:26.202414 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c592f-0fa5-4fc1-9600-bff56d456757 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:26.204435 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-db9c592f-0fa5-4fc1-9600-bff56d456757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:26.214141 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392514be-d0f1-46dc-a42e-fbe5ef2f74f9 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:26.280906 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c592f-0fa5-4fc1-9600-bff56d456757 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:26.285440 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0771c8d-09e1-47d4-9ee8-bca9e0b8c82b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:26.286247 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0771c8d-09e1-47d4-9ee8-bca9e0b8c82b service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:26.286644 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0771c8d-09e1-47d4-9ee8-bca9e0b8c82b service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:26.287267 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0771c8d-09e1-47d4-9ee8-bca9e0b8c82b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:26.298021 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0771c8d-09e1-47d4-9ee8-bca9e0b8c82b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:26.301074 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0771c8d-09e1-47d4-9ee8-bca9e0b8c82b service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:26.317551 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 855/1699] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:33:26.328595 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 845/1700] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:33:26 2021] PUT /identity/v3/projects/e336b3b6f4df41f59c8bf29d15c75be0/users/586e35d22d144d629673099869e71087/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:26.394799 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7dcd9-06ea-4a86-959a-f01c90800c4b None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:26.399946 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7dcd9-06ea-4a86-959a-f01c90800c4b None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:26.399946 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7dcd9-06ea-4a86-959a-f01c90800c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:26.458922 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-6bc7dcd9-06ea-4a86-959a-f01c90800c4b None None] MFA Rules not processed for user `586e35d22d144d629673099869e71087`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:26.463000 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-6bc7dcd9-06ea-4a86-959a-f01c90800c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:26.623194 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 856/1701] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:26 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:26.628054 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392514be-d0f1-46dc-a42e-fbe5ef2f74f9 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:26.779804 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392514be-d0f1-46dc-a42e-fbe5ef2f74f9 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:26.793573 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cc6f6-3046-4673-b4a9-3a3ff6b96b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:26.795067 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cc6f6-3046-4673-b4a9-3a3ff6b96b68 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:26.795551 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cc6f6-3046-4673-b4a9-3a3ff6b96b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:26.795842 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cc6f6-3046-4673-b4a9-3a3ff6b96b68 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:26.796519 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cc6f6-3046-4673-b4a9-3a3ff6b96b68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:26.798654 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cc6f6-3046-4673-b4a9-3a3ff6b96b68 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:26.953573 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 846/1702] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:33:26 2021] POST /identity/v3/projects => generated 385 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:26.959200 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7dcd9-06ea-4a86-959a-f01c90800c4b None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:26.995536 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7dcd9-06ea-4a86-959a-f01c90800c4b None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:27.162500 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8c258-f964-4c98-afab-0dd5dd372e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:27.163515 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8c258-f964-4c98-afab-0dd5dd372e1d admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:27.163971 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8c258-f964-4c98-afab-0dd5dd372e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:27.164423 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8c258-f964-4c98-afab-0dd5dd372e1d admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:27.165147 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e8c258-f964-4c98-afab-0dd5dd372e1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:27.167281 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e8c258-f964-4c98-afab-0dd5dd372e1d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:27.283246 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 857/1703] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:33:26 2021] POST /identity/v3/users => generated 299 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:27.287776 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cc6f6-3046-4673-b4a9-3a3ff6b96b68 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:27.309719 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cc6f6-3046-4673-b4a9-3a3ff6b96b68 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:27.321044 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d874e4-145a-4f6e-a322-ecd0b113081a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:27.323377 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d874e4-145a-4f6e-a322-ecd0b113081a admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:27.325084 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d874e4-145a-4f6e-a322-ecd0b113081a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:27.325675 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d874e4-145a-4f6e-a322-ecd0b113081a admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:27.326659 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d874e4-145a-4f6e-a322-ecd0b113081a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:27.328659 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d874e4-145a-4f6e-a322-ecd0b113081a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:27.360489 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 847/1704] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:27 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:27.362949 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8c258-f964-4c98-afab-0dd5dd372e1d admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:27.377310 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8c258-f964-4c98-afab-0dd5dd372e1d admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:27.399685 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a76d9-8d2f-4085-8f5d-3859bae08664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:27.402113 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a76d9-8d2f-4085-8f5d-3859bae08664 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:27.402417 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a76d9-8d2f-4085-8f5d-3859bae08664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:27.402888 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a76d9-8d2f-4085-8f5d-3859bae08664 admin admin] PATH_INFO: `/v3/projects/19ebf3e474f549dbb7ef60b75089e9d7/users/4ba1e492c3b642f38723ca3040c8a5d1/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:27.447011 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a76d9-8d2f-4085-8f5d-3859bae08664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19ebf3e474f549dbb7ef60b75089e9d7, user_id=4ba1e492c3b642f38723ca3040c8a5d1, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:27.451617 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a76d9-8d2f-4085-8f5d-3859bae08664 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:27.556077 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 858/1705] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:33:27 2021] PUT /identity/v3/projects/19ebf3e474f549dbb7ef60b75089e9d7/users/4ba1e492c3b642f38723ca3040c8a5d1/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:27.560047 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d874e4-145a-4f6e-a322-ecd0b113081a admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:27.571736 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d874e4-145a-4f6e-a322-ecd0b113081a admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:27.822795 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd6d2d-edc1-478c-bd66-6e6fdd31a9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:27.822795 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd6d2d-edc1-478c-bd66-6e6fdd31a9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:27.822795 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd6d2d-edc1-478c-bd66-6e6fdd31a9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:27.822795 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd6d2d-edc1-478c-bd66-6e6fdd31a9b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:27.825016 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd6d2d-edc1-478c-bd66-6e6fdd31a9b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:27.825016 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd6d2d-edc1-478c-bd66-6e6fdd31a9b7 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:27.825016 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 848/1706] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:27 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:27.826006 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a76d9-8d2f-4085-8f5d-3859bae08664 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:27.827188 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd6d2d-edc1-478c-bd66-6e6fdd31a9b7 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:27.827497 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a76d9-8d2f-4085-8f5d-3859bae08664 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:27.827768 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-d5cd6d2d-edc1-478c-bd66-6e6fdd31a9b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:27.828927 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734cc68-4d99-4e48-8b10-42b78ec8de23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:27.828927 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734cc68-4d99-4e48-8b10-42b78ec8de23 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:27.828927 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734cc68-4d99-4e48-8b10-42b78ec8de23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:27.828927 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734cc68-4d99-4e48-8b10-42b78ec8de23 admin admin] PATH_INFO: `/v3/projects/19ebf3e474f549dbb7ef60b75089e9d7/users/4ba1e492c3b642f38723ca3040c8a5d1/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:27.829777 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd6d2d-edc1-478c-bd66-6e6fdd31a9b7 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:27.830064 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7734cc68-4d99-4e48-8b10-42b78ec8de23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19ebf3e474f549dbb7ef60b75089e9d7, user_id=4ba1e492c3b642f38723ca3040c8a5d1, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:27.830064 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7734cc68-4d99-4e48-8b10-42b78ec8de23 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:27.830315 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc52c86-0976-4d56-a510-e04bacf73f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:27.830315 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc52c86-0976-4d56-a510-e04bacf73f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:27.830315 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc52c86-0976-4d56-a510-e04bacf73f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:27.830315 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc52c86-0976-4d56-a510-e04bacf73f79 admin admin] PATH_INFO: `/v3/projects/141fa94a9f464d909a64362e4a068a3b` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:27.831503 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc52c86-0976-4d56-a510-e04bacf73f79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=141fa94a9f464d909a64362e4a068a3b)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:27.831503 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc52c86-0976-4d56-a510-e04bacf73f79 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:27.831772 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 859/1707] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:33:27 2021] PUT /identity/v3/projects/19ebf3e474f549dbb7ef60b75089e9d7/users/4ba1e492c3b642f38723ca3040c8a5d1/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:27.831772 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561f976-ed5e-4b29-8e49-569b8d29cba6 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:27.831772 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561f976-ed5e-4b29-8e49-569b8d29cba6 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:27.831772 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561f976-ed5e-4b29-8e49-569b8d29cba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:27.875868 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-1561f976-ed5e-4b29-8e49-569b8d29cba6 None None] MFA Rules not processed for user `4ba1e492c3b642f38723ca3040c8a5d1`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:27.877107 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-1561f976-ed5e-4b29-8e49-569b8d29cba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:27.934759 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-ffc52c86-0976-4d56-a510-e04bacf73f79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '141fa94a9f464d909a64362e4a068a3b', 'request_id': 'req-ffc52c86-0976-4d56-a510-e04bacf73f79'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:27.949556 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-ffc52c86-0976-4d56-a510-e04bacf73f79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '141fa94a9f464d909a64362e4a068a3b', 'request_id': 'req-ffc52c86-0976-4d56-a510-e04bacf73f79'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:27.969978 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-ffc52c86-0976-4d56-a510-e04bacf73f79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '141fa94a9f464d909a64362e4a068a3b', 'request_id': 'req-ffc52c86-0976-4d56-a510-e04bacf73f79'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:28.033257 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 860/1708] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:27 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:28.042162 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561f976-ed5e-4b29-8e49-569b8d29cba6 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:28.044554 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-1561f976-ed5e-4b29-8e49-569b8d29cba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:28.096221 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-ffc52c86-0976-4d56-a510-e04bacf73f79 admin admin] The token cache is being invalidate because project 141fa94a9f464d909a64362e4a068a3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:33:28.096221 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-ffc52c86-0976-4d56-a510-e04bacf73f79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:28.096221 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-ffc52c86-0976-4d56-a510-e04bacf73f79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:28.098298 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 849/1709] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:33:27 2021] DELETE /identity/v3/projects/141fa94a9f464d909a64362e4a068a3b => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:28.103639 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31184b40-8a83-429b-b53b-563b267c04f2 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:28.104696 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31184b40-8a83-429b-b53b-563b267c04f2 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:28.105435 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31184b40-8a83-429b-b53b-563b267c04f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:28.156354 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-31184b40-8a83-429b-b53b-563b267c04f2 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:28.159822 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-31184b40-8a83-429b-b53b-563b267c04f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:28.169508 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561f976-ed5e-4b29-8e49-569b8d29cba6 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:28.268125 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e052a9-73d5-400e-a657-9b02a003db1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:28.269081 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e052a9-73d5-400e-a657-9b02a003db1b service cinder] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:28.270935 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e052a9-73d5-400e-a657-9b02a003db1b service cinder] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:28.271631 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e052a9-73d5-400e-a657-9b02a003db1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:28.292699 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-82e052a9-73d5-400e-a657-9b02a003db1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:28.331888 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 850/1710] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:28.333648 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62344dbe-7422-48c2-a080-3ab785f2466d None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:28.335751 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62344dbe-7422-48c2-a080-3ab785f2466d None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:28.337613 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62344dbe-7422-48c2-a080-3ab785f2466d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:28.367040 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-62344dbe-7422-48c2-a080-3ab785f2466d None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:28.368241 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-62344dbe-7422-48c2-a080-3ab785f2466d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:28.384317 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 851/1711] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:28.394053 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be348143-6293-4031-b224-f386c0e9b95d None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:28.394804 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be348143-6293-4031-b224-f386c0e9b95d None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:28.395239 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be348143-6293-4031-b224-f386c0e9b95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:28.421471 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e052a9-73d5-400e-a657-9b02a003db1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:28.422946 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e052a9-73d5-400e-a657-9b02a003db1b service cinder] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:28.458227 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 861/1712] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:28 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:33:28.459410 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e052a9-73d5-400e-a657-9b02a003db1b service cinder] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:28.460972 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-be348143-6293-4031-b224-f386c0e9b95d None None] MFA Rules not processed for user `4638e688aedc44e6b55166a9276a4c80`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:28.462347 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-be348143-6293-4031-b224-f386c0e9b95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:28.494038 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e052a9-73d5-400e-a657-9b02a003db1b service cinder] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:28.510966 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5678bf4-a5f5-4ee1-a529-311b55e7dbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:28.510966 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5678bf4-a5f5-4ee1-a529-311b55e7dbf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:28.511212 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5678bf4-a5f5-4ee1-a529-311b55e7dbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:28.515539 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5678bf4-a5f5-4ee1-a529-311b55e7dbf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:28.516565 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5678bf4-a5f5-4ee1-a529-311b55e7dbf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:33:28.516886 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5678bf4-a5f5-4ee1-a529-311b55e7dbf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:28.518756 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5678bf4-a5f5-4ee1-a529-311b55e7dbf9 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:28.544681 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 862/1713] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:33:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:33:28.546205 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5678bf4-a5f5-4ee1-a529-311b55e7dbf9 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:28.553461 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-f5678bf4-a5f5-4ee1-a529-311b55e7dbf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:28.570200 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5678bf4-a5f5-4ee1-a529-311b55e7dbf9 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:28.575559 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce067f-9d91-412b-89db-8f0fc4bd769d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:28.576655 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce067f-9d91-412b-89db-8f0fc4bd769d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:28.576941 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce067f-9d91-412b-89db-8f0fc4bd769d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:28.577221 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce067f-9d91-412b-89db-8f0fc4bd769d admin admin] PATH_INFO: `/v3/users/586e35d22d144d629673099869e71087` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:28.578655 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce067f-9d91-412b-89db-8f0fc4bd769d admin admin] RBAC: Authorizing `identity:delete_user(user_id=586e35d22d144d629673099869e71087)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:28.580574 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce067f-9d91-412b-89db-8f0fc4bd769d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:28.598210 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 852/1714] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:28 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:28.598972 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be348143-6293-4031-b224-f386c0e9b95d None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:28.642787 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be348143-6293-4031-b224-f386c0e9b95d None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:28.655629 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1cdd6-d71b-4c68-ba8a-16a36800ffe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:28.656330 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1cdd6-d71b-4c68-ba8a-16a36800ffe5 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:28.656757 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1cdd6-d71b-4c68-ba8a-16a36800ffe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:28.657041 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1cdd6-d71b-4c68-ba8a-16a36800ffe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:28.657805 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1cdd6-d71b-4c68-ba8a-16a36800ffe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:28.661051 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1cdd6-d71b-4c68-ba8a-16a36800ffe5 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:28.782943 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 853/1715] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:33:28 2021] POST /identity/v3/projects => generated 387 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:28.783446 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3013ad-c715-40ce-a537-0d03e128de52 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:28.784583 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3013ad-c715-40ce-a537-0d03e128de52 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:28.785098 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3013ad-c715-40ce-a537-0d03e128de52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:28.807380 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-63ce067f-9d91-412b-89db-8f0fc4bd769d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '586e35d22d144d629673099869e71087'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:28.810484 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-63ce067f-9d91-412b-89db-8f0fc4bd769d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '586e35d22d144d629673099869e71087'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:28.816966 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-8a3013ad-c715-40ce-a537-0d03e128de52 None None] MFA Rules not processed for user `4638e688aedc44e6b55166a9276a4c80`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:28.818941 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-8a3013ad-c715-40ce-a537-0d03e128de52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:28.820938 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-63ce067f-9d91-412b-89db-8f0fc4bd769d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '586e35d22d144d629673099869e71087'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:28.821861 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-63ce067f-9d91-412b-89db-8f0fc4bd769d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '586e35d22d144d629673099869e71087'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:28.841561 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-63ce067f-9d91-412b-89db-8f0fc4bd769d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '586e35d22d144d629673099869e71087'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:28.915569 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 854/1716] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:28 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:28.915569 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3013ad-c715-40ce-a537-0d03e128de52 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:28.915569 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-8a3013ad-c715-40ce-a537-0d03e128de52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:28.924190 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 863/1717] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:33:28 2021] DELETE /identity/v3/users/586e35d22d144d629673099869e71087 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:28.926421 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce067f-9d91-412b-89db-8f0fc4bd769d admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:28.930880 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-63ce067f-9d91-412b-89db-8f0fc4bd769d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:29.050611 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3013ad-c715-40ce-a537-0d03e128de52 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:29.066912 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce067f-9d91-412b-89db-8f0fc4bd769d admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:29.091299 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723dd94-a361-48b5-b333-85661707f137 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:29.096188 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723dd94-a361-48b5-b333-85661707f137 service nova] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:29.096188 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723dd94-a361-48b5-b333-85661707f137 service nova] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:29.096188 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723dd94-a361-48b5-b333-85661707f137 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:29.103190 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-e723dd94-a361-48b5-b333-85661707f137 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:29.136858 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132dc761-459a-43e0-853e-201e657e8fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:29.138622 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dc761-459a-43e0-853e-201e657e8fcb admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:29.138943 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dc761-459a-43e0-853e-201e657e8fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:29.139817 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dc761-459a-43e0-853e-201e657e8fcb admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:29.140980 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132dc761-459a-43e0-853e-201e657e8fcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:29.143199 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132dc761-459a-43e0-853e-201e657e8fcb admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:29.236545 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e723dd94-a361-48b5-b333-85661707f137 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:29.238198 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e723dd94-a361-48b5-b333-85661707f137 service nova] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:29.250816 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 855/1718] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:33:28 2021] POST /identity/v3/users => generated 294 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:29.252349 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aaff4b-bdd9-495a-8e4c-d7b5447afa48 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:29.253232 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aaff4b-bdd9-495a-8e4c-d7b5447afa48 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:29.253552 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aaff4b-bdd9-495a-8e4c-d7b5447afa48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:29.277098 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 864/1719] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:28 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:33:29.279643 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723dd94-a361-48b5-b333-85661707f137 service nova] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:29.303946 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723dd94-a361-48b5-b333-85661707f137 service nova] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:29.310057 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ed1c5-f6c2-4bad-9ab3-bcdd01ab8aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:29.311064 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ed1c5-f6c2-4bad-9ab3-bcdd01ab8aba admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:29.311567 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ed1c5-f6c2-4bad-9ab3-bcdd01ab8aba admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:29.312097 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ed1c5-f6c2-4bad-9ab3-bcdd01ab8aba admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:29.313349 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ed1c5-f6c2-4bad-9ab3-bcdd01ab8aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:29.314860 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-04aaff4b-bdd9-495a-8e4c-d7b5447afa48 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:29.316925 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-04aaff4b-bdd9-495a-8e4c-d7b5447afa48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:29.318592 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ed1c5-f6c2-4bad-9ab3-bcdd01ab8aba admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:29.339316 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 856/1720] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:29.353926 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aaff4b-bdd9-495a-8e4c-d7b5447afa48 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:29.355638 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-04aaff4b-bdd9-495a-8e4c-d7b5447afa48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:29.415176 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 865/1721] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:29 2021] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:29.416630 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ed1c5-f6c2-4bad-9ab3-bcdd01ab8aba admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:29.436370 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ed1c5-f6c2-4bad-9ab3-bcdd01ab8aba admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:29.449091 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58013db-6b97-4e21-aef5-b677384b8acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:29.450224 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58013db-6b97-4e21-aef5-b677384b8acf admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:29.451641 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58013db-6b97-4e21-aef5-b677384b8acf admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:29.461764 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58013db-6b97-4e21-aef5-b677384b8acf admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:29.466386 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58013db-6b97-4e21-aef5-b677384b8acf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:29.472879 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58013db-6b97-4e21-aef5-b677384b8acf admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:29.493962 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 866/1722] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:29 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:29.499507 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b5bd3-b1ac-4bcb-a27e-9c776463cd7a None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:29.499982 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b5bd3-b1ac-4bcb-a27e-9c776463cd7a None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:29.500530 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b5bd3-b1ac-4bcb-a27e-9c776463cd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:29.535419 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aaff4b-bdd9-495a-8e4c-d7b5447afa48 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:29.543441 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e238e-0e41-405f-98b5-f57978748f83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:29.544119 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e238e-0e41-405f-98b5-f57978748f83 service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:29.544402 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e238e-0e41-405f-98b5-f57978748f83 service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:29.544679 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e238e-0e41-405f-98b5-f57978748f83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:29.560804 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e238e-0e41-405f-98b5-f57978748f83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:29.563716 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e238e-0e41-405f-98b5-f57978748f83 service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:29.576095 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 857/1723] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:33:29.576786 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-8a0b5bd3-b1ac-4bcb-a27e-9c776463cd7a None None] MFA Rules not processed for user `8cabe29657c04e1da5b3a13cd2cdf77e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:29.576954 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e238e-0e41-405f-98b5-f57978748f83 service neutron] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:29.578058 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-8a0b5bd3-b1ac-4bcb-a27e-9c776463cd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:29.590745 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e238e-0e41-405f-98b5-f57978748f83 service neutron] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:29.597590 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9484fb-07a2-45cb-8634-0d633cadcc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:29.597590 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9484fb-07a2-45cb-8634-0d633cadcc7a admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:29.597590 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9484fb-07a2-45cb-8634-0d633cadcc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:29.597590 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9484fb-07a2-45cb-8634-0d633cadcc7a admin admin] PATH_INFO: `/v3/projects/8096ed4f52544d74a46426641e12ce89/users/1d91640f01d64c458e28a8a89b9672a2/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:29.625686 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9484fb-07a2-45cb-8634-0d633cadcc7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8096ed4f52544d74a46426641e12ce89, user_id=1d91640f01d64c458e28a8a89b9672a2, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:29.629354 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9484fb-07a2-45cb-8634-0d633cadcc7a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:29.744855 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 858/1724] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:33:29 2021] PUT /identity/v3/projects/8096ed4f52544d74a46426641e12ce89/users/1d91640f01d64c458e28a8a89b9672a2/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:29.756969 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb22a98-a978-4b54-9505-0957055fa59e None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:29.757614 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb22a98-a978-4b54-9505-0957055fa59e None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:29.758022 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb22a98-a978-4b54-9505-0957055fa59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:29.795394 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 867/1725] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:29 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:29.866138 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-3bb22a98-a978-4b54-9505-0957055fa59e None None] MFA Rules not processed for user `1d91640f01d64c458e28a8a89b9672a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:29.867769 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-3bb22a98-a978-4b54-9505-0957055fa59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:29.929735 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b5bd3-b1ac-4bcb-a27e-9c776463cd7a None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:29.932057 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-8a0b5bd3-b1ac-4bcb-a27e-9c776463cd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:29.966900 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b5bd3-b1ac-4bcb-a27e-9c776463cd7a None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:29.985687 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 859/1726] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:29 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:29.991050 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb22a98-a978-4b54-9505-0957055fa59e None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:30.109528 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb22a98-a978-4b54-9505-0957055fa59e None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:30.124362 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ddffb1-b35c-46cf-9560-60f8a9d0611b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:30.125269 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddffb1-b35c-46cf-9560-60f8a9d0611b admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:30.125822 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddffb1-b35c-46cf-9560-60f8a9d0611b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:30.128427 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddffb1-b35c-46cf-9560-60f8a9d0611b admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:30.128427 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ddffb1-b35c-46cf-9560-60f8a9d0611b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:30.133871 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ddffb1-b35c-46cf-9560-60f8a9d0611b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:30.146632 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f3e5d-5d95-4307-b1e9-48a6e25ec821 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:30.148084 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f3e5d-5d95-4307-b1e9-48a6e25ec821 service nova] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:30.148521 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f3e5d-5d95-4307-b1e9-48a6e25ec821 service nova] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:30.148811 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f3e5d-5d95-4307-b1e9-48a6e25ec821 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:30.241658 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 860/1727] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:33:29 2021] POST /identity/v3/projects => generated 387 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:33:30.242518 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ddffb1-b35c-46cf-9560-60f8a9d0611b admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:30.244593 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-18ddffb1-b35c-46cf-9560-60f8a9d0611b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:30.249222 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f3e5d-5d95-4307-b1e9-48a6e25ec821 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:30.250858 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f3e5d-5d95-4307-b1e9-48a6e25ec821 service nova] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:30.273867 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 868/1728] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:29 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:33:30.274832 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f3e5d-5d95-4307-b1e9-48a6e25ec821 service nova] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:30.292840 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f3e5d-5d95-4307-b1e9-48a6e25ec821 service nova] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:30.401523 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ddffb1-b35c-46cf-9560-60f8a9d0611b admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:30.421131 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f23bf-963b-4385-a0d3-07ce3d864a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:30.422177 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f23bf-963b-4385-a0d3-07ce3d864a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:30.426046 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f23bf-963b-4385-a0d3-07ce3d864a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:30.434557 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f23bf-963b-4385-a0d3-07ce3d864a1f admin admin] PATH_INFO: `/v3/users/00e9c953d31a48679656f22425088f18` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:30.434557 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f23bf-963b-4385-a0d3-07ce3d864a1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=00e9c953d31a48679656f22425088f18)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:30.436112 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: WARNING py.warnings [None req-0f4f23bf-963b-4385-a0d3-07ce3d864a1f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:33:30.436112 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: warnings.warn(msg) Nov 23 19:33:30.436112 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: Nov 23 19:33:30.437474 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f23bf-963b-4385-a0d3-07ce3d864a1f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:30.488804 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157501d-5279-466d-b0e0-0bc54321305c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:30.489537 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157501d-5279-466d-b0e0-0bc54321305c admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:30.489820 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157501d-5279-466d-b0e0-0bc54321305c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:30.490099 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157501d-5279-466d-b0e0-0bc54321305c admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:30.490806 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4157501d-5279-466d-b0e0-0bc54321305c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:30.492883 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4157501d-5279-466d-b0e0-0bc54321305c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:30.607734 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 869/1729] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:33:30 2021] POST /identity/v3/users => generated 300 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:30.616758 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157501d-5279-466d-b0e0-0bc54321305c admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:30.639133 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157501d-5279-466d-b0e0-0bc54321305c admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:30.645984 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf85bc-0169-4233-b2e9-2cdc8b227ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:30.646783 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf85bc-0169-4233-b2e9-2cdc8b227ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:30.647129 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf85bc-0169-4233-b2e9-2cdc8b227ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:30.647415 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf85bc-0169-4233-b2e9-2cdc8b227ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:30.648247 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf85bc-0169-4233-b2e9-2cdc8b227ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:30.650281 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf85bc-0169-4233-b2e9-2cdc8b227ce4 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:30.673606 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 870/1730] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:30 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:30.673606 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf85bc-0169-4233-b2e9-2cdc8b227ce4 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:30.681165 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf85bc-0169-4233-b2e9-2cdc8b227ce4 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:30.687811 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b16a6-ba2a-493d-b30a-b23b99a7abb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:30.688814 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b16a6-ba2a-493d-b30a-b23b99a7abb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:30.689102 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b16a6-ba2a-493d-b30a-b23b99a7abb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:30.689382 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b16a6-ba2a-493d-b30a-b23b99a7abb4 admin admin] PATH_INFO: `/v3/projects/6698a977324e41e3902e26da76616ac0/users/f3760c7bf3c64a22a8c5643f3fccb9a1/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:30.708307 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b16a6-ba2a-493d-b30a-b23b99a7abb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6698a977324e41e3902e26da76616ac0, user_id=f3760c7bf3c64a22a8c5643f3fccb9a1, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:30.711353 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b16a6-ba2a-493d-b30a-b23b99a7abb4 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:30.785927 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-0f4f23bf-963b-4385-a0d3-07ce3d864a1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00e9c953d31a48679656f22425088f18'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:30.789331 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-0f4f23bf-963b-4385-a0d3-07ce3d864a1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00e9c953d31a48679656f22425088f18'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:30.836399 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 871/1731] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:33:30 2021] PUT /identity/v3/projects/6698a977324e41e3902e26da76616ac0/users/f3760c7bf3c64a22a8c5643f3fccb9a1/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:30.837682 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b16a6-ba2a-493d-b30a-b23b99a7abb4 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:30.867038 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-0f4f23bf-963b-4385-a0d3-07ce3d864a1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00e9c953d31a48679656f22425088f18'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:30.867697 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-0f4f23bf-963b-4385-a0d3-07ce3d864a1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00e9c953d31a48679656f22425088f18'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:30.922003 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-0f4f23bf-963b-4385-a0d3-07ce3d864a1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00e9c953d31a48679656f22425088f18'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:30.977748 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 861/1732] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:33:30 2021] DELETE /identity/v3/users/00e9c953d31a48679656f22425088f18 => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:30.984061 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce5415-5123-4b45-ad4f-d4af1b429470 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:30.984346 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce5415-5123-4b45-ad4f-d4af1b429470 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:30.984631 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce5415-5123-4b45-ad4f-d4af1b429470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:31.012688 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b16a6-ba2a-493d-b30a-b23b99a7abb4 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:31.084538 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1148a6a-d3ab-4a30-8975-153b9adcfe41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:31.085240 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1148a6a-d3ab-4a30-8975-153b9adcfe41 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:31.085585 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1148a6a-d3ab-4a30-8975-153b9adcfe41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:31.085867 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1148a6a-d3ab-4a30-8975-153b9adcfe41 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:31.086661 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1148a6a-d3ab-4a30-8975-153b9adcfe41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:31.086777 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-9dce5415-5123-4b45-ad4f-d4af1b429470 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:31.091060 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-9dce5415-5123-4b45-ad4f-d4af1b429470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:31.092258 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1148a6a-d3ab-4a30-8975-153b9adcfe41 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:31.118757 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 872/1733] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:30 2021] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:31.120210 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151dd46-1026-4890-ae14-bbf7f56459c2 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:31.120500 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151dd46-1026-4890-ae14-bbf7f56459c2 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:31.120792 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151dd46-1026-4890-ae14-bbf7f56459c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:31.130980 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 862/1734] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:31.132379 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce5415-5123-4b45-ad4f-d4af1b429470 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:31.144477 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-9dce5415-5123-4b45-ad4f-d4af1b429470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:31.161897 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce5415-5123-4b45-ad4f-d4af1b429470 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:31.175445 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b702c52-1121-4e9d-8e41-d4a1b14e498f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:31.177916 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b702c52-1121-4e9d-8e41-d4a1b14e498f admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:31.178218 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b702c52-1121-4e9d-8e41-d4a1b14e498f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:31.180794 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b702c52-1121-4e9d-8e41-d4a1b14e498f admin admin] PATH_INFO: `/v3/projects/6698a977324e41e3902e26da76616ac0/users/f3760c7bf3c64a22a8c5643f3fccb9a1/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:31.185592 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b702c52-1121-4e9d-8e41-d4a1b14e498f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6698a977324e41e3902e26da76616ac0, user_id=f3760c7bf3c64a22a8c5643f3fccb9a1, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:31.191268 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b702c52-1121-4e9d-8e41-d4a1b14e498f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:31.213613 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-f151dd46-1026-4890-ae14-bbf7f56459c2 None None] MFA Rules not processed for user `4638e688aedc44e6b55166a9276a4c80`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:31.222333 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-f151dd46-1026-4890-ae14-bbf7f56459c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:31.247639 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 863/1735] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:33:31 2021] PUT /identity/v3/projects/6698a977324e41e3902e26da76616ac0/users/f3760c7bf3c64a22a8c5643f3fccb9a1/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:31.251574 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b702c52-1121-4e9d-8e41-d4a1b14e498f admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:31.264155 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-6b702c52-1121-4e9d-8e41-d4a1b14e498f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:31.367703 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 873/1736] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:31 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:31.379763 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382248f6-6a81-450f-821f-526db589baeb None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:31.381838 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382248f6-6a81-450f-821f-526db589baeb None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:31.383831 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382248f6-6a81-450f-821f-526db589baeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:31.444624 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-382248f6-6a81-450f-821f-526db589baeb None None] MFA Rules not processed for user `f3760c7bf3c64a22a8c5643f3fccb9a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:31.446671 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-382248f6-6a81-450f-821f-526db589baeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:31.529432 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b702c52-1121-4e9d-8e41-d4a1b14e498f admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:31.550953 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965c82b-cc2b-4cf7-b611-597850e9f459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:31.551629 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965c82b-cc2b-4cf7-b611-597850e9f459 service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:31.551912 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965c82b-cc2b-4cf7-b611-597850e9f459 service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:31.552188 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965c82b-cc2b-4cf7-b611-597850e9f459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:31.655295 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 874/1737] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:31 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:31.656529 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382248f6-6a81-450f-821f-526db589baeb None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:31.660734 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-382248f6-6a81-450f-821f-526db589baeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:31.701036 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965c82b-cc2b-4cf7-b611-597850e9f459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:31.713738 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965c82b-cc2b-4cf7-b611-597850e9f459 service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:31.738956 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 864/1738] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:33:31.740161 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578d60e-08b1-4ab3-9b62-0a3d724f7004 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:31.740453 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578d60e-08b1-4ab3-9b62-0a3d724f7004 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:31.740735 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578d60e-08b1-4ab3-9b62-0a3d724f7004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:31.756343 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382248f6-6a81-450f-821f-526db589baeb None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:31.765288 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6c2c8-b655-4241-8c5a-45ae62a20587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:31.768952 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6c2c8-b655-4241-8c5a-45ae62a20587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:31.771853 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6c2c8-b655-4241-8c5a-45ae62a20587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:31.772272 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6c2c8-b655-4241-8c5a-45ae62a20587 admin admin] PATH_INFO: `/v3/projects/e336b3b6f4df41f59c8bf29d15c75be0` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:31.775177 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa6c2c8-b655-4241-8c5a-45ae62a20587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e336b3b6f4df41f59c8bf29d15c75be0)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:31.776072 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: WARNING py.warnings [None req-4aa6c2c8-b655-4241-8c5a-45ae62a20587 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 23 19:33:31.776072 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: warnings.warn(msg) Nov 23 19:33:31.776072 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: Nov 23 19:33:31.778261 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa6c2c8-b655-4241-8c5a-45ae62a20587 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:31.786156 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-b578d60e-08b1-4ab3-9b62-0a3d724f7004 None None] MFA Rules not processed for user `abc393885c6c4cf6bd4dd52f698fc38c`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:31.787372 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-b578d60e-08b1-4ab3-9b62-0a3d724f7004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:31.925544 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 865/1739] 10.222.0.62 () {58 vars in 1009 bytes} [Tue Nov 23 19:33:31 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:31.962288 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578d60e-08b1-4ab3-9b62-0a3d724f7004 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:31.968740 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-b578d60e-08b1-4ab3-9b62-0a3d724f7004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:32.020401 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-4aa6c2c8-b655-4241-8c5a-45ae62a20587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e336b3b6f4df41f59c8bf29d15c75be0', 'request_id': 'req-4aa6c2c8-b655-4241-8c5a-45ae62a20587'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:32.048624 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-4aa6c2c8-b655-4241-8c5a-45ae62a20587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e336b3b6f4df41f59c8bf29d15c75be0', 'request_id': 'req-4aa6c2c8-b655-4241-8c5a-45ae62a20587'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:32.061822 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-4aa6c2c8-b655-4241-8c5a-45ae62a20587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e336b3b6f4df41f59c8bf29d15c75be0', 'request_id': 'req-4aa6c2c8-b655-4241-8c5a-45ae62a20587'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:32.167344 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-4aa6c2c8-b655-4241-8c5a-45ae62a20587 admin admin] The token cache is being invalidate because project e336b3b6f4df41f59c8bf29d15c75be0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:33:32.168846 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-4aa6c2c8-b655-4241-8c5a-45ae62a20587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:32.174273 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-4aa6c2c8-b655-4241-8c5a-45ae62a20587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:32.179533 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 875/1740] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:33:31 2021] DELETE /identity/v3/projects/e336b3b6f4df41f59c8bf29d15c75be0 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:32.180781 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578d60e-08b1-4ab3-9b62-0a3d724f7004 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:32.183497 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6c2c8-b655-4241-8c5a-45ae62a20587 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:32.186579 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-4aa6c2c8-b655-4241-8c5a-45ae62a20587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:32.301915 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6c2c8-b655-4241-8c5a-45ae62a20587 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:32.308556 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db2083-a212-4833-846a-9c3ec2860b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:32.309696 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db2083-a212-4833-846a-9c3ec2860b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:32.310472 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db2083-a212-4833-846a-9c3ec2860b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:32.310982 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db2083-a212-4833-846a-9c3ec2860b97 admin admin] PATH_INFO: `/v3/users/4ba1e492c3b642f38723ca3040c8a5d1` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:32.312565 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db2083-a212-4833-846a-9c3ec2860b97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ba1e492c3b642f38723ca3040c8a5d1)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:32.315408 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db2083-a212-4833-846a-9c3ec2860b97 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:32.361047 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bcbb07-bec6-4a70-a30d-b13f35257943 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:32.361951 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcbb07-bec6-4a70-a30d-b13f35257943 service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:32.363641 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcbb07-bec6-4a70-a30d-b13f35257943 service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:32.364043 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcbb07-bec6-4a70-a30d-b13f35257943 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:32.366247 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-29bcbb07-bec6-4a70-a30d-b13f35257943 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:32.452817 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bcbb07-bec6-4a70-a30d-b13f35257943 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:32.455006 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bcbb07-bec6-4a70-a30d-b13f35257943 service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:32.471731 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 866/1741] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:31 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:33:32.532863 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bcbb07-bec6-4a70-a30d-b13f35257943 service cinder] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:32.536728 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-29bcbb07-bec6-4a70-a30d-b13f35257943 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:32.595940 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-32db2083-a212-4833-846a-9c3ec2860b97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ba1e492c3b642f38723ca3040c8a5d1'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:32.597181 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-32db2083-a212-4833-846a-9c3ec2860b97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ba1e492c3b642f38723ca3040c8a5d1'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:32.638608 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-32db2083-a212-4833-846a-9c3ec2860b97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ba1e492c3b642f38723ca3040c8a5d1'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:32.640473 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-32db2083-a212-4833-846a-9c3ec2860b97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ba1e492c3b642f38723ca3040c8a5d1'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:32.703581 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-32db2083-a212-4833-846a-9c3ec2860b97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ba1e492c3b642f38723ca3040c8a5d1'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:32.794171 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 876/1742] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:33:32 2021] DELETE /identity/v3/users/4ba1e492c3b642f38723ca3040c8a5d1 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:32.795382 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db2083-a212-4833-846a-9c3ec2860b97 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:32.800858 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-32db2083-a212-4833-846a-9c3ec2860b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:32.827818 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bcbb07-bec6-4a70-a30d-b13f35257943 service cinder] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:33.014300 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797bad01-491d-4046-954b-04f040b89ddc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87b6ed93587a4c87ad5002fc80b985c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:33.015302 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bad01-491d-4046-954b-04f040b89ddc service swift] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:33.015590 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bad01-491d-4046-954b-04f040b89ddc service swift] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:33.015863 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bad01-491d-4046-954b-04f040b89ddc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:33.024768 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-797bad01-491d-4046-954b-04f040b89ddc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:33.029555 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db2083-a212-4833-846a-9c3ec2860b97 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:33.042012 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba734b9-424b-4028-be77-959c61cfa1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:33.045667 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba734b9-424b-4028-be77-959c61cfa1bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:33.045962 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba734b9-424b-4028-be77-959c61cfa1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:33.046247 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba734b9-424b-4028-be77-959c61cfa1bc admin admin] PATH_INFO: `/v3/users/1d91640f01d64c458e28a8a89b9672a2` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:33.074634 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba734b9-424b-4028-be77-959c61cfa1bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d91640f01d64c458e28a8a89b9672a2)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:33.088709 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba734b9-424b-4028-be77-959c61cfa1bc admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:33.281384 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797bad01-491d-4046-954b-04f040b89ddc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:33.285659 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797bad01-491d-4046-954b-04f040b89ddc service swift] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:33.323811 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 867/1743] 10.222.0.62 () {60 vars in 1384 bytes} [Tue Nov 23 19:33:32 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 791 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:33:33.546650 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-dba734b9-424b-4028-be77-959c61cfa1bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d91640f01d64c458e28a8a89b9672a2'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:33.554722 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-dba734b9-424b-4028-be77-959c61cfa1bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d91640f01d64c458e28a8a89b9672a2'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:33.599108 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-dba734b9-424b-4028-be77-959c61cfa1bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d91640f01d64c458e28a8a89b9672a2'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:33.599936 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-dba734b9-424b-4028-be77-959c61cfa1bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d91640f01d64c458e28a8a89b9672a2'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:33.645117 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-dba734b9-424b-4028-be77-959c61cfa1bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d91640f01d64c458e28a8a89b9672a2'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:33.739195 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 877/1744] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:33:32 2021] DELETE /identity/v3/users/1d91640f01d64c458e28a8a89b9672a2 => generated 0 bytes in 944 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:33.744261 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebbac4-6690-4d1b-b106-f5d4a843f5ab None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:33.744815 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebbac4-6690-4d1b-b106-f5d4a843f5ab None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:33.745278 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebbac4-6690-4d1b-b106-f5d4a843f5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:33.782379 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-19ebbac4-6690-4d1b-b106-f5d4a843f5ab None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:33.795793 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-19ebbac4-6690-4d1b-b106-f5d4a843f5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:33.945193 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba734b9-424b-4028-be77-959c61cfa1bc admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:33.947429 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-dba734b9-424b-4028-be77-959c61cfa1bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:34.113611 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 868/1745] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:34.117277 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ebbac4-6690-4d1b-b106-f5d4a843f5ab None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:34.124490 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-19ebbac4-6690-4d1b-b106-f5d4a843f5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:34.263945 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba734b9-424b-4028-be77-959c61cfa1bc admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:34.286319 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4d652-3b67-4fa1-98a1-eef096d9eac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:34.299259 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4d652-3b67-4fa1-98a1-eef096d9eac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:34.299259 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4d652-3b67-4fa1-98a1-eef096d9eac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:34.299596 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ebbac4-6690-4d1b-b106-f5d4a843f5ab None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:34.299718 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4d652-3b67-4fa1-98a1-eef096d9eac9 admin admin] PATH_INFO: `/v3/projects/3f785c5b833646fe8bd3d132c0f01a4c` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:34.299718 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4d652-3b67-4fa1-98a1-eef096d9eac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f785c5b833646fe8bd3d132c0f01a4c)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:34.299718 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4d652-3b67-4fa1-98a1-eef096d9eac9 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:34.299890 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ee37a-9117-46a3-8a23-84c78def535a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:34.301703 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ee37a-9117-46a3-8a23-84c78def535a service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:34.302060 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ee37a-9117-46a3-8a23-84c78def535a service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:34.302406 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ee37a-9117-46a3-8a23-84c78def535a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:34.308457 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-9c9ee37a-9117-46a3-8a23-84c78def535a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:34.539727 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ee37a-9117-46a3-8a23-84c78def535a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:34.542057 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ee37a-9117-46a3-8a23-84c78def535a service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:34.577819 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 869/1746] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:34 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:33:34.578993 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ee37a-9117-46a3-8a23-84c78def535a service cinder] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:34.586330 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-9c9ee37a-9117-46a3-8a23-84c78def535a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:34.599412 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-66c4d652-3b67-4fa1-98a1-eef096d9eac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f785c5b833646fe8bd3d132c0f01a4c', 'request_id': 'req-66c4d652-3b67-4fa1-98a1-eef096d9eac9'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:34.634194 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-66c4d652-3b67-4fa1-98a1-eef096d9eac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f785c5b833646fe8bd3d132c0f01a4c', 'request_id': 'req-66c4d652-3b67-4fa1-98a1-eef096d9eac9'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:34.657291 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-66c4d652-3b67-4fa1-98a1-eef096d9eac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f785c5b833646fe8bd3d132c0f01a4c', 'request_id': 'req-66c4d652-3b67-4fa1-98a1-eef096d9eac9'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:34.723026 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ee37a-9117-46a3-8a23-84c78def535a service cinder] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:34.742512 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-66c4d652-3b67-4fa1-98a1-eef096d9eac9 admin admin] The token cache is being invalidate because project 3f785c5b833646fe8bd3d132c0f01a4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:33:34.742815 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-66c4d652-3b67-4fa1-98a1-eef096d9eac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:34.743846 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-66c4d652-3b67-4fa1-98a1-eef096d9eac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:34.747514 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 878/1747] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:33:33 2021] DELETE /identity/v3/projects/3f785c5b833646fe8bd3d132c0f01a4c => generated 0 bytes in 803 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:33:34.755106 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eca152-5dea-4fa7-9a75-63bbeb020202 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:34.757860 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eca152-5dea-4fa7-9a75-63bbeb020202 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:34.758236 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eca152-5dea-4fa7-9a75-63bbeb020202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:34.823683 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379fee7-5003-44f3-ad0e-6d269435c8ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:34.826873 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379fee7-5003-44f3-ad0e-6d269435c8ab service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:34.826873 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379fee7-5003-44f3-ad0e-6d269435c8ab service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:34.826873 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379fee7-5003-44f3-ad0e-6d269435c8ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:34.830685 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-3379fee7-5003-44f3-ad0e-6d269435c8ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:34.840634 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-80eca152-5dea-4fa7-9a75-63bbeb020202 None None] MFA Rules not processed for user `f1ef2ac0a788451eb50fa80f559f808f`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:34.841892 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-80eca152-5dea-4fa7-9a75-63bbeb020202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:34.853399 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 879/1748] 10.222.0.41 () {58 vars in 1015 bytes} [Tue Nov 23 19:33:34 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:34.864207 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eca152-5dea-4fa7-9a75-63bbeb020202 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:34.867836 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-80eca152-5dea-4fa7-9a75-63bbeb020202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:34.992078 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379fee7-5003-44f3-ad0e-6d269435c8ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:34.993665 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379fee7-5003-44f3-ad0e-6d269435c8ab service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:35.013090 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 870/1749] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:33:35.019142 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379fee7-5003-44f3-ad0e-6d269435c8ab service neutron] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:35.019142 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-3379fee7-5003-44f3-ad0e-6d269435c8ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:35.038174 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379fee7-5003-44f3-ad0e-6d269435c8ab service neutron] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:35.044782 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a8dc6b-1d33-4573-8903-a3a119a4f9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:35.053390 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8dc6b-1d33-4573-8903-a3a119a4f9cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:35.053390 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8dc6b-1d33-4573-8903-a3a119a4f9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:35.053390 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8dc6b-1d33-4573-8903-a3a119a4f9cd admin admin] PATH_INFO: `/v3/users/b6d7f210e55b409f8108e3c7a70ce69e` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:35.068462 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a8dc6b-1d33-4573-8903-a3a119a4f9cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6d7f210e55b409f8108e3c7a70ce69e)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:35.073677 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a8dc6b-1d33-4573-8903-a3a119a4f9cd admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:35.084727 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eca152-5dea-4fa7-9a75-63bbeb020202 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:35.096276 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64235eb-201d-45d1-8331-725e75424736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:35.097939 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64235eb-201d-45d1-8331-725e75424736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:35.097939 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64235eb-201d-45d1-8331-725e75424736 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:35.097939 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64235eb-201d-45d1-8331-725e75424736 admin admin] PATH_INFO: `/v3/users/bd9c5861abcd4e22b48f20cbfe98e734` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:35.106497 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64235eb-201d-45d1-8331-725e75424736 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd9c5861abcd4e22b48f20cbfe98e734)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:35.108832 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64235eb-201d-45d1-8331-725e75424736 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:35.564028 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-40a8dc6b-1d33-4573-8903-a3a119a4f9cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6d7f210e55b409f8108e3c7a70ce69e'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:35.564028 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-40a8dc6b-1d33-4573-8903-a3a119a4f9cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6d7f210e55b409f8108e3c7a70ce69e'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:35.638637 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-b64235eb-201d-45d1-8331-725e75424736 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd9c5861abcd4e22b48f20cbfe98e734'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:35.641392 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-b64235eb-201d-45d1-8331-725e75424736 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd9c5861abcd4e22b48f20cbfe98e734'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:35.665946 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-b64235eb-201d-45d1-8331-725e75424736 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd9c5861abcd4e22b48f20cbfe98e734'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:35.666925 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-b64235eb-201d-45d1-8331-725e75424736 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd9c5861abcd4e22b48f20cbfe98e734'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:35.717890 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-b64235eb-201d-45d1-8331-725e75424736 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd9c5861abcd4e22b48f20cbfe98e734'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:35.771375 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-40a8dc6b-1d33-4573-8903-a3a119a4f9cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6d7f210e55b409f8108e3c7a70ce69e'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:35.778991 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-40a8dc6b-1d33-4573-8903-a3a119a4f9cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6d7f210e55b409f8108e3c7a70ce69e'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:35.818982 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-40a8dc6b-1d33-4573-8903-a3a119a4f9cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6d7f210e55b409f8108e3c7a70ce69e'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:35.844465 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 871/1750] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:33:35 2021] DELETE /identity/v3/users/b6d7f210e55b409f8108e3c7a70ce69e => generated 0 bytes in 831 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:35.845188 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a8dc6b-1d33-4573-8903-a3a119a4f9cd admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:35.847521 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-40a8dc6b-1d33-4573-8903-a3a119a4f9cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:35.867018 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 880/1751] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:33:34 2021] DELETE /identity/v3/users/bd9c5861abcd4e22b48f20cbfe98e734 => generated 0 bytes in 1008 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:35.867018 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64235eb-201d-45d1-8331-725e75424736 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:35.877422 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-b64235eb-201d-45d1-8331-725e75424736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:36.152082 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a8dc6b-1d33-4573-8903-a3a119a4f9cd admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:36.183778 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64235eb-201d-45d1-8331-725e75424736 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:36.191242 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e822d1f5-f065-4f16-ad8f-079a4c9a56b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:36.191242 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822d1f5-f065-4f16-ad8f-079a4c9a56b7 service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:36.191242 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822d1f5-f065-4f16-ad8f-079a4c9a56b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:36.191242 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822d1f5-f065-4f16-ad8f-079a4c9a56b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:36.193108 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-e822d1f5-f065-4f16-ad8f-079a4c9a56b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:36.229147 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e822d1f5-f065-4f16-ad8f-079a4c9a56b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:36.230672 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e822d1f5-f065-4f16-ad8f-079a4c9a56b7 service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:36.263851 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 881/1752] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:35 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:33:36.265049 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8d13c-0184-44b6-91af-5a87c568103c None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:36.265399 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8d13c-0184-44b6-91af-5a87c568103c None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:36.265725 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8d13c-0184-44b6-91af-5a87c568103c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:36.317490 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad4ffe-870c-45a1-b735-474a430c083f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:36.317490 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad4ffe-870c-45a1-b735-474a430c083f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:36.317490 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad4ffe-870c-45a1-b735-474a430c083f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:36.317490 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad4ffe-870c-45a1-b735-474a430c083f admin admin] PATH_INFO: `/v3/projects/19ebf3e474f549dbb7ef60b75089e9d7` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:36.317849 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad4ffe-870c-45a1-b735-474a430c083f admin admin] RBAC: Authorizing `identity:delete_project(project_id=19ebf3e474f549dbb7ef60b75089e9d7)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:36.324573 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad4ffe-870c-45a1-b735-474a430c083f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:36.342650 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-1bc8d13c-0184-44b6-91af-5a87c568103c None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:36.352009 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-1bc8d13c-0184-44b6-91af-5a87c568103c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:36.366021 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 882/1753] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:36.396487 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8d13c-0184-44b6-91af-5a87c568103c None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:36.398381 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-1bc8d13c-0184-44b6-91af-5a87c568103c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:36.418280 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8d13c-0184-44b6-91af-5a87c568103c None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:36.425665 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3f6ca-11ae-4ad3-8e37-33f648f79bea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:36.426724 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3f6ca-11ae-4ad3-8e37-33f648f79bea service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:36.427160 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3f6ca-11ae-4ad3-8e37-33f648f79bea service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:36.427615 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3f6ca-11ae-4ad3-8e37-33f648f79bea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:36.443824 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3f6ca-11ae-4ad3-8e37-33f648f79bea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:36.445285 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3f6ca-11ae-4ad3-8e37-33f648f79bea service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:36.471875 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 883/1754] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:33:36.577702 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4cad4ffe-870c-45a1-b735-474a430c083f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19ebf3e474f549dbb7ef60b75089e9d7', 'request_id': 'req-4cad4ffe-870c-45a1-b735-474a430c083f'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:36.584405 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4cad4ffe-870c-45a1-b735-474a430c083f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19ebf3e474f549dbb7ef60b75089e9d7', 'request_id': 'req-4cad4ffe-870c-45a1-b735-474a430c083f'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:36.591390 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4cad4ffe-870c-45a1-b735-474a430c083f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19ebf3e474f549dbb7ef60b75089e9d7', 'request_id': 'req-4cad4ffe-870c-45a1-b735-474a430c083f'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:36.652917 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3f6ca-11ae-4ad3-8e37-33f648f79bea service neutron] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:36.654475 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-ffa3f6ca-11ae-4ad3-8e37-33f648f79bea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:36.677074 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3f6ca-11ae-4ad3-8e37-33f648f79bea service neutron] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:36.701679 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4cad4ffe-870c-45a1-b735-474a430c083f admin admin] The token cache is being invalidate because project 19ebf3e474f549dbb7ef60b75089e9d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:33:36.702704 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4cad4ffe-870c-45a1-b735-474a430c083f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:36.705894 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4cad4ffe-870c-45a1-b735-474a430c083f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:36.708831 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 872/1755] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:33:35 2021] DELETE /identity/v3/projects/19ebf3e474f549dbb7ef60b75089e9d7 => generated 0 bytes in 864 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:36.715026 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd55c92-431f-4062-84fe-7a07697bf2aa None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:36.715498 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd55c92-431f-4062-84fe-7a07697bf2aa None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:36.715784 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd55c92-431f-4062-84fe-7a07697bf2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:36.749656 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-fcd55c92-431f-4062-84fe-7a07697bf2aa None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:36.750992 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-fcd55c92-431f-4062-84fe-7a07697bf2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:36.866834 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5571c-7626-453b-8864-4c217af373c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:36.867800 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5571c-7626-453b-8864-4c217af373c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:36.870970 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5571c-7626-453b-8864-4c217af373c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:36.871450 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5571c-7626-453b-8864-4c217af373c2 admin admin] PATH_INFO: `/v3/projects/8096ed4f52544d74a46426641e12ce89` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:36.875174 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5571c-7626-453b-8864-4c217af373c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8096ed4f52544d74a46426641e12ce89)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:36.878101 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5571c-7626-453b-8864-4c217af373c2 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:36.924625 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 873/1756] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:36.926885 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714449e-6e6d-4b5d-baf9-34c8469ea870 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:36.927007 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714449e-6e6d-4b5d-baf9-34c8469ea870 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:36.927343 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714449e-6e6d-4b5d-baf9-34c8469ea870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:36.948597 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-f714449e-6e6d-4b5d-baf9-34c8469ea870 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:36.950399 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-f714449e-6e6d-4b5d-baf9-34c8469ea870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:36.984121 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 874/1757] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:37.013547 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714449e-6e6d-4b5d-baf9-34c8469ea870 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:37.035829 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714449e-6e6d-4b5d-baf9-34c8469ea870 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:37.051412 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97039f13-721b-4da6-a518-739c0bd3de13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:37.051412 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97039f13-721b-4da6-a518-739c0bd3de13 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:37.051688 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97039f13-721b-4da6-a518-739c0bd3de13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:37.052138 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97039f13-721b-4da6-a518-739c0bd3de13 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:37.052705 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97039f13-721b-4da6-a518-739c0bd3de13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:33:37.053039 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97039f13-721b-4da6-a518-739c0bd3de13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:37.054672 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97039f13-721b-4da6-a518-739c0bd3de13 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:37.072370 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 875/1758] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:33:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:33:37.073310 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97039f13-721b-4da6-a518-739c0bd3de13 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:37.084214 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97039f13-721b-4da6-a518-739c0bd3de13 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:37.089815 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac7a88-e2ab-4dc8-834d-c059b2e00083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:37.090495 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac7a88-e2ab-4dc8-834d-c059b2e00083 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:37.090782 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac7a88-e2ab-4dc8-834d-c059b2e00083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:37.091079 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac7a88-e2ab-4dc8-834d-c059b2e00083 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:37.091985 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac7a88-e2ab-4dc8-834d-c059b2e00083 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:37.093705 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac7a88-e2ab-4dc8-834d-c059b2e00083 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:37.192894 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-87d5571c-7626-453b-8864-4c217af373c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8096ed4f52544d74a46426641e12ce89', 'request_id': 'req-87d5571c-7626-453b-8864-4c217af373c2'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:37.201853 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-87d5571c-7626-453b-8864-4c217af373c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8096ed4f52544d74a46426641e12ce89', 'request_id': 'req-87d5571c-7626-453b-8864-4c217af373c2'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:37.208524 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 876/1759] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:33:37 2021] POST /identity/v3/projects => generated 409 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:37.212888 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac7a88-e2ab-4dc8-834d-c059b2e00083 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:37.215588 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-87d5571c-7626-453b-8864-4c217af373c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8096ed4f52544d74a46426641e12ce89', 'request_id': 'req-87d5571c-7626-453b-8864-4c217af373c2'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:37.324363 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-87d5571c-7626-453b-8864-4c217af373c2 admin admin] The token cache is being invalidate because project 8096ed4f52544d74a46426641e12ce89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:33:37.324363 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-87d5571c-7626-453b-8864-4c217af373c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:37.324363 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-87d5571c-7626-453b-8864-4c217af373c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:37.328634 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 884/1760] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:33:36 2021] DELETE /identity/v3/projects/8096ed4f52544d74a46426641e12ce89 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:37.329380 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5571c-7626-453b-8864-4c217af373c2 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:37.334269 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-87d5571c-7626-453b-8864-4c217af373c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:37.415334 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac7a88-e2ab-4dc8-834d-c059b2e00083 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:37.438485 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29aa2f-2c4c-48ef-b5eb-2d60e6f71171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:37.446282 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29aa2f-2c4c-48ef-b5eb-2d60e6f71171 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:37.446585 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29aa2f-2c4c-48ef-b5eb-2d60e6f71171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:37.448890 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29aa2f-2c4c-48ef-b5eb-2d60e6f71171 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:37.456797 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29aa2f-2c4c-48ef-b5eb-2d60e6f71171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:37.466429 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29aa2f-2c4c-48ef-b5eb-2d60e6f71171 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:37.576409 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5571c-7626-453b-8864-4c217af373c2 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:37.604291 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7dcf9-c4de-4df9-9763-974c59249203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:37.604291 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7dcf9-c4de-4df9-9763-974c59249203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:37.604291 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7dcf9-c4de-4df9-9763-974c59249203 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:37.604291 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7dcf9-c4de-4df9-9763-974c59249203 admin admin] PATH_INFO: `/v3/users/f3760c7bf3c64a22a8c5643f3fccb9a1` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:37.609610 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc7dcf9-c4de-4df9-9763-974c59249203 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3760c7bf3c64a22a8c5643f3fccb9a1)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:37.611969 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc7dcf9-c4de-4df9-9763-974c59249203 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:37.657618 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 877/1761] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:33:37 2021] POST /identity/v3/users => generated 305 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:37.663156 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29aa2f-2c4c-48ef-b5eb-2d60e6f71171 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:37.667798 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-0f29aa2f-2c4c-48ef-b5eb-2d60e6f71171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:37.731872 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29aa2f-2c4c-48ef-b5eb-2d60e6f71171 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:37.752576 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf1af04-08b7-4ca8-bd3d-00c602d12c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:37.753193 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1af04-08b7-4ca8-bd3d-00c602d12c85 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:37.754858 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1af04-08b7-4ca8-bd3d-00c602d12c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:37.754858 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1af04-08b7-4ca8-bd3d-00c602d12c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:37.754858 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf1af04-08b7-4ca8-bd3d-00c602d12c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:37.757553 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf1af04-08b7-4ca8-bd3d-00c602d12c85 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:37.809339 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 878/1762] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:37 2021] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:37.810448 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf1af04-08b7-4ca8-bd3d-00c602d12c85 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:37.815987 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-fbf1af04-08b7-4ca8-bd3d-00c602d12c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:37.837161 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf1af04-08b7-4ca8-bd3d-00c602d12c85 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:37.845013 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7d4ae-1a0d-4f72-80a1-b221d245b40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:37.847591 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7d4ae-1a0d-4f72-80a1-b221d245b40b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:37.852263 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7d4ae-1a0d-4f72-80a1-b221d245b40b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:37.852263 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7d4ae-1a0d-4f72-80a1-b221d245b40b admin admin] PATH_INFO: `/v3/projects/b85fbc4d72d54c95847f8e04dc7cb64d` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:37.852263 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7d4ae-1a0d-4f72-80a1-b221d245b40b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b85fbc4d72d54c95847f8e04dc7cb64d)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:37.871054 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7d4ae-1a0d-4f72-80a1-b221d245b40b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:37.948712 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-7cc7dcf9-c4de-4df9-9763-974c59249203 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3760c7bf3c64a22a8c5643f3fccb9a1'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:37.951381 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-7cc7dcf9-c4de-4df9-9763-974c59249203 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3760c7bf3c64a22a8c5643f3fccb9a1'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:37.968554 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-7cc7dcf9-c4de-4df9-9763-974c59249203 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3760c7bf3c64a22a8c5643f3fccb9a1'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:37.969821 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-7cc7dcf9-c4de-4df9-9763-974c59249203 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3760c7bf3c64a22a8c5643f3fccb9a1'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:37.990660 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-7cc7dcf9-c4de-4df9-9763-974c59249203 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3760c7bf3c64a22a8c5643f3fccb9a1'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:38.091707 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-24e7d4ae-1a0d-4f72-80a1-b221d245b40b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b85fbc4d72d54c95847f8e04dc7cb64d', 'request_id': 'req-24e7d4ae-1a0d-4f72-80a1-b221d245b40b'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:38.102907 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-24e7d4ae-1a0d-4f72-80a1-b221d245b40b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b85fbc4d72d54c95847f8e04dc7cb64d', 'request_id': 'req-24e7d4ae-1a0d-4f72-80a1-b221d245b40b'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:38.105105 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 885/1763] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:33:37 2021] DELETE /identity/v3/users/f3760c7bf3c64a22a8c5643f3fccb9a1 => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:38.108953 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105d4e8-f3b9-401c-949f-de010fd7b617 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:38.109255 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105d4e8-f3b9-401c-949f-de010fd7b617 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:38.109565 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105d4e8-f3b9-401c-949f-de010fd7b617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:38.113889 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-24e7d4ae-1a0d-4f72-80a1-b221d245b40b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b85fbc4d72d54c95847f8e04dc7cb64d', 'request_id': 'req-24e7d4ae-1a0d-4f72-80a1-b221d245b40b'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:38.178565 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-1105d4e8-f3b9-401c-949f-de010fd7b617 None None] MFA Rules not processed for user `8cabe29657c04e1da5b3a13cd2cdf77e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:38.179877 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-1105d4e8-f3b9-401c-949f-de010fd7b617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:38.364422 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 886/1764] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:38 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:38.364422 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105d4e8-f3b9-401c-949f-de010fd7b617 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:38.364422 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-1105d4e8-f3b9-401c-949f-de010fd7b617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:38.423979 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105d4e8-f3b9-401c-949f-de010fd7b617 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:38.437009 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784de687-8015-4d5e-ab61-6cf2c2815add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:38.437998 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784de687-8015-4d5e-ab61-6cf2c2815add admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:38.438483 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784de687-8015-4d5e-ab61-6cf2c2815add admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:38.438772 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784de687-8015-4d5e-ab61-6cf2c2815add admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:38.439583 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784de687-8015-4d5e-ab61-6cf2c2815add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:38.443047 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784de687-8015-4d5e-ab61-6cf2c2815add admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:38.484611 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 887/1765] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:38 2021] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:38.485684 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784de687-8015-4d5e-ab61-6cf2c2815add admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:38.501840 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784de687-8015-4d5e-ab61-6cf2c2815add admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:38.512745 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17322c0-3e8e-46c8-a675-8e21f2663c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:38.518082 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17322c0-3e8e-46c8-a675-8e21f2663c28 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:38.518082 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17322c0-3e8e-46c8-a675-8e21f2663c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:38.518082 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17322c0-3e8e-46c8-a675-8e21f2663c28 admin admin] PATH_INFO: `/v3/projects/459be06d15174b4b8a4f1092f4e4a5f1/users/f8637b5502a54ba8bb943addae4d726a/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:38.521518 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-24e7d4ae-1a0d-4f72-80a1-b221d245b40b admin admin] The token cache is being invalidate because project b85fbc4d72d54c95847f8e04dc7cb64d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:33:38.522077 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-24e7d4ae-1a0d-4f72-80a1-b221d245b40b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:38.523348 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-24e7d4ae-1a0d-4f72-80a1-b221d245b40b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:38.526044 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 879/1766] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:33:37 2021] DELETE /identity/v3/projects/b85fbc4d72d54c95847f8e04dc7cb64d => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:38.531786 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda1c2c-6f17-47c5-aee9-61166334882a None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:38.532411 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda1c2c-6f17-47c5-aee9-61166334882a None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:38.538159 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17322c0-3e8e-46c8-a675-8e21f2663c28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=459be06d15174b4b8a4f1092f4e4a5f1, user_id=f8637b5502a54ba8bb943addae4d726a, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:38.542087 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17322c0-3e8e-46c8-a675-8e21f2663c28 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:38.549283 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda1c2c-6f17-47c5-aee9-61166334882a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:38.593883 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-bbda1c2c-6f17-47c5-aee9-61166334882a None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:38.598885 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-bbda1c2c-6f17-47c5-aee9-61166334882a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:38.628911 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 880/1767] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:38.673357 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 888/1768] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:33:38 2021] PUT /identity/v3/projects/459be06d15174b4b8a4f1092f4e4a5f1/users/f8637b5502a54ba8bb943addae4d726a/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:38.695150 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655b2c3-0bd5-4f23-a070-d5abdf53407b None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:38.695500 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655b2c3-0bd5-4f23-a070-d5abdf53407b None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:38.695777 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655b2c3-0bd5-4f23-a070-d5abdf53407b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:38.706859 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff6fc0-541d-4685-acec-f4587c2ac699 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:38.707212 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff6fc0-541d-4685-acec-f4587c2ac699 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:38.707496 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff6fc0-541d-4685-acec-f4587c2ac699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:38.740440 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-e655b2c3-0bd5-4f23-a070-d5abdf53407b None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:38.741875 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-e655b2c3-0bd5-4f23-a070-d5abdf53407b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:38.829667 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-79ff6fc0-541d-4685-acec-f4587c2ac699 None None] MFA Rules not processed for user `f8637b5502a54ba8bb943addae4d726a`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:38.831989 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-79ff6fc0-541d-4685-acec-f4587c2ac699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:38.960481 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 881/1769] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:38.961636 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655b2c3-0bd5-4f23-a070-d5abdf53407b None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:38.977156 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 889/1770] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:38 2021] POST /identity/v3/auth/tokens => generated 3276 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:38.977766 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff6fc0-541d-4685-acec-f4587c2ac699 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:38.980594 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-79ff6fc0-541d-4685-acec-f4587c2ac699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:38.981586 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655b2c3-0bd5-4f23-a070-d5abdf53407b None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:39.006315 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91758e1f-ca81-41d0-a885-eae4f1be0efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:39.007015 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91758e1f-ca81-41d0-a885-eae4f1be0efb admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:39.007300 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91758e1f-ca81-41d0-a885-eae4f1be0efb admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:39.007638 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91758e1f-ca81-41d0-a885-eae4f1be0efb admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:39.008484 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91758e1f-ca81-41d0-a885-eae4f1be0efb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:33:39.008796 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91758e1f-ca81-41d0-a885-eae4f1be0efb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:39.012791 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91758e1f-ca81-41d0-a885-eae4f1be0efb admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:39.023114 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff6fc0-541d-4685-acec-f4587c2ac699 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:39.041622 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9cbd4-d770-4878-bb78-710d0de0179b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:39.042036 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9cbd4-d770-4878-bb78-710d0de0179b admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:39.042322 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9cbd4-d770-4878-bb78-710d0de0179b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:39.042599 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9cbd4-d770-4878-bb78-710d0de0179b admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:39.043470 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab9cbd4-d770-4878-bb78-710d0de0179b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:39.048940 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab9cbd4-d770-4878-bb78-710d0de0179b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:39.053466 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 882/1771] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:33:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:33:39.057541 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91758e1f-ca81-41d0-a885-eae4f1be0efb admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:39.084898 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91758e1f-ca81-41d0-a885-eae4f1be0efb admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:39.106105 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd333972-e828-479e-9b90-57717299acf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:39.107952 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd333972-e828-479e-9b90-57717299acf2 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:39.108446 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd333972-e828-479e-9b90-57717299acf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:39.109310 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd333972-e828-479e-9b90-57717299acf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:39.110636 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd333972-e828-479e-9b90-57717299acf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:39.113763 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd333972-e828-479e-9b90-57717299acf2 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:39.338001 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 890/1772] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:33:38 2021] POST /identity/v3/projects => generated 405 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:39.338953 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9cbd4-d770-4878-bb78-710d0de0179b admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:39.347510 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-6ab9cbd4-d770-4878-bb78-710d0de0179b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:39.366574 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 883/1773] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:33:39 2021] POST /identity/v3/projects => generated 377 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:33:39.367372 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd333972-e828-479e-9b90-57717299acf2 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:39.508703 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd333972-e828-479e-9b90-57717299acf2 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:39.524009 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9cbd4-d770-4878-bb78-710d0de0179b admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:39.525581 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fd25b-0c3f-4920-ada4-bce44a948d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:39.526388 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fd25b-0c3f-4920-ada4-bce44a948d89 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:39.531473 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfd13f-135a-438d-ad8f-1a53ed2cb224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:39.532822 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfd13f-135a-438d-ad8f-1a53ed2cb224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:39.533735 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfd13f-135a-438d-ad8f-1a53ed2cb224 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:39.534200 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfd13f-135a-438d-ad8f-1a53ed2cb224 admin admin] PATH_INFO: `/v3/projects/90c36f903ecc4c8f9f00800e54daf910` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:39.536516 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addfd13f-135a-438d-ad8f-1a53ed2cb224 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90c36f903ecc4c8f9f00800e54daf910)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:39.539875 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addfd13f-135a-438d-ad8f-1a53ed2cb224 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:39.540411 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fd25b-0c3f-4920-ada4-bce44a948d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:39.540702 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fd25b-0c3f-4920-ada4-bce44a948d89 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:39.541596 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0fd25b-0c3f-4920-ada4-bce44a948d89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:39.543500 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0fd25b-0c3f-4920-ada4-bce44a948d89 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:39.691335 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 884/1774] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:33:39 2021] POST /identity/v3/users => generated 309 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:39.701876 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-addfd13f-135a-438d-ad8f-1a53ed2cb224 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90c36f903ecc4c8f9f00800e54daf910', 'request_id': 'req-addfd13f-135a-438d-ad8f-1a53ed2cb224'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:39.703525 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fd25b-0c3f-4920-ada4-bce44a948d89 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:39.711283 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-addfd13f-135a-438d-ad8f-1a53ed2cb224 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90c36f903ecc4c8f9f00800e54daf910', 'request_id': 'req-addfd13f-135a-438d-ad8f-1a53ed2cb224'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:39.717307 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fd25b-0c3f-4920-ada4-bce44a948d89 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:39.719837 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-addfd13f-135a-438d-ad8f-1a53ed2cb224 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90c36f903ecc4c8f9f00800e54daf910', 'request_id': 'req-addfd13f-135a-438d-ad8f-1a53ed2cb224'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:39.794835 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-addfd13f-135a-438d-ad8f-1a53ed2cb224 admin admin] The token cache is being invalidate because project 90c36f903ecc4c8f9f00800e54daf910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:33:39.798777 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-addfd13f-135a-438d-ad8f-1a53ed2cb224 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:39.798777 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-addfd13f-135a-438d-ad8f-1a53ed2cb224 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:39.800948 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 891/1775] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:33:39 2021] DELETE /identity/v3/projects/90c36f903ecc4c8f9f00800e54daf910 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:39.808283 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfd13f-135a-438d-ad8f-1a53ed2cb224 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:39.821758 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52074b-6675-4149-9d42-833a5180f0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:39.821957 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-addfd13f-135a-438d-ad8f-1a53ed2cb224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:39.825006 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52074b-6675-4149-9d42-833a5180f0c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:39.827539 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52074b-6675-4149-9d42-833a5180f0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:39.832678 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52074b-6675-4149-9d42-833a5180f0c6 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:39.832678 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52074b-6675-4149-9d42-833a5180f0c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:39.839304 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52074b-6675-4149-9d42-833a5180f0c6 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:39.853996 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfd13f-135a-438d-ad8f-1a53ed2cb224 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:39.866256 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866fba9-dd4e-48fc-83f6-bd1a15b2dadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:39.868825 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866fba9-dd4e-48fc-83f6-bd1a15b2dadc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:39.869159 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866fba9-dd4e-48fc-83f6-bd1a15b2dadc admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:39.869502 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866fba9-dd4e-48fc-83f6-bd1a15b2dadc admin admin] PATH_INFO: `/v3/projects/6698a977324e41e3902e26da76616ac0` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:39.873377 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b866fba9-dd4e-48fc-83f6-bd1a15b2dadc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6698a977324e41e3902e26da76616ac0)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:39.879827 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b866fba9-dd4e-48fc-83f6-bd1a15b2dadc admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:39.943529 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 885/1776] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:33:39 2021] POST /identity/v3/users => generated 289 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:39.945639 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3acbaf-e796-436f-8e27-2246c28ed8a2 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:39.947434 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3acbaf-e796-436f-8e27-2246c28ed8a2 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:39.947957 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3acbaf-e796-436f-8e27-2246c28ed8a2 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:39.953060 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 886/1777] 10.222.0.62 () {54 vars in 921 bytes} [Tue Nov 23 19:33:39 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:33:39.954156 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3acbaf-e796-436f-8e27-2246c28ed8a2 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:39.959023 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-ee3acbaf-e796-436f-8e27-2246c28ed8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:40.135110 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3acbaf-e796-436f-8e27-2246c28ed8a2 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:40.135110 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54290408-9247-4796-934e-6ac779588ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:40.135110 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54290408-9247-4796-934e-6ac779588ced admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:40.135110 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54290408-9247-4796-934e-6ac779588ced admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:40.136016 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54290408-9247-4796-934e-6ac779588ced admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:40.136016 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54290408-9247-4796-934e-6ac779588ced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:40.136016 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54290408-9247-4796-934e-6ac779588ced admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:40.136016 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 887/1778] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:39 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:40.136016 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d1fcb-36b9-4c0b-9cea-7514165c02d0 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:40.136016 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d1fcb-36b9-4c0b-9cea-7514165c02d0 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:40.136433 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d1fcb-36b9-4c0b-9cea-7514165c02d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:40.136433 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-848d1fcb-36b9-4c0b-9cea-7514165c02d0 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:40.136433 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-848d1fcb-36b9-4c0b-9cea-7514165c02d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:40.136433 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 888/1779] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:40.136433 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d1fcb-36b9-4c0b-9cea-7514165c02d0 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:40.136889 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-848d1fcb-36b9-4c0b-9cea-7514165c02d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:40.136889 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d1fcb-36b9-4c0b-9cea-7514165c02d0 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:40.136889 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4e739-816c-4d76-9e3a-991a0ca998ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:40.137091 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4e739-816c-4d76-9e3a-991a0ca998ce admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:40.137091 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4e739-816c-4d76-9e3a-991a0ca998ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:40.137091 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4e739-816c-4d76-9e3a-991a0ca998ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:40.137091 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4e739-816c-4d76-9e3a-991a0ca998ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:40.137091 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4e739-816c-4d76-9e3a-991a0ca998ce admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:40.137091 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 889/1780] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:40 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:40.138848 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c833ac4-5443-45b9-bc59-64b574c5e3a1 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:40.138848 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c833ac4-5443-45b9-bc59-64b574c5e3a1 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:40.138848 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c833ac4-5443-45b9-bc59-64b574c5e3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:40.138848 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-7c833ac4-5443-45b9-bc59-64b574c5e3a1 None None] MFA Rules not processed for user `6d91fe7f996b48b0bc28e1eadc4f8869`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:40.138848 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-7c833ac4-5443-45b9-bc59-64b574c5e3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:40.152871 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 890/1781] 10.222.0.62 () {58 vars in 1018 bytes} [Tue Nov 23 19:33:40 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:40.158399 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c833ac4-5443-45b9-bc59-64b574c5e3a1 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:40.186007 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c833ac4-5443-45b9-bc59-64b574c5e3a1 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:40.191439 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa760d4b-ac8b-45af-bd9f-555ebcce2005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:40.192720 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa760d4b-ac8b-45af-bd9f-555ebcce2005 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:40.193215 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa760d4b-ac8b-45af-bd9f-555ebcce2005 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:40.193758 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa760d4b-ac8b-45af-bd9f-555ebcce2005 admin admin] PATH_INFO: `/v3/projects/479baebddd6642f39e8dd4e65c609c4b/users/5d6800baf5f347789781c4e5bf4483b1/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:40.217638 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa760d4b-ac8b-45af-bd9f-555ebcce2005 admin admin] RBAC: Authorizing `identity:create_grant(project_id=479baebddd6642f39e8dd4e65c609c4b, user_id=5d6800baf5f347789781c4e5bf4483b1, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:40.230868 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa760d4b-ac8b-45af-bd9f-555ebcce2005 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:40.239399 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-b866fba9-dd4e-48fc-83f6-bd1a15b2dadc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6698a977324e41e3902e26da76616ac0', 'request_id': 'req-b866fba9-dd4e-48fc-83f6-bd1a15b2dadc'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:40.257009 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-b866fba9-dd4e-48fc-83f6-bd1a15b2dadc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6698a977324e41e3902e26da76616ac0', 'request_id': 'req-b866fba9-dd4e-48fc-83f6-bd1a15b2dadc'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:40.268363 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-b866fba9-dd4e-48fc-83f6-bd1a15b2dadc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6698a977324e41e3902e26da76616ac0', 'request_id': 'req-b866fba9-dd4e-48fc-83f6-bd1a15b2dadc'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:40.328071 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 891/1782] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:33:40 2021] PUT /identity/v3/projects/479baebddd6642f39e8dd4e65c609c4b/users/5d6800baf5f347789781c4e5bf4483b1/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:40.329346 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa760d4b-ac8b-45af-bd9f-555ebcce2005 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:40.400520 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-b866fba9-dd4e-48fc-83f6-bd1a15b2dadc admin admin] The token cache is being invalidate because project 6698a977324e41e3902e26da76616ac0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:33:40.400829 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-b866fba9-dd4e-48fc-83f6-bd1a15b2dadc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:40.401542 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-b866fba9-dd4e-48fc-83f6-bd1a15b2dadc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:40.403579 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 892/1783] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:33:39 2021] DELETE /identity/v3/projects/6698a977324e41e3902e26da76616ac0 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:40.404976 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4456691-7daf-4527-acc2-04d5a7511862 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:40.407365 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4456691-7daf-4527-acc2-04d5a7511862 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:40.407625 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4456691-7daf-4527-acc2-04d5a7511862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:40.467269 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-d4456691-7daf-4527-acc2-04d5a7511862 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:40.467269 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-d4456691-7daf-4527-acc2-04d5a7511862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:40.485103 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa760d4b-ac8b-45af-bd9f-555ebcce2005 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:40.492894 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e00fe-a6fd-4c06-800b-eaabf806c49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:40.508660 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e00fe-a6fd-4c06-800b-eaabf806c49d admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:40.508660 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e00fe-a6fd-4c06-800b-eaabf806c49d admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:40.508660 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e00fe-a6fd-4c06-800b-eaabf806c49d admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:40.508660 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e00fe-a6fd-4c06-800b-eaabf806c49d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:40.508660 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e00fe-a6fd-4c06-800b-eaabf806c49d admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:40.509218 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 893/1784] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:40.509218 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4456691-7daf-4527-acc2-04d5a7511862 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:40.509218 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-d4456691-7daf-4527-acc2-04d5a7511862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:40.552770 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 892/1785] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:40 2021] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:40.553675 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e00fe-a6fd-4c06-800b-eaabf806c49d admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:40.561636 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-b49e00fe-a6fd-4c06-800b-eaabf806c49d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:40.585763 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e00fe-a6fd-4c06-800b-eaabf806c49d admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:40.592510 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebeea8-3e18-4c9f-a3ec-31cdfd085881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:40.593230 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebeea8-3e18-4c9f-a3ec-31cdfd085881 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:40.593654 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebeea8-3e18-4c9f-a3ec-31cdfd085881 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:40.593919 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebeea8-3e18-4c9f-a3ec-31cdfd085881 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:40.594730 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebeea8-3e18-4c9f-a3ec-31cdfd085881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:40.598423 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebeea8-3e18-4c9f-a3ec-31cdfd085881 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:40.616120 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 893/1786] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:40 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:40.617807 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5bf5a-df00-409f-9e75-eb290010d17a None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:40.618167 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5bf5a-df00-409f-9e75-eb290010d17a None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:40.619009 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5bf5a-df00-409f-9e75-eb290010d17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:40.743880 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-0cd5bf5a-df00-409f-9e75-eb290010d17a None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:40.743880 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-0cd5bf5a-df00-409f-9e75-eb290010d17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:40.743880 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 894/1787] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:40.743880 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5bf5a-df00-409f-9e75-eb290010d17a None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:40.745513 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4456691-7daf-4527-acc2-04d5a7511862 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:40.745679 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5bf5a-df00-409f-9e75-eb290010d17a None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:40.745770 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94188f-d37e-4976-b74c-fe7ed057e424 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:40.747110 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94188f-d37e-4976-b74c-fe7ed057e424 service nova] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:40.747713 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94188f-d37e-4976-b74c-fe7ed057e424 service nova] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:40.748292 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94188f-d37e-4976-b74c-fe7ed057e424 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:40.753306 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-6a94188f-d37e-4976-b74c-fe7ed057e424 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:40.753870 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca542df-fbeb-43d4-8a41-34766a97c011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:40.755053 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca542df-fbeb-43d4-8a41-34766a97c011 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:40.755543 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca542df-fbeb-43d4-8a41-34766a97c011 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:40.756034 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca542df-fbeb-43d4-8a41-34766a97c011 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:40.757443 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca542df-fbeb-43d4-8a41-34766a97c011 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:33:40.757985 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca542df-fbeb-43d4-8a41-34766a97c011 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:40.762909 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca542df-fbeb-43d4-8a41-34766a97c011 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:40.818615 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 895/1788] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:33:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:33:40.820019 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca542df-fbeb-43d4-8a41-34766a97c011 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:40.834500 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-aca542df-fbeb-43d4-8a41-34766a97c011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:40.844436 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94188f-d37e-4976-b74c-fe7ed057e424 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:40.849939 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94188f-d37e-4976-b74c-fe7ed057e424 service nova] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:40.885665 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca542df-fbeb-43d4-8a41-34766a97c011 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:40.895556 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 894/1789] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:40 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:33:40.896260 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94188f-d37e-4976-b74c-fe7ed057e424 service nova] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:40.912856 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94188f-d37e-4976-b74c-fe7ed057e424 service nova] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:40.923070 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2a237-7a6b-4b6a-a75a-dd724a25c961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:40.923070 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2a237-7a6b-4b6a-a75a-dd724a25c961 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:40.923070 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2a237-7a6b-4b6a-a75a-dd724a25c961 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:40.923070 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2a237-7a6b-4b6a-a75a-dd724a25c961 admin admin] PATH_INFO: `/v3/projects/479baebddd6642f39e8dd4e65c609c4b/users/5d6800baf5f347789781c4e5bf4483b1/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:40.923435 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9b31b-dd0d-44bd-b86e-4a2817533c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:40.923435 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9b31b-dd0d-44bd-b86e-4a2817533c8b admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:40.923435 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9b31b-dd0d-44bd-b86e-4a2817533c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:40.923630 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2a237-7a6b-4b6a-a75a-dd724a25c961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=479baebddd6642f39e8dd4e65c609c4b, user_id=5d6800baf5f347789781c4e5bf4483b1, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:40.926325 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2a237-7a6b-4b6a-a75a-dd724a25c961 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:40.926785 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9b31b-dd0d-44bd-b86e-4a2817533c8b admin admin] PATH_INFO: `/v3/projects/b1b742d7d6cd4560b95273b99d07f2aa/users/2add15a51a4e44f9a15bf41c52d29898/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:40.943869 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 895/1790] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:33:40 2021] PUT /identity/v3/projects/479baebddd6642f39e8dd4e65c609c4b/users/5d6800baf5f347789781c4e5bf4483b1/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:40.946016 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67179be2-a153-43a1-a02f-a9acf50d8774 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:40.946384 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67179be2-a153-43a1-a02f-a9acf50d8774 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:40.946659 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67179be2-a153-43a1-a02f-a9acf50d8774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:40.980512 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9b31b-dd0d-44bd-b86e-4a2817533c8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1b742d7d6cd4560b95273b99d07f2aa, user_id=2add15a51a4e44f9a15bf41c52d29898, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:40.986377 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9b31b-dd0d-44bd-b86e-4a2817533c8b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:40.991028 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-67179be2-a153-43a1-a02f-a9acf50d8774 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:40.993113 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-67179be2-a153-43a1-a02f-a9acf50d8774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:41.101250 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 896/1791] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:33:40 2021] PUT /identity/v3/projects/b1b742d7d6cd4560b95273b99d07f2aa/users/2add15a51a4e44f9a15bf41c52d29898/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:41.108405 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 896/1792] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:41.109768 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d934c8-0e9b-48c3-9ef8-8d035099876d None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:41.110064 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d934c8-0e9b-48c3-9ef8-8d035099876d None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:41.110343 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d934c8-0e9b-48c3-9ef8-8d035099876d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:41.111228 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9b31b-dd0d-44bd-b86e-4a2817533c8b admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:41.164757 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-10d934c8-0e9b-48c3-9ef8-8d035099876d None None] MFA Rules not processed for user `5d6800baf5f347789781c4e5bf4483b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:41.166009 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-10d934c8-0e9b-48c3-9ef8-8d035099876d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:41.264863 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9b31b-dd0d-44bd-b86e-4a2817533c8b admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:41.272220 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860502f-31d1-4ab1-b894-8659a0a3f685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:41.273254 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860502f-31d1-4ab1-b894-8659a0a3f685 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:41.273783 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860502f-31d1-4ab1-b894-8659a0a3f685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:41.274103 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860502f-31d1-4ab1-b894-8659a0a3f685 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:41.275317 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b860502f-31d1-4ab1-b894-8659a0a3f685 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:41.278433 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b860502f-31d1-4ab1-b894-8659a0a3f685 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:41.371019 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 897/1793] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:33:41 2021] POST /identity/v3/projects => generated 403 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:41.373321 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a8a7a-cb9c-4268-9fff-5867a0bc6c8f None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:41.385888 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 897/1794] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:41 2021] POST /identity/v3/auth/tokens => generated 3339 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:41.389685 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a8a7a-cb9c-4268-9fff-5867a0bc6c8f None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:41.389685 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a8a7a-cb9c-4268-9fff-5867a0bc6c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:41.389860 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d934c8-0e9b-48c3-9ef8-8d035099876d None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:41.407066 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d934c8-0e9b-48c3-9ef8-8d035099876d None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:41.444715 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-7e8a8a7a-cb9c-4268-9fff-5867a0bc6c8f None None] MFA Rules not processed for user `2add15a51a4e44f9a15bf41c52d29898`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:41.446178 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-7e8a8a7a-cb9c-4268-9fff-5867a0bc6c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:41.579001 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cec47-8457-4b70-bffd-1d78b3d4ece5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:41.579912 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cec47-8457-4b70-bffd-1d78b3d4ece5 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:41.581862 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cec47-8457-4b70-bffd-1d78b3d4ece5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:41.582187 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cec47-8457-4b70-bffd-1d78b3d4ece5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:41.583040 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cec47-8457-4b70-bffd-1d78b3d4ece5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:33:41.583315 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 898/1795] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:41 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:41.583591 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cec47-8457-4b70-bffd-1d78b3d4ece5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:41.584405 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a8a7a-cb9c-4268-9fff-5867a0bc6c8f None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:41.587746 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cec47-8457-4b70-bffd-1d78b3d4ece5 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:41.595761 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a8a7a-cb9c-4268-9fff-5867a0bc6c8f None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:41.601293 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10b4a0-4803-4771-b0f2-8d97d16babac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:41.602056 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10b4a0-4803-4771-b0f2-8d97d16babac admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:41.602348 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10b4a0-4803-4771-b0f2-8d97d16babac admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:41.602693 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10b4a0-4803-4771-b0f2-8d97d16babac admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:41.603431 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10b4a0-4803-4771-b0f2-8d97d16babac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:41.613141 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10b4a0-4803-4771-b0f2-8d97d16babac admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:41.621778 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 898/1796] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:33:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:33:41.622683 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cec47-8457-4b70-bffd-1d78b3d4ece5 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:41.739649 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-412cec47-8457-4b70-bffd-1d78b3d4ece5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:41.744234 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cec47-8457-4b70-bffd-1d78b3d4ece5 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:41.748697 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1e02a-9963-4d7a-8845-e0a6a691bd2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:41.749375 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1e02a-9963-4d7a-8845-e0a6a691bd2d service cinder] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:41.749688 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1e02a-9963-4d7a-8845-e0a6a691bd2d service cinder] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:41.749975 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1e02a-9963-4d7a-8845-e0a6a691bd2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:41.822266 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1e02a-9963-4d7a-8845-e0a6a691bd2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:41.825069 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1e02a-9963-4d7a-8845-e0a6a691bd2d service cinder] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:41.847846 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 899/1797] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:41 2021] GET /identity/v3/auth/tokens => generated 3339 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:33:41.848843 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1e02a-9963-4d7a-8845-e0a6a691bd2d service cinder] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:41.855348 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-4ad1e02a-9963-4d7a-8845-e0a6a691bd2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:41.899915 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1e02a-9963-4d7a-8845-e0a6a691bd2d service cinder] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:41.915564 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db4a08-d980-4e3b-bf8c-a76255fc019c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:41.916471 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db4a08-d980-4e3b-bf8c-a76255fc019c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:41.916740 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db4a08-d980-4e3b-bf8c-a76255fc019c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:41.917013 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db4a08-d980-4e3b-bf8c-a76255fc019c admin admin] PATH_INFO: `/v3/users/203f5f33dd5046e0897cfc299cc2caee` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:41.920229 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db4a08-d980-4e3b-bf8c-a76255fc019c admin admin] RBAC: Authorizing `identity:delete_user(user_id=203f5f33dd5046e0897cfc299cc2caee)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:41.922369 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db4a08-d980-4e3b-bf8c-a76255fc019c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:41.939084 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 899/1798] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:33:41 2021] POST /identity/v3/users => generated 302 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:41.942686 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10b4a0-4803-4771-b0f2-8d97d16babac admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:41.971547 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10b4a0-4803-4771-b0f2-8d97d16babac admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:41.996252 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0614f-ce60-426e-a2b8-6cdaa7784abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:42.000143 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0614f-ce60-426e-a2b8-6cdaa7784abc admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:42.001696 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0614f-ce60-426e-a2b8-6cdaa7784abc admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:42.005676 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0614f-ce60-426e-a2b8-6cdaa7784abc admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:42.015874 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0614f-ce60-426e-a2b8-6cdaa7784abc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:42.025805 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0614f-ce60-426e-a2b8-6cdaa7784abc admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:42.354167 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 900/1799] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:33:41 2021] POST /identity/v3/projects => generated 375 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:42.356208 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0614f-ce60-426e-a2b8-6cdaa7784abc admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:42.413480 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-b0db4a08-d980-4e3b-bf8c-a76255fc019c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '203f5f33dd5046e0897cfc299cc2caee'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:42.415624 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-b0db4a08-d980-4e3b-bf8c-a76255fc019c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '203f5f33dd5046e0897cfc299cc2caee'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:42.428177 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-b0db4a08-d980-4e3b-bf8c-a76255fc019c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '203f5f33dd5046e0897cfc299cc2caee'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:42.435670 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-b0db4a08-d980-4e3b-bf8c-a76255fc019c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '203f5f33dd5046e0897cfc299cc2caee'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:42.441882 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-b0db4a08-d980-4e3b-bf8c-a76255fc019c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '203f5f33dd5046e0897cfc299cc2caee'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:42.470289 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0614f-ce60-426e-a2b8-6cdaa7784abc admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:42.475495 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b6628-c1b6-43d7-aa11-c6647f0b689a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:42.476169 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b6628-c1b6-43d7-aa11-c6647f0b689a admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:42.476450 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b6628-c1b6-43d7-aa11-c6647f0b689a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:42.476731 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b6628-c1b6-43d7-aa11-c6647f0b689a admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:42.477472 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b6628-c1b6-43d7-aa11-c6647f0b689a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:42.479399 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b6628-c1b6-43d7-aa11-c6647f0b689a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:42.622624 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 900/1800] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:33:41 2021] DELETE /identity/v3/users/203f5f33dd5046e0897cfc299cc2caee => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:42.623653 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db4a08-d980-4e3b-bf8c-a76255fc019c admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:42.626756 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 901/1801] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:33:42 2021] POST /identity/v3/projects => generated 389 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:42.626756 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b6628-c1b6-43d7-aa11-c6647f0b689a admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:42.626991 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-b0db4a08-d980-4e3b-bf8c-a76255fc019c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:42.628118 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-190b6628-c1b6-43d7-aa11-c6647f0b689a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:42.731956 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b6628-c1b6-43d7-aa11-c6647f0b689a admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:42.732635 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db4a08-d980-4e3b-bf8c-a76255fc019c admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:42.739972 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90217d0-5cfe-4adb-b4b1-ee0c797aee2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:42.741133 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90217d0-5cfe-4adb-b4b1-ee0c797aee2c admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:42.741713 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90217d0-5cfe-4adb-b4b1-ee0c797aee2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:42.742442 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90217d0-5cfe-4adb-b4b1-ee0c797aee2c admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:42.743593 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90217d0-5cfe-4adb-b4b1-ee0c797aee2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:42.747198 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90217d0-5cfe-4adb-b4b1-ee0c797aee2c admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:42.766651 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b861f5f-8200-4d59-bcf9-880a75e8d2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:42.768259 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b861f5f-8200-4d59-bcf9-880a75e8d2da admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:42.768980 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b861f5f-8200-4d59-bcf9-880a75e8d2da admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:42.769608 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b861f5f-8200-4d59-bcf9-880a75e8d2da admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:42.771287 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b861f5f-8200-4d59-bcf9-880a75e8d2da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:42.778963 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b861f5f-8200-4d59-bcf9-880a75e8d2da admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:42.826067 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 901/1802] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:42 2021] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:42.834498 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49846f46-4ce0-4ce6-bd80-801fef5994d5 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:42.834793 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49846f46-4ce0-4ce6-bd80-801fef5994d5 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:42.835072 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49846f46-4ce0-4ce6-bd80-801fef5994d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:42.900601 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-49846f46-4ce0-4ce6-bd80-801fef5994d5 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:42.919081 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 902/1803] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:33:42 2021] POST /identity/v3/users => generated 294 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:42.921071 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90217d0-5cfe-4adb-b4b1-ee0c797aee2c admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:42.923105 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-49846f46-4ce0-4ce6-bd80-801fef5994d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:42.924042 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-a90217d0-5cfe-4adb-b4b1-ee0c797aee2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:42.953781 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 902/1804] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:42.955777 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49846f46-4ce0-4ce6-bd80-801fef5994d5 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:42.967771 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49846f46-4ce0-4ce6-bd80-801fef5994d5 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:42.973668 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6216b-bbd6-4209-bce2-5b135ddbcfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:42.974385 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6216b-bbd6-4209-bce2-5b135ddbcfa4 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:42.974645 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6216b-bbd6-4209-bce2-5b135ddbcfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:42.974922 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6216b-bbd6-4209-bce2-5b135ddbcfa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:42.975673 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90217d0-5cfe-4adb-b4b1-ee0c797aee2c admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:42.975790 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb6216b-bbd6-4209-bce2-5b135ddbcfa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:42.977289 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb6216b-bbd6-4209-bce2-5b135ddbcfa4 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:42.986424 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f583f6-b235-41ee-a771-9c2e985dff6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:42.989450 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 903/1805] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:42 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:42.990234 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6216b-bbd6-4209-bce2-5b135ddbcfa4 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:42.992676 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f583f6-b235-41ee-a771-9c2e985dff6f admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:42.992973 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f583f6-b235-41ee-a771-9c2e985dff6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:42.993251 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f583f6-b235-41ee-a771-9c2e985dff6f admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:42.994031 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f583f6-b235-41ee-a771-9c2e985dff6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:42.996034 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f583f6-b235-41ee-a771-9c2e985dff6f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:43.001393 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6216b-bbd6-4209-bce2-5b135ddbcfa4 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:43.015310 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4a7b0-2bc4-4f7c-982a-5eb413aa3b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:43.019414 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4a7b0-2bc4-4f7c-982a-5eb413aa3b9c admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:43.019414 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4a7b0-2bc4-4f7c-982a-5eb413aa3b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:43.019414 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4a7b0-2bc4-4f7c-982a-5eb413aa3b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:43.019414 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4a7b0-2bc4-4f7c-982a-5eb413aa3b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:43.037515 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4a7b0-2bc4-4f7c-982a-5eb413aa3b9c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:43.054231 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 904/1806] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:42 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:43.054231 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4a7b0-2bc4-4f7c-982a-5eb413aa3b9c admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:43.059549 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-d9d4a7b0-2bc4-4f7c-982a-5eb413aa3b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:43.180700 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4a7b0-2bc4-4f7c-982a-5eb413aa3b9c admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:43.186409 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b02b4-c730-4ca6-a353-37f6600411df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:43.187079 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b02b4-c730-4ca6-a353-37f6600411df service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:43.187366 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b02b4-c730-4ca6-a353-37f6600411df service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:43.187645 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b02b4-c730-4ca6-a353-37f6600411df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:43.204486 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b02b4-c730-4ca6-a353-37f6600411df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:43.205990 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b02b4-c730-4ca6-a353-37f6600411df service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:43.216485 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 905/1807] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:33:43.217313 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b02b4-c730-4ca6-a353-37f6600411df service neutron] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:43.227681 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b02b4-c730-4ca6-a353-37f6600411df service neutron] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:43.233582 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e77ff8-a422-4ff7-a8e3-5f50bc17710c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:43.234492 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e77ff8-a422-4ff7-a8e3-5f50bc17710c admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:43.234775 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e77ff8-a422-4ff7-a8e3-5f50bc17710c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:43.235052 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e77ff8-a422-4ff7-a8e3-5f50bc17710c admin admin] PATH_INFO: `/v3/projects/f5865a946ab24f399d59484590b84a91/users/b5073537fe314b15b076f6a5448acb1a/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:43.265663 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e77ff8-a422-4ff7-a8e3-5f50bc17710c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5865a946ab24f399d59484590b84a91, user_id=b5073537fe314b15b076f6a5448acb1a, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:43.268056 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 903/1808] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:33:42 2021] POST /identity/v3/users => generated 295 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:43.269289 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e77ff8-a422-4ff7-a8e3-5f50bc17710c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:43.269548 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f583f6-b235-41ee-a771-9c2e985dff6f admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:43.280631 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f583f6-b235-41ee-a771-9c2e985dff6f admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:43.300037 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b46671-4dcf-4b70-bc1b-45f546a832d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:43.300037 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b46671-4dcf-4b70-bc1b-45f546a832d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:43.300037 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b46671-4dcf-4b70-bc1b-45f546a832d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:43.300037 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b46671-4dcf-4b70-bc1b-45f546a832d4 admin admin] PATH_INFO: `/v3/projects/1fa92d08844c446897deca64d27bca7e/users/cef626cddbf3482a94c43b0322da216f/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:43.315175 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b46671-4dcf-4b70-bc1b-45f546a832d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fa92d08844c446897deca64d27bca7e, user_id=cef626cddbf3482a94c43b0322da216f, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:43.318554 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b46671-4dcf-4b70-bc1b-45f546a832d4 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:43.352097 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 906/1809] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:33:43 2021] PUT /identity/v3/projects/f5865a946ab24f399d59484590b84a91/users/b5073537fe314b15b076f6a5448acb1a/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:43.352988 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e77ff8-a422-4ff7-a8e3-5f50bc17710c admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:43.354749 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-46e77ff8-a422-4ff7-a8e3-5f50bc17710c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:43.401365 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 904/1810] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:33:43 2021] PUT /identity/v3/projects/1fa92d08844c446897deca64d27bca7e/users/cef626cddbf3482a94c43b0322da216f/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:43.403856 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a9635-03a7-4a84-9745-0161047874a8 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:43.404412 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a9635-03a7-4a84-9745-0161047874a8 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:43.404837 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a9635-03a7-4a84-9745-0161047874a8 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:43.411905 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 905/1811] 10.222.0.62 () {54 vars in 921 bytes} [Tue Nov 23 19:33:43 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:33:43.415616 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a9635-03a7-4a84-9745-0161047874a8 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:43.480531 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e77ff8-a422-4ff7-a8e3-5f50bc17710c admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:43.578171 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80844b-6a14-40c0-9c76-3e62da089fb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:43.578953 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80844b-6a14-40c0-9c76-3e62da089fb5 service cinder] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:43.579520 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80844b-6a14-40c0-9c76-3e62da089fb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:43.579879 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80844b-6a14-40c0-9c76-3e62da089fb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:43.583665 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-1c80844b-6a14-40c0-9c76-3e62da089fb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:43.593773 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a9635-03a7-4a84-9745-0161047874a8 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:43.611857 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c88855-2a2e-46ee-9367-2767d4e5b20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:43.622085 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c88855-2a2e-46ee-9367-2767d4e5b20a admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:43.622085 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c88855-2a2e-46ee-9367-2767d4e5b20a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:43.622085 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c88855-2a2e-46ee-9367-2767d4e5b20a admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:43.622085 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c88855-2a2e-46ee-9367-2767d4e5b20a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:43.622085 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c88855-2a2e-46ee-9367-2767d4e5b20a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:43.635245 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 906/1812] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:43 2021] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:43.638280 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c88855-2a2e-46ee-9367-2767d4e5b20a admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:43.674678 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c88855-2a2e-46ee-9367-2767d4e5b20a admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:43.691432 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848000e0-6a04-46fe-a0c0-e0756c5e2314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:43.691432 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848000e0-6a04-46fe-a0c0-e0756c5e2314 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:43.691432 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848000e0-6a04-46fe-a0c0-e0756c5e2314 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:43.691432 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848000e0-6a04-46fe-a0c0-e0756c5e2314 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:43.691822 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80844b-6a14-40c0-9c76-3e62da089fb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:43.691913 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848000e0-6a04-46fe-a0c0-e0756c5e2314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:43.692771 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80844b-6a14-40c0-9c76-3e62da089fb5 service cinder] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:43.694212 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848000e0-6a04-46fe-a0c0-e0756c5e2314 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:43.732500 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 907/1813] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:43 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:43.732500 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe2034-b41d-48cb-b7ab-70c831508982 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:43.732814 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe2034-b41d-48cb-b7ab-70c831508982 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:43.732814 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe2034-b41d-48cb-b7ab-70c831508982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:43.741972 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 907/1814] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:43 2021] GET /identity/v3/auth/tokens => generated 3276 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:33:43.743433 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a7d41-1b35-49dc-a37f-072c89fe7b9a None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:43.754646 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a7d41-1b35-49dc-a37f-072c89fe7b9a None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:43.754646 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a7d41-1b35-49dc-a37f-072c89fe7b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:43.808413 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-d8fe2034-b41d-48cb-b7ab-70c831508982 None None] MFA Rules not processed for user `b5073537fe314b15b076f6a5448acb1a`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:43.811447 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-d8fe2034-b41d-48cb-b7ab-70c831508982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:43.827573 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-8f9a7d41-1b35-49dc-a37f-072c89fe7b9a None None] MFA Rules not processed for user `6d91fe7f996b48b0bc28e1eadc4f8869`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:43.828964 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-8f9a7d41-1b35-49dc-a37f-072c89fe7b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:43.995420 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 908/1815] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:43 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:43.995420 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe2034-b41d-48cb-b7ab-70c831508982 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:44.001243 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 908/1816] 10.222.0.62 () {58 vars in 1018 bytes} [Tue Nov 23 19:33:43 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:44.002524 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a7d41-1b35-49dc-a37f-072c89fe7b9a None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:44.018667 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a7d41-1b35-49dc-a37f-072c89fe7b9a None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:44.025564 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe2034-b41d-48cb-b7ab-70c831508982 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:44.037638 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85ae2d-4bdb-492a-9130-57e07ea026e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:44.044341 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85ae2d-4bdb-492a-9130-57e07ea026e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:44.044341 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85ae2d-4bdb-492a-9130-57e07ea026e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:44.044341 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85ae2d-4bdb-492a-9130-57e07ea026e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:44.044341 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85ae2d-4bdb-492a-9130-57e07ea026e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:44.044341 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85ae2d-4bdb-492a-9130-57e07ea026e9 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:44.044733 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a6661-0371-46cf-a857-e2072161d047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:44.044733 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a6661-0371-46cf-a857-e2072161d047 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:44.044733 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a6661-0371-46cf-a857-e2072161d047 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:44.044733 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a6661-0371-46cf-a857-e2072161d047 admin admin] PATH_INFO: `/v3/projects/1fa92d08844c446897deca64d27bca7e/users/cef626cddbf3482a94c43b0322da216f/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:44.046091 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a6661-0371-46cf-a857-e2072161d047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fa92d08844c446897deca64d27bca7e, user_id=cef626cddbf3482a94c43b0322da216f, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:44.049107 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a6661-0371-46cf-a857-e2072161d047 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:44.073479 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 909/1818] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:33:44 2021] PUT /identity/v3/projects/1fa92d08844c446897deca64d27bca7e/users/cef626cddbf3482a94c43b0322da216f/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:44.077552 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 909/1818] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:43 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:44.078585 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85ae2d-4bdb-492a-9130-57e07ea026e9 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:44.080340 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-bb85ae2d-4bdb-492a-9130-57e07ea026e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:44.083851 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a6661-0371-46cf-a857-e2072161d047 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:44.101784 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85ae2d-4bdb-492a-9130-57e07ea026e9 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:44.268406 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a6661-0371-46cf-a857-e2072161d047 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:44.275043 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a370f9d-e83d-469e-b067-fb61fe0c988d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:44.277099 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0742c9c-e5bb-4004-9004-71f91447759e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:44.277219 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a370f9d-e83d-469e-b067-fb61fe0c988d admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:44.277313 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0742c9c-e5bb-4004-9004-71f91447759e service nova] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:44.277389 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a370f9d-e83d-469e-b067-fb61fe0c988d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:44.277495 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0742c9c-e5bb-4004-9004-71f91447759e service nova] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:44.277591 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a370f9d-e83d-469e-b067-fb61fe0c988d admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:44.277663 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0742c9c-e5bb-4004-9004-71f91447759e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:44.277742 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a370f9d-e83d-469e-b067-fb61fe0c988d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:44.281735 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a370f9d-e83d-469e-b067-fb61fe0c988d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:44.293685 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0742c9c-e5bb-4004-9004-71f91447759e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:44.296123 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0742c9c-e5bb-4004-9004-71f91447759e service nova] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:44.317895 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 910/1819] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:44 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:33:44.323201 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0742c9c-e5bb-4004-9004-71f91447759e service nova] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:44.339774 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0742c9c-e5bb-4004-9004-71f91447759e service nova] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:44.344972 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbdda19-50b4-4b06-98bd-b98003dff5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:44.347738 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbdda19-50b4-4b06-98bd-b98003dff5a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:44.347738 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbdda19-50b4-4b06-98bd-b98003dff5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:44.347738 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbdda19-50b4-4b06-98bd-b98003dff5a0 admin admin] PATH_INFO: `/v3/projects/d43adfbe38b44fdbbe29abd5429c35eb/users/e4168fdc638d48ba9751cd40d746f0e8/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:44.373651 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbdda19-50b4-4b06-98bd-b98003dff5a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d43adfbe38b44fdbbe29abd5429c35eb, user_id=e4168fdc638d48ba9751cd40d746f0e8, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:44.374944 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbdda19-50b4-4b06-98bd-b98003dff5a0 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:44.535435 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 910/1820] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:33:44 2021] POST /identity/v3/projects => generated 403 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:44.535435 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f61f9c-9fa9-4de6-9e06-71248bc68579 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:44.535435 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f61f9c-9fa9-4de6-9e06-71248bc68579 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:44.535435 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f61f9c-9fa9-4de6-9e06-71248bc68579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:44.563671 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-29f61f9c-9fa9-4de6-9e06-71248bc68579 None None] MFA Rules not processed for user `cef626cddbf3482a94c43b0322da216f`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:44.565097 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-29f61f9c-9fa9-4de6-9e06-71248bc68579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:44.595380 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 911/1821] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:33:44 2021] PUT /identity/v3/projects/d43adfbe38b44fdbbe29abd5429c35eb/users/e4168fdc638d48ba9751cd40d746f0e8/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:44.598102 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbdda19-50b4-4b06-98bd-b98003dff5a0 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:44.600280 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-dcbdda19-50b4-4b06-98bd-b98003dff5a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:44.658092 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 911/1822] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:44 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:44.659123 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f61f9c-9fa9-4de6-9e06-71248bc68579 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:44.687874 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbdda19-50b4-4b06-98bd-b98003dff5a0 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:44.708105 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529e0ba-3361-4c11-9b0b-f67d166d45e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:44.709079 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529e0ba-3361-4c11-9b0b-f67d166d45e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:44.709370 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529e0ba-3361-4c11-9b0b-f67d166d45e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:44.709678 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529e0ba-3361-4c11-9b0b-f67d166d45e1 admin admin] PATH_INFO: `/v3/projects/4b0a9c91e7894d16b675e67539d818d6` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:44.711690 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529e0ba-3361-4c11-9b0b-f67d166d45e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b0a9c91e7894d16b675e67539d818d6)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:44.714081 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529e0ba-3361-4c11-9b0b-f67d166d45e1 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:44.766576 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f61f9c-9fa9-4de6-9e06-71248bc68579 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:44.792906 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b181575-3a6b-45ae-8f38-e9fc899dd8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:44.793636 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b181575-3a6b-45ae-8f38-e9fc899dd8d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:44.797734 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b181575-3a6b-45ae-8f38-e9fc899dd8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:44.797734 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b181575-3a6b-45ae-8f38-e9fc899dd8d9 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:44.797734 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b181575-3a6b-45ae-8f38-e9fc899dd8d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:44.814148 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b181575-3a6b-45ae-8f38-e9fc899dd8d9 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:45.167276 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 912/1823] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:33:44 2021] POST /identity/v3/users => generated 308 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:45.169170 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793d625-52cb-43b8-9f18-8cdd9174522f None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:45.169957 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793d625-52cb-43b8-9f18-8cdd9174522f None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:45.170659 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793d625-52cb-43b8-9f18-8cdd9174522f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:45.204094 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-0529e0ba-3361-4c11-9b0b-f67d166d45e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b0a9c91e7894d16b675e67539d818d6', 'request_id': 'req-0529e0ba-3361-4c11-9b0b-f67d166d45e1'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:45.211231 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-0529e0ba-3361-4c11-9b0b-f67d166d45e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b0a9c91e7894d16b675e67539d818d6', 'request_id': 'req-0529e0ba-3361-4c11-9b0b-f67d166d45e1'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:45.215442 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-b793d625-52cb-43b8-9f18-8cdd9174522f None None] MFA Rules not processed for user `e4168fdc638d48ba9751cd40d746f0e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:45.216682 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-b793d625-52cb-43b8-9f18-8cdd9174522f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:45.218649 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-0529e0ba-3361-4c11-9b0b-f67d166d45e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b0a9c91e7894d16b675e67539d818d6', 'request_id': 'req-0529e0ba-3361-4c11-9b0b-f67d166d45e1'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:45.295721 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-0529e0ba-3361-4c11-9b0b-f67d166d45e1 admin admin] The token cache is being invalidate because project 4b0a9c91e7894d16b675e67539d818d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:33:45.299769 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-0529e0ba-3361-4c11-9b0b-f67d166d45e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:45.299769 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-0529e0ba-3361-4c11-9b0b-f67d166d45e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:45.299769 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 912/1824] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:33:44 2021] DELETE /identity/v3/projects/4b0a9c91e7894d16b675e67539d818d6 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:45.299769 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529e0ba-3361-4c11-9b0b-f67d166d45e1 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:45.301885 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-0529e0ba-3361-4c11-9b0b-f67d166d45e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:45.304858 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 913/1825] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:45 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:45.305850 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793d625-52cb-43b8-9f18-8cdd9174522f None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:45.367144 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529e0ba-3361-4c11-9b0b-f67d166d45e1 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:45.371233 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0ea13-589b-49b5-ae40-745a50d068d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:45.372181 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0ea13-589b-49b5-ae40-745a50d068d8 service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:45.372633 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0ea13-589b-49b5-ae40-745a50d068d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:45.373057 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0ea13-589b-49b5-ae40-745a50d068d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:45.375237 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-20d0ea13-589b-49b5-ae40-745a50d068d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:45.381486 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793d625-52cb-43b8-9f18-8cdd9174522f None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:45.388783 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940c386-ae10-4f4f-bb6e-04ef29c21d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:45.391635 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940c386-ae10-4f4f-bb6e-04ef29c21d37 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:45.391635 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940c386-ae10-4f4f-bb6e-04ef29c21d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:45.391635 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940c386-ae10-4f4f-bb6e-04ef29c21d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:45.391635 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5940c386-ae10-4f4f-bb6e-04ef29c21d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:45.394229 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5940c386-ae10-4f4f-bb6e-04ef29c21d37 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:45.414371 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 914/1826] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:45 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:45.415431 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940c386-ae10-4f4f-bb6e-04ef29c21d37 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:45.417396 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-5940c386-ae10-4f4f-bb6e-04ef29c21d37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:45.430388 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940c386-ae10-4f4f-bb6e-04ef29c21d37 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:45.435305 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db88e17-6d6a-49a8-8bc0-5ba42cb44934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:45.436167 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db88e17-6d6a-49a8-8bc0-5ba42cb44934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:45.436443 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db88e17-6d6a-49a8-8bc0-5ba42cb44934 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:45.436714 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db88e17-6d6a-49a8-8bc0-5ba42cb44934 admin admin] PATH_INFO: `/v3/users/384aa4a772f4473aae3b6d37fa039822` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:45.438060 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db88e17-6d6a-49a8-8bc0-5ba42cb44934 admin admin] RBAC: Authorizing `identity:delete_user(user_id=384aa4a772f4473aae3b6d37fa039822)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:45.439925 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db88e17-6d6a-49a8-8bc0-5ba42cb44934 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:45.452229 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0ea13-589b-49b5-ae40-745a50d068d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:45.454156 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0ea13-589b-49b5-ae40-745a50d068d8 service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:45.466769 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 913/1827] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:45 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:33:45.467677 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0ea13-589b-49b5-ae40-745a50d068d8 service cinder] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:45.469168 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-20d0ea13-589b-49b5-ae40-745a50d068d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:45.484949 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0ea13-589b-49b5-ae40-745a50d068d8 service cinder] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:45.490006 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807e00d-4edd-4c78-a007-76c7e4a4f736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:45.490861 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807e00d-4edd-4c78-a007-76c7e4a4f736 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:45.491289 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807e00d-4edd-4c78-a007-76c7e4a4f736 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:45.491568 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807e00d-4edd-4c78-a007-76c7e4a4f736 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:45.492327 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807e00d-4edd-4c78-a007-76c7e4a4f736 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:45.494902 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807e00d-4edd-4c78-a007-76c7e4a4f736 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:45.562201 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 914/1828] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:33:45 2021] POST /identity/v3/projects => generated 391 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:45.563100 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807e00d-4edd-4c78-a007-76c7e4a4f736 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:45.567614 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-8807e00d-4edd-4c78-a007-76c7e4a4f736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:45.610908 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-8db88e17-6d6a-49a8-8bc0-5ba42cb44934 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '384aa4a772f4473aae3b6d37fa039822'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:45.612016 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-8db88e17-6d6a-49a8-8bc0-5ba42cb44934 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '384aa4a772f4473aae3b6d37fa039822'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:45.772644 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-8db88e17-6d6a-49a8-8bc0-5ba42cb44934 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '384aa4a772f4473aae3b6d37fa039822'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:45.772644 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-8db88e17-6d6a-49a8-8bc0-5ba42cb44934 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '384aa4a772f4473aae3b6d37fa039822'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:45.772644 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-8db88e17-6d6a-49a8-8bc0-5ba42cb44934 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '384aa4a772f4473aae3b6d37fa039822'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:45.774055 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807e00d-4edd-4c78-a007-76c7e4a4f736 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:45.774055 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287ba3f-4b2e-4473-856e-efe0590abdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:45.774055 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287ba3f-4b2e-4473-856e-efe0590abdb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:45.774055 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287ba3f-4b2e-4473-856e-efe0590abdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:45.774896 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287ba3f-4b2e-4473-856e-efe0590abdb0 admin admin] PATH_INFO: `/v3/projects/fcafd51b834f475f8ed7b6642968fe67/users/b53d91bf9e564ebb9c7d0c3acf9eab97/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:45.774896 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287ba3f-4b2e-4473-856e-efe0590abdb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcafd51b834f475f8ed7b6642968fe67, user_id=b53d91bf9e564ebb9c7d0c3acf9eab97, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:45.774896 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287ba3f-4b2e-4473-856e-efe0590abdb0 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:45.853141 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 915/1829] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:33:45 2021] DELETE /identity/v3/users/384aa4a772f4473aae3b6d37fa039822 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:45.854052 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db88e17-6d6a-49a8-8bc0-5ba42cb44934 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:45.860720 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-8db88e17-6d6a-49a8-8bc0-5ba42cb44934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:45.860970 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 915/1830] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:33:45 2021] PUT /identity/v3/projects/fcafd51b834f475f8ed7b6642968fe67/users/b53d91bf9e564ebb9c7d0c3acf9eab97/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:45.864962 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287ba3f-4b2e-4473-856e-efe0590abdb0 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:45.867143 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-8287ba3f-4b2e-4473-856e-efe0590abdb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:45.967486 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287ba3f-4b2e-4473-856e-efe0590abdb0 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:45.985341 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db88e17-6d6a-49a8-8bc0-5ba42cb44934 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:45.995393 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441e0a1-e4bb-45d3-ac58-5aae2cfb301a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:45.996533 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441e0a1-e4bb-45d3-ac58-5aae2cfb301a admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:45.996835 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441e0a1-e4bb-45d3-ac58-5aae2cfb301a admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:45.997109 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441e0a1-e4bb-45d3-ac58-5aae2cfb301a admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:45.997852 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441e0a1-e4bb-45d3-ac58-5aae2cfb301a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:46.003876 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441e0a1-e4bb-45d3-ac58-5aae2cfb301a admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:46.057127 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5287d3-c403-4203-b52d-0b7773a6e8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:46.057851 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5287d3-c403-4203-b52d-0b7773a6e8b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:46.058277 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5287d3-c403-4203-b52d-0b7773a6e8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:46.058633 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5287d3-c403-4203-b52d-0b7773a6e8b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:46.059445 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5287d3-c403-4203-b52d-0b7773a6e8b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:46.061159 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5287d3-c403-4203-b52d-0b7773a6e8b4 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:46.071427 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 916/1831] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:45 2021] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:46.075729 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5287d3-c403-4203-b52d-0b7773a6e8b4 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:46.085975 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5287d3-c403-4203-b52d-0b7773a6e8b4 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:46.090717 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f340fced-e302-4449-81d2-c7ffbc212c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:46.091591 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340fced-e302-4449-81d2-c7ffbc212c64 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:46.091894 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340fced-e302-4449-81d2-c7ffbc212c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:46.092170 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340fced-e302-4449-81d2-c7ffbc212c64 admin admin] PATH_INFO: `/v3/projects/fcafd51b834f475f8ed7b6642968fe67/users/b53d91bf9e564ebb9c7d0c3acf9eab97/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:46.094177 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f340fced-e302-4449-81d2-c7ffbc212c64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcafd51b834f475f8ed7b6642968fe67, user_id=b53d91bf9e564ebb9c7d0c3acf9eab97, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:46.098131 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f340fced-e302-4449-81d2-c7ffbc212c64 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:46.104708 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 916/1832] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:33:45 2021] POST /identity/v3/users => generated 302 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:46.108390 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441e0a1-e4bb-45d3-ac58-5aae2cfb301a admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:46.110852 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 917/1833] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:33:46 2021] PUT /identity/v3/projects/fcafd51b834f475f8ed7b6642968fe67/users/b53d91bf9e564ebb9c7d0c3acf9eab97/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:33:46.120931 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee824c5-32d4-47db-bf78-a47b47b2abd6 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:46.121316 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee824c5-32d4-47db-bf78-a47b47b2abd6 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:46.121772 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee824c5-32d4-47db-bf78-a47b47b2abd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:46.127543 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441e0a1-e4bb-45d3-ac58-5aae2cfb301a admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:46.172369 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-aee824c5-32d4-47db-bf78-a47b47b2abd6 None None] MFA Rules not processed for user `b53d91bf9e564ebb9c7d0c3acf9eab97`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:46.173771 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-aee824c5-32d4-47db-bf78-a47b47b2abd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:46.218808 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7759d5-8990-46e0-b493-511e57116f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:46.219893 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7759d5-8990-46e0-b493-511e57116f73 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:46.220346 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7759d5-8990-46e0-b493-511e57116f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:46.220772 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7759d5-8990-46e0-b493-511e57116f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:46.221694 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7759d5-8990-46e0-b493-511e57116f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:46.223985 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7759d5-8990-46e0-b493-511e57116f73 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:46.235001 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 917/1834] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:46 2021] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:33:46.241488 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7759d5-8990-46e0-b493-511e57116f73 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:46.257872 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7759d5-8990-46e0-b493-511e57116f73 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:46.265878 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319daa0-00a6-4c4c-a6f7-fd1a9852087a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:46.266985 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319daa0-00a6-4c4c-a6f7-fd1a9852087a admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:46.267269 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319daa0-00a6-4c4c-a6f7-fd1a9852087a admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:46.267548 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319daa0-00a6-4c4c-a6f7-fd1a9852087a admin admin] PATH_INFO: `/v3/projects/4b3ab6b6253d42d693eaf4b8773f0e45/users/b3f830efc2474990bfebbf11a1d2caa4/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:46.295878 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319daa0-00a6-4c4c-a6f7-fd1a9852087a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b3ab6b6253d42d693eaf4b8773f0e45, user_id=b3f830efc2474990bfebbf11a1d2caa4, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:46.296053 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 918/1835] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:46 2021] POST /identity/v3/auth/tokens => generated 3337 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:46.299119 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319daa0-00a6-4c4c-a6f7-fd1a9852087a admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:46.334967 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee824c5-32d4-47db-bf78-a47b47b2abd6 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:46.336360 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-aee824c5-32d4-47db-bf78-a47b47b2abd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:46.404912 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 918/1836] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:33:46 2021] PUT /identity/v3/projects/4b3ab6b6253d42d693eaf4b8773f0e45/users/b3f830efc2474990bfebbf11a1d2caa4/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:46.408673 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319daa0-00a6-4c4c-a6f7-fd1a9852087a admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:46.421336 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee824c5-32d4-47db-bf78-a47b47b2abd6 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:46.525992 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ce6b1-fbb9-4952-82e0-f4795e88e621 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:46.525992 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ce6b1-fbb9-4952-82e0-f4795e88e621 service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:46.525992 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ce6b1-fbb9-4952-82e0-f4795e88e621 service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:46.525992 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ce6b1-fbb9-4952-82e0-f4795e88e621 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:46.574095 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319daa0-00a6-4c4c-a6f7-fd1a9852087a admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:46.582972 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27dd81-86a8-4468-b291-dc86e3e3766e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:46.582972 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27dd81-86a8-4468-b291-dc86e3e3766e admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:46.582972 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27dd81-86a8-4468-b291-dc86e3e3766e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:46.582972 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27dd81-86a8-4468-b291-dc86e3e3766e admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:46.583713 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27dd81-86a8-4468-b291-dc86e3e3766e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:46.585031 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27dd81-86a8-4468-b291-dc86e3e3766e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:46.597679 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 919/1837] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:46 2021] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:33:46.598446 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27dd81-86a8-4468-b291-dc86e3e3766e admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:46.600484 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-6a27dd81-86a8-4468-b291-dc86e3e3766e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:46.602529 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ce6b1-fbb9-4952-82e0-f4795e88e621 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:46.604098 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ce6b1-fbb9-4952-82e0-f4795e88e621 service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:46.622581 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 919/1838] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:46 2021] GET /identity/v3/auth/tokens => generated 3337 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:33:46.623487 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ce6b1-fbb9-4952-82e0-f4795e88e621 service cinder] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:46.627127 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27dd81-86a8-4468-b291-dc86e3e3766e admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:46.636726 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b467d12-4399-4bfe-802b-103ff4b4b02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:46.637639 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b467d12-4399-4bfe-802b-103ff4b4b02a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:46.637966 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b467d12-4399-4bfe-802b-103ff4b4b02a admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:46.638222 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ce6b1-fbb9-4952-82e0-f4795e88e621 service cinder] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:46.638344 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b467d12-4399-4bfe-802b-103ff4b4b02a admin admin] PATH_INFO: `/v3/projects/07548b25b4604684bb008b31cc4aea18` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:46.640353 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b467d12-4399-4bfe-802b-103ff4b4b02a admin admin] RBAC: Authorizing `identity:delete_project(project_id=07548b25b4604684bb008b31cc4aea18)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:46.641886 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b467d12-4399-4bfe-802b-103ff4b4b02a admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:46.647722 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4bdf24-28f4-4bc5-94ea-2087974de814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:46.651955 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bdf24-28f4-4bc5-94ea-2087974de814 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:46.651955 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bdf24-28f4-4bc5-94ea-2087974de814 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:46.651955 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bdf24-28f4-4bc5-94ea-2087974de814 admin admin] PATH_INFO: `/v3/projects/4b3ab6b6253d42d693eaf4b8773f0e45/users/b3f830efc2474990bfebbf11a1d2caa4/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:46.653870 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4bdf24-28f4-4bc5-94ea-2087974de814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b3ab6b6253d42d693eaf4b8773f0e45, user_id=b3f830efc2474990bfebbf11a1d2caa4, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:46.656641 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4bdf24-28f4-4bc5-94ea-2087974de814 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:46.671752 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 920/1839] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:33:46 2021] PUT /identity/v3/projects/4b3ab6b6253d42d693eaf4b8773f0e45/users/b3f830efc2474990bfebbf11a1d2caa4/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:46.681828 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005548df-65ac-44dd-b104-47d35b18790a None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:46.682141 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005548df-65ac-44dd-b104-47d35b18790a None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:46.682422 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005548df-65ac-44dd-b104-47d35b18790a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:46.712615 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-005548df-65ac-44dd-b104-47d35b18790a None None] MFA Rules not processed for user `b3f830efc2474990bfebbf11a1d2caa4`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:46.714099 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-005548df-65ac-44dd-b104-47d35b18790a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:46.792411 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-9b467d12-4399-4bfe-802b-103ff4b4b02a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07548b25b4604684bb008b31cc4aea18', 'request_id': 'req-9b467d12-4399-4bfe-802b-103ff4b4b02a'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:46.799603 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-9b467d12-4399-4bfe-802b-103ff4b4b02a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07548b25b4604684bb008b31cc4aea18', 'request_id': 'req-9b467d12-4399-4bfe-802b-103ff4b4b02a'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:46.808162 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-9b467d12-4399-4bfe-802b-103ff4b4b02a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07548b25b4604684bb008b31cc4aea18', 'request_id': 'req-9b467d12-4399-4bfe-802b-103ff4b4b02a'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:46.810881 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 921/1840] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:46 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:46.825352 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005548df-65ac-44dd-b104-47d35b18790a None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:46.892405 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005548df-65ac-44dd-b104-47d35b18790a None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:46.933802 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-9b467d12-4399-4bfe-802b-103ff4b4b02a admin admin] The token cache is being invalidate because project 07548b25b4604684bb008b31cc4aea18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:33:46.934517 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-9b467d12-4399-4bfe-802b-103ff4b4b02a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:46.936803 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-9b467d12-4399-4bfe-802b-103ff4b4b02a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:46.943621 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 920/1841] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:33:46 2021] DELETE /identity/v3/projects/07548b25b4604684bb008b31cc4aea18 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:46.943621 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b467d12-4399-4bfe-802b-103ff4b4b02a admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:46.945925 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-9b467d12-4399-4bfe-802b-103ff4b4b02a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:46.982150 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fb2f0-2f41-47c8-9dc5-587fc833c4ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:46.983731 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fb2f0-2f41-47c8-9dc5-587fc833c4ba service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:46.984107 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fb2f0-2f41-47c8-9dc5-587fc833c4ba service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:46.984659 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fb2f0-2f41-47c8-9dc5-587fc833c4ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:46.987178 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-219fb2f0-2f41-47c8-9dc5-587fc833c4ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:47.049593 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b467d12-4399-4bfe-802b-103ff4b4b02a admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:47.057590 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7a3c8-9059-4d60-a4a0-a5abed706024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:47.059641 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7a3c8-9059-4d60-a4a0-a5abed706024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:47.059641 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7a3c8-9059-4d60-a4a0-a5abed706024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:47.059641 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7a3c8-9059-4d60-a4a0-a5abed706024 admin admin] PATH_INFO: `/v3/users/b5073537fe314b15b076f6a5448acb1a` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:47.061329 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7a3c8-9059-4d60-a4a0-a5abed706024 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5073537fe314b15b076f6a5448acb1a)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:47.075481 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7a3c8-9059-4d60-a4a0-a5abed706024 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:47.079518 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219fb2f0-2f41-47c8-9dc5-587fc833c4ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:47.081003 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219fb2f0-2f41-47c8-9dc5-587fc833c4ba service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:47.098865 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 922/1842] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:46 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:33:47.100113 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fb2f0-2f41-47c8-9dc5-587fc833c4ba service cinder] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:47.101949 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-219fb2f0-2f41-47c8-9dc5-587fc833c4ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:47.117199 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fb2f0-2f41-47c8-9dc5-587fc833c4ba service cinder] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:47.124306 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b1a28-8bbc-4a2d-89bd-2845350f9a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:47.125350 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b1a28-8bbc-4a2d-89bd-2845350f9a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:47.125803 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b1a28-8bbc-4a2d-89bd-2845350f9a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:47.126144 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b1a28-8bbc-4a2d-89bd-2845350f9a54 admin admin] PATH_INFO: `/v3/users/0f960df5d21243aabd9a680a58170952` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:47.127520 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b1a28-8bbc-4a2d-89bd-2845350f9a54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f960df5d21243aabd9a680a58170952)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:47.131221 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b1a28-8bbc-4a2d-89bd-2845350f9a54 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:47.294101 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-bce7a3c8-9059-4d60-a4a0-a5abed706024 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5073537fe314b15b076f6a5448acb1a'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:47.294778 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-bce7a3c8-9059-4d60-a4a0-a5abed706024 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5073537fe314b15b076f6a5448acb1a'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:47.302613 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-bce7a3c8-9059-4d60-a4a0-a5abed706024 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5073537fe314b15b076f6a5448acb1a'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:47.303294 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-bce7a3c8-9059-4d60-a4a0-a5abed706024 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5073537fe314b15b076f6a5448acb1a'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:47.316832 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-bce7a3c8-9059-4d60-a4a0-a5abed706024 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5073537fe314b15b076f6a5448acb1a'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:47.319474 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-665b1a28-8bbc-4a2d-89bd-2845350f9a54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f960df5d21243aabd9a680a58170952'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:47.320195 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-665b1a28-8bbc-4a2d-89bd-2845350f9a54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f960df5d21243aabd9a680a58170952'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:47.434956 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 921/1843] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:33:46 2021] DELETE /identity/v3/users/b5073537fe314b15b076f6a5448acb1a => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:47.434956 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7a3c8-9059-4d60-a4a0-a5abed706024 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:47.442383 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-bce7a3c8-9059-4d60-a4a0-a5abed706024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:47.510358 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7a3c8-9059-4d60-a4a0-a5abed706024 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:47.514986 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766608bf-077f-40cb-a347-7d522c466e9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:47.515156 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766608bf-077f-40cb-a347-7d522c466e9d service cinder] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:47.515931 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766608bf-077f-40cb-a347-7d522c466e9d service cinder] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:47.516224 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766608bf-077f-40cb-a347-7d522c466e9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:47.520097 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-665b1a28-8bbc-4a2d-89bd-2845350f9a54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f960df5d21243aabd9a680a58170952'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:47.520786 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-665b1a28-8bbc-4a2d-89bd-2845350f9a54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f960df5d21243aabd9a680a58170952'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:47.524403 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-766608bf-077f-40cb-a347-7d522c466e9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:47.539007 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-665b1a28-8bbc-4a2d-89bd-2845350f9a54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f960df5d21243aabd9a680a58170952'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:47.558019 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 923/1844] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:33:47 2021] DELETE /identity/v3/users/0f960df5d21243aabd9a680a58170952 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:47.558019 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801f950-4856-481b-9b22-b53ad278748f None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:47.558019 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801f950-4856-481b-9b22-b53ad278748f None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:47.558019 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801f950-4856-481b-9b22-b53ad278748f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:47.577575 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-6801f950-4856-481b-9b22-b53ad278748f None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:47.580624 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-6801f950-4856-481b-9b22-b53ad278748f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:47.637571 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766608bf-077f-40cb-a347-7d522c466e9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:47.639196 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766608bf-077f-40cb-a347-7d522c466e9d service cinder] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:47.657696 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 922/1845] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:47 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:33:47.681624 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 924/1846] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:47.695892 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766608bf-077f-40cb-a347-7d522c466e9d service cinder] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:47.697523 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-766608bf-077f-40cb-a347-7d522c466e9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:47.764629 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766608bf-077f-40cb-a347-7d522c466e9d service cinder] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:47.822371 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1a5e2-987f-4070-b2fd-e54b0f629c23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:47.823051 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1a5e2-987f-4070-b2fd-e54b0f629c23 service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:47.823498 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1a5e2-987f-4070-b2fd-e54b0f629c23 service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:47.823808 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1a5e2-987f-4070-b2fd-e54b0f629c23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:47.834258 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1a5e2-987f-4070-b2fd-e54b0f629c23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:47.835685 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1a5e2-987f-4070-b2fd-e54b0f629c23 service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:47.852776 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 923/1847] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:33:48.112003 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801f950-4856-481b-9b22-b53ad278748f None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:48.114810 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-6801f950-4856-481b-9b22-b53ad278748f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:48.148833 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801f950-4856-481b-9b22-b53ad278748f None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:48.158421 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42cd13f-9667-405a-9535-2305e45f42d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:48.160268 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cd13f-9667-405a-9535-2305e45f42d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:48.161136 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cd13f-9667-405a-9535-2305e45f42d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:48.161664 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cd13f-9667-405a-9535-2305e45f42d2 admin admin] PATH_INFO: `/v3/projects/c1409c65f74f477498196c51abaf49d0` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:48.163117 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42cd13f-9667-405a-9535-2305e45f42d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1409c65f74f477498196c51abaf49d0)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:48.165854 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42cd13f-9667-405a-9535-2305e45f42d2 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:48.256326 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-b42cd13f-9667-405a-9535-2305e45f42d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1409c65f74f477498196c51abaf49d0', 'request_id': 'req-b42cd13f-9667-405a-9535-2305e45f42d2'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:48.261632 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-b42cd13f-9667-405a-9535-2305e45f42d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1409c65f74f477498196c51abaf49d0', 'request_id': 'req-b42cd13f-9667-405a-9535-2305e45f42d2'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:48.268054 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-b42cd13f-9667-405a-9535-2305e45f42d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1409c65f74f477498196c51abaf49d0', 'request_id': 'req-b42cd13f-9667-405a-9535-2305e45f42d2'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:48.370503 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-b42cd13f-9667-405a-9535-2305e45f42d2 admin admin] The token cache is being invalidate because project c1409c65f74f477498196c51abaf49d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:33:48.370503 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-b42cd13f-9667-405a-9535-2305e45f42d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:48.371186 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-b42cd13f-9667-405a-9535-2305e45f42d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:48.373711 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 925/1848] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:33:48 2021] DELETE /identity/v3/projects/c1409c65f74f477498196c51abaf49d0 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:48.373912 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1a5e2-987f-4070-b2fd-e54b0f629c23 service neutron] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:48.375855 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-bca1a5e2-987f-4070-b2fd-e54b0f629c23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:48.382760 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63715c63-6601-4403-9a7a-ff1446662314 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:48.383645 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63715c63-6601-4403-9a7a-ff1446662314 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:48.384324 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63715c63-6601-4403-9a7a-ff1446662314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:48.391646 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1a5e2-987f-4070-b2fd-e54b0f629c23 service neutron] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:48.426450 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-63715c63-6601-4403-9a7a-ff1446662314 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:48.427698 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-63715c63-6601-4403-9a7a-ff1446662314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:48.459728 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f0ce9-a130-40bc-bdee-80248f771eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:48.459728 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f0ce9-a130-40bc-bdee-80248f771eea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:48.459728 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f0ce9-a130-40bc-bdee-80248f771eea admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:48.459728 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f0ce9-a130-40bc-bdee-80248f771eea admin admin] PATH_INFO: `/v3/projects/f5865a946ab24f399d59484590b84a91` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:48.460248 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f0ce9-a130-40bc-bdee-80248f771eea admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5865a946ab24f399d59484590b84a91)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:48.460248 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f0ce9-a130-40bc-bdee-80248f771eea admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:48.493571 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 926/1849] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:33:48.501953 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a6a27-5009-4597-9103-c3a1b105e991 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:48.502242 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a6a27-5009-4597-9103-c3a1b105e991 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:48.502520 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a6a27-5009-4597-9103-c3a1b105e991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:48.520165 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-806a6a27-5009-4597-9103-c3a1b105e991 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:48.521335 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-806a6a27-5009-4597-9103-c3a1b105e991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:48.529157 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 927/1850] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:33:48.533065 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a6a27-5009-4597-9103-c3a1b105e991 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:48.542931 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a6a27-5009-4597-9103-c3a1b105e991 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:48.547853 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702aca06-6c2b-47db-8124-e21132a660b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:48.548496 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702aca06-6c2b-47db-8124-e21132a660b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:48.548775 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702aca06-6c2b-47db-8124-e21132a660b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:48.549043 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702aca06-6c2b-47db-8124-e21132a660b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:48.549798 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702aca06-6c2b-47db-8124-e21132a660b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:33:48.550905 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702aca06-6c2b-47db-8124-e21132a660b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:48.552593 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702aca06-6c2b-47db-8124-e21132a660b3 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:48.564075 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 928/1851] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:33:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:33:48.568308 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702aca06-6c2b-47db-8124-e21132a660b3 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:48.578067 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702aca06-6c2b-47db-8124-e21132a660b3 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:48.584704 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-ce3f0ce9-a130-40bc-bdee-80248f771eea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5865a946ab24f399d59484590b84a91', 'request_id': 'req-ce3f0ce9-a130-40bc-bdee-80248f771eea'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:48.591634 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-ce3f0ce9-a130-40bc-bdee-80248f771eea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5865a946ab24f399d59484590b84a91', 'request_id': 'req-ce3f0ce9-a130-40bc-bdee-80248f771eea'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:48.599673 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-ce3f0ce9-a130-40bc-bdee-80248f771eea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5865a946ab24f399d59484590b84a91', 'request_id': 'req-ce3f0ce9-a130-40bc-bdee-80248f771eea'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:48.635052 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2c695-a1a0-4dde-8bd8-fe47306ffa32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:48.635722 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2c695-a1a0-4dde-8bd8-fe47306ffa32 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:48.636004 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2c695-a1a0-4dde-8bd8-fe47306ffa32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:48.636280 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2c695-a1a0-4dde-8bd8-fe47306ffa32 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:48.637064 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2c695-a1a0-4dde-8bd8-fe47306ffa32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:48.639535 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2c695-a1a0-4dde-8bd8-fe47306ffa32 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:48.672484 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-ce3f0ce9-a130-40bc-bdee-80248f771eea admin admin] The token cache is being invalidate because project f5865a946ab24f399d59484590b84a91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:33:48.672984 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-ce3f0ce9-a130-40bc-bdee-80248f771eea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:48.673493 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-ce3f0ce9-a130-40bc-bdee-80248f771eea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:48.675227 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 924/1852] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:33:48 2021] DELETE /identity/v3/projects/f5865a946ab24f399d59484590b84a91 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:33:48.678971 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f0ce9-a130-40bc-bdee-80248f771eea admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:48.680263 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-ce3f0ce9-a130-40bc-bdee-80248f771eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:48.692857 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f0ce9-a130-40bc-bdee-80248f771eea admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:48.697643 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fab1f2-23e1-485e-bdc4-f5e5b4142ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:48.698566 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fab1f2-23e1-485e-bdc4-f5e5b4142ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:48.698846 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fab1f2-23e1-485e-bdc4-f5e5b4142ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:48.699121 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fab1f2-23e1-485e-bdc4-f5e5b4142ffd admin admin] PATH_INFO: `/v3/users/b53d91bf9e564ebb9c7d0c3acf9eab97` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:48.700744 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fab1f2-23e1-485e-bdc4-f5e5b4142ffd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b53d91bf9e564ebb9c7d0c3acf9eab97)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:48.703367 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fab1f2-23e1-485e-bdc4-f5e5b4142ffd admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:48.732565 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 929/1853] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:33:48 2021] POST /identity/v3/projects => generated 375 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:33:48.736570 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2c695-a1a0-4dde-8bd8-fe47306ffa32 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:48.739910 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-d0e2c695-a1a0-4dde-8bd8-fe47306ffa32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:48.833682 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2c695-a1a0-4dde-8bd8-fe47306ffa32 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:48.838575 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72485c30-b5d7-4427-b5e3-5fc389e1ed3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:48.840237 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72485c30-b5d7-4427-b5e3-5fc389e1ed3a admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:48.840237 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72485c30-b5d7-4427-b5e3-5fc389e1ed3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:48.840237 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72485c30-b5d7-4427-b5e3-5fc389e1ed3a admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:48.840868 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72485c30-b5d7-4427-b5e3-5fc389e1ed3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:48.842846 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72485c30-b5d7-4427-b5e3-5fc389e1ed3a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:48.844182 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-31fab1f2-23e1-485e-bdc4-f5e5b4142ffd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b53d91bf9e564ebb9c7d0c3acf9eab97'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:48.845013 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-31fab1f2-23e1-485e-bdc4-f5e5b4142ffd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b53d91bf9e564ebb9c7d0c3acf9eab97'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:48.855248 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-31fab1f2-23e1-485e-bdc4-f5e5b4142ffd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b53d91bf9e564ebb9c7d0c3acf9eab97'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:48.856045 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-31fab1f2-23e1-485e-bdc4-f5e5b4142ffd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b53d91bf9e564ebb9c7d0c3acf9eab97'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:48.878108 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-31fab1f2-23e1-485e-bdc4-f5e5b4142ffd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b53d91bf9e564ebb9c7d0c3acf9eab97'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:48.918658 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 930/1854] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:33:48 2021] POST /identity/v3/users => generated 288 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:48.923671 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72485c30-b5d7-4427-b5e3-5fc389e1ed3a admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:48.925332 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-72485c30-b5d7-4427-b5e3-5fc389e1ed3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:48.937192 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72485c30-b5d7-4427-b5e3-5fc389e1ed3a admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:48.942301 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b544d3-0002-4d78-8d27-51f8d562c855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:48.945124 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b544d3-0002-4d78-8d27-51f8d562c855 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:48.945124 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b544d3-0002-4d78-8d27-51f8d562c855 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:48.945124 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b544d3-0002-4d78-8d27-51f8d562c855 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:48.945124 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b544d3-0002-4d78-8d27-51f8d562c855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:48.945942 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b544d3-0002-4d78-8d27-51f8d562c855 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:48.947286 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 925/1855] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:33:48 2021] DELETE /identity/v3/users/b53d91bf9e564ebb9c7d0c3acf9eab97 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:33:48.956945 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 931/1856] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:48 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:33:48.960582 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fab1f2-23e1-485e-bdc4-f5e5b4142ffd admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:49.022784 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fab1f2-23e1-485e-bdc4-f5e5b4142ffd admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:49.027518 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647f528-fb06-43aa-8bfc-e42344d39ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:49.028199 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647f528-fb06-43aa-8bfc-e42344d39ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:49.028483 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647f528-fb06-43aa-8bfc-e42344d39ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:49.028760 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647f528-fb06-43aa-8bfc-e42344d39ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:49.029556 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f647f528-fb06-43aa-8bfc-e42344d39ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:49.031175 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f647f528-fb06-43aa-8bfc-e42344d39ae2 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:49.046301 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 926/1857] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:48 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:49.047719 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b544d3-0002-4d78-8d27-51f8d562c855 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:49.058663 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b544d3-0002-4d78-8d27-51f8d562c855 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:49.063638 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597fe3e-a992-474a-849b-23463133104f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:49.064544 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597fe3e-a992-474a-849b-23463133104f admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:49.064830 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597fe3e-a992-474a-849b-23463133104f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:49.065108 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597fe3e-a992-474a-849b-23463133104f admin admin] PATH_INFO: `/v3/projects/c376d25cfd0645a1bd0d2dea2e61b14e/users/45f8573c6b8444058cf3a33e24ab1efa/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:49.081945 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597fe3e-a992-474a-849b-23463133104f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c376d25cfd0645a1bd0d2dea2e61b14e, user_id=45f8573c6b8444058cf3a33e24ab1efa, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:49.084734 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597fe3e-a992-474a-849b-23463133104f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:49.149343 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 932/1858] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:33:49 2021] PUT /identity/v3/projects/c376d25cfd0645a1bd0d2dea2e61b14e/users/45f8573c6b8444058cf3a33e24ab1efa/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:49.162839 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664938c9-7580-4965-8655-9d82404ebe28 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:49.163140 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664938c9-7580-4965-8655-9d82404ebe28 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:49.163922 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664938c9-7580-4965-8655-9d82404ebe28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:49.191832 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-664938c9-7580-4965-8655-9d82404ebe28 None None] MFA Rules not processed for user `45f8573c6b8444058cf3a33e24ab1efa`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:49.193041 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-664938c9-7580-4965-8655-9d82404ebe28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:49.255737 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 927/1859] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:49 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:49.266673 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597fe3e-a992-474a-849b-23463133104f admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:49.268499 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-8597fe3e-a992-474a-849b-23463133104f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:49.326235 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597fe3e-a992-474a-849b-23463133104f admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:49.329852 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6d117-102b-4c22-a214-cddd0198c830 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:49.330490 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6d117-102b-4c22-a214-cddd0198c830 service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:49.330773 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6d117-102b-4c22-a214-cddd0198c830 service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:49.331043 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6d117-102b-4c22-a214-cddd0198c830 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:49.340203 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6d117-102b-4c22-a214-cddd0198c830 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:49.341626 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6d117-102b-4c22-a214-cddd0198c830 service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:49.351048 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 933/1860] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:49 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:33:49.531815 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664938c9-7580-4965-8655-9d82404ebe28 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:49.533211 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-664938c9-7580-4965-8655-9d82404ebe28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:49.599788 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664938c9-7580-4965-8655-9d82404ebe28 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:49.604346 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd020049-b54a-4746-9fd6-bc2034fd1d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:49.605200 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd020049-b54a-4746-9fd6-bc2034fd1d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:49.605513 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd020049-b54a-4746-9fd6-bc2034fd1d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:49.605790 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd020049-b54a-4746-9fd6-bc2034fd1d62 admin admin] PATH_INFO: `/v3/projects/fcafd51b834f475f8ed7b6642968fe67` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:49.606994 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd020049-b54a-4746-9fd6-bc2034fd1d62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcafd51b834f475f8ed7b6642968fe67)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:49.608922 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd020049-b54a-4746-9fd6-bc2034fd1d62 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:49.742000 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-dd020049-b54a-4746-9fd6-bc2034fd1d62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcafd51b834f475f8ed7b6642968fe67', 'request_id': 'req-dd020049-b54a-4746-9fd6-bc2034fd1d62'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:49.748122 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-dd020049-b54a-4746-9fd6-bc2034fd1d62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcafd51b834f475f8ed7b6642968fe67', 'request_id': 'req-dd020049-b54a-4746-9fd6-bc2034fd1d62'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:49.754146 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-dd020049-b54a-4746-9fd6-bc2034fd1d62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcafd51b834f475f8ed7b6642968fe67', 'request_id': 'req-dd020049-b54a-4746-9fd6-bc2034fd1d62'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:49.843936 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-dd020049-b54a-4746-9fd6-bc2034fd1d62 admin admin] The token cache is being invalidate because project fcafd51b834f475f8ed7b6642968fe67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:33:49.844224 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-dd020049-b54a-4746-9fd6-bc2034fd1d62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:49.844895 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-dd020049-b54a-4746-9fd6-bc2034fd1d62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:33:49.846569 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 928/1861] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:33:49 2021] DELETE /identity/v3/projects/fcafd51b834f475f8ed7b6642968fe67 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:49.852522 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ea373-7913-4fdb-95c7-e0a3bb85dcc3 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:49.852813 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ea373-7913-4fdb-95c7-e0a3bb85dcc3 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:49.853128 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ea373-7913-4fdb-95c7-e0a3bb85dcc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:49.872030 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-c35ea373-7913-4fdb-95c7-e0a3bb85dcc3 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:49.873229 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-c35ea373-7913-4fdb-95c7-e0a3bb85dcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:49.946819 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 934/1862] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:33:49.965918 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382c435-2ffd-4007-9eef-800ac67592e2 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:49.968807 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382c435-2ffd-4007-9eef-800ac67592e2 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:49.969485 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382c435-2ffd-4007-9eef-800ac67592e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:50.070129 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-6382c435-2ffd-4007-9eef-800ac67592e2 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:50.070129 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-6382c435-2ffd-4007-9eef-800ac67592e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:50.074289 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 929/1863] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:50.074829 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ea373-7913-4fdb-95c7-e0a3bb85dcc3 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:50.090864 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ea373-7913-4fdb-95c7-e0a3bb85dcc3 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:50.097857 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ba9f0-5aae-4ab2-bc0a-2001b031213e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:50.099170 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ba9f0-5aae-4ab2-bc0a-2001b031213e admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:50.099640 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ba9f0-5aae-4ab2-bc0a-2001b031213e admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:50.100042 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ba9f0-5aae-4ab2-bc0a-2001b031213e admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:50.100878 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ba9f0-5aae-4ab2-bc0a-2001b031213e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:33:50.101287 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ba9f0-5aae-4ab2-bc0a-2001b031213e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:50.103084 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ba9f0-5aae-4ab2-bc0a-2001b031213e admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:50.125493 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 935/1864] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:33:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:33:50.130947 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382c435-2ffd-4007-9eef-800ac67592e2 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:50.143056 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382c435-2ffd-4007-9eef-800ac67592e2 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:50.152581 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff5fb9-7db2-4528-adcb-5a849f518c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:50.153832 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff5fb9-7db2-4528-adcb-5a849f518c90 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:50.154337 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff5fb9-7db2-4528-adcb-5a849f518c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:50.155266 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff5fb9-7db2-4528-adcb-5a849f518c90 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:50.156224 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff5fb9-7db2-4528-adcb-5a849f518c90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:50.161711 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff5fb9-7db2-4528-adcb-5a849f518c90 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:50.252652 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 930/1865] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:33:50 2021] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:50.257828 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ba9f0-5aae-4ab2-bc0a-2001b031213e admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:50.271782 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ba9f0-5aae-4ab2-bc0a-2001b031213e admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:50.341073 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae6fdb-1879-4ab9-b9e8-0adc4616b6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:50.341696 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae6fdb-1879-4ab9-b9e8-0adc4616b6f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:50.341973 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae6fdb-1879-4ab9-b9e8-0adc4616b6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:50.342248 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae6fdb-1879-4ab9-b9e8-0adc4616b6f0 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:50.342989 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae6fdb-1879-4ab9-b9e8-0adc4616b6f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:50.344857 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae6fdb-1879-4ab9-b9e8-0adc4616b6f0 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:50.416086 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 936/1866] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:33:50 2021] POST /identity/v3/users => generated 283 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:50.420004 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff5fb9-7db2-4528-adcb-5a849f518c90 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:50.431169 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff5fb9-7db2-4528-adcb-5a849f518c90 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:50.436292 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48158d-93e7-42b1-8413-927943fc3b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:50.436990 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48158d-93e7-42b1-8413-927943fc3b79 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:50.437275 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48158d-93e7-42b1-8413-927943fc3b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:50.437588 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48158d-93e7-42b1-8413-927943fc3b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:50.438334 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48158d-93e7-42b1-8413-927943fc3b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:50.439909 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48158d-93e7-42b1-8413-927943fc3b79 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:50.452770 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 931/1867] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:50 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:50.460538 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae6fdb-1879-4ab9-b9e8-0adc4616b6f0 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:50.470356 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae6fdb-1879-4ab9-b9e8-0adc4616b6f0 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:50.475680 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9576e-c2fa-409b-ae0c-e0d7fe9b0971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:50.476369 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9576e-c2fa-409b-ae0c-e0d7fe9b0971 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:50.476670 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9576e-c2fa-409b-ae0c-e0d7fe9b0971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:50.476929 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9576e-c2fa-409b-ae0c-e0d7fe9b0971 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:50.477726 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9576e-c2fa-409b-ae0c-e0d7fe9b0971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:50.479283 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9576e-c2fa-409b-ae0c-e0d7fe9b0971 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:50.490210 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 937/1868] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:50 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:50.494355 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48158d-93e7-42b1-8413-927943fc3b79 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:50.504914 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48158d-93e7-42b1-8413-927943fc3b79 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:50.509531 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3e0cf-23f0-4e56-8005-f1bef529d400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:50.510403 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3e0cf-23f0-4e56-8005-f1bef529d400 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:50.510682 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3e0cf-23f0-4e56-8005-f1bef529d400 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:50.510957 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3e0cf-23f0-4e56-8005-f1bef529d400 admin admin] PATH_INFO: `/v3/projects/cbf01f9dce2e4734b7cd7574cf1820ce/users/23d85a50876f4bf89793a5cf58ae3b22/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:50.525670 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3e0cf-23f0-4e56-8005-f1bef529d400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf01f9dce2e4734b7cd7574cf1820ce, user_id=23d85a50876f4bf89793a5cf58ae3b22, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:50.528247 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3e0cf-23f0-4e56-8005-f1bef529d400 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:50.627247 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 932/1869] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:33:50 2021] PUT /identity/v3/projects/cbf01f9dce2e4734b7cd7574cf1820ce/users/23d85a50876f4bf89793a5cf58ae3b22/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:33:50.638839 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fe1ee-b8f4-48a9-8a70-fff61a314d54 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:50.642909 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fe1ee-b8f4-48a9-8a70-fff61a314d54 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:50.642909 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fe1ee-b8f4-48a9-8a70-fff61a314d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:50.665218 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-9d3fe1ee-b8f4-48a9-8a70-fff61a314d54 None None] MFA Rules not processed for user `23d85a50876f4bf89793a5cf58ae3b22`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:50.666470 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-9d3fe1ee-b8f4-48a9-8a70-fff61a314d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:50.730249 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 938/1870] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:50 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:50.734686 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3e0cf-23f0-4e56-8005-f1bef529d400 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:50.800725 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3e0cf-23f0-4e56-8005-f1bef529d400 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:50.805666 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767bcbfa-d929-4d82-b76b-bd5e45993d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:50.806329 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bcbfa-d929-4d82-b76b-bd5e45993d43 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:50.806612 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bcbfa-d929-4d82-b76b-bd5e45993d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:50.806890 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bcbfa-d929-4d82-b76b-bd5e45993d43 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:50.807597 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767bcbfa-d929-4d82-b76b-bd5e45993d43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:50.809501 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767bcbfa-d929-4d82-b76b-bd5e45993d43 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:50.919988 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 933/1871] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:33:50 2021] POST /identity/v3/projects => generated 363 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:50.923920 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fe1ee-b8f4-48a9-8a70-fff61a314d54 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:50.935826 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fe1ee-b8f4-48a9-8a70-fff61a314d54 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:50.990706 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108b7c1-33ab-4658-813f-532f08c5fa6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:50.991429 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108b7c1-33ab-4658-813f-532f08c5fa6f admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:50.991713 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108b7c1-33ab-4658-813f-532f08c5fa6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:50.991988 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108b7c1-33ab-4658-813f-532f08c5fa6f admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:50.992779 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108b7c1-33ab-4658-813f-532f08c5fa6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:50.994724 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108b7c1-33ab-4658-813f-532f08c5fa6f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:51.052141 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 939/1872] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:33:50 2021] POST /identity/v3/users => generated 288 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:33:51.055944 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767bcbfa-d929-4d82-b76b-bd5e45993d43 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:51.067498 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767bcbfa-d929-4d82-b76b-bd5e45993d43 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:51.075755 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19d840-032b-4ba5-84aa-9613e0866a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:51.077197 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19d840-032b-4ba5-84aa-9613e0866a77 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:51.077516 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19d840-032b-4ba5-84aa-9613e0866a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:51.077814 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19d840-032b-4ba5-84aa-9613e0866a77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:51.078550 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19d840-032b-4ba5-84aa-9613e0866a77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:51.080137 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19d840-032b-4ba5-84aa-9613e0866a77 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:51.100845 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 934/1873] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:51 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:51.101262 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108b7c1-33ab-4658-813f-532f08c5fa6f admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:51.111340 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108b7c1-33ab-4658-813f-532f08c5fa6f admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:51.116783 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2659be-4d8c-4a61-a508-9cf93611f5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:51.118580 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2659be-4d8c-4a61-a508-9cf93611f5e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:51.118707 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2659be-4d8c-4a61-a508-9cf93611f5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:51.118965 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2659be-4d8c-4a61-a508-9cf93611f5e3 admin admin] PATH_INFO: `/v3/projects/323ba636e6174e7bba3fbb1c5c8219f2/users/6ca9f9e43b0e44bfa9a8081c2e56f92b/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:51.137063 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2659be-4d8c-4a61-a508-9cf93611f5e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=323ba636e6174e7bba3fbb1c5c8219f2, user_id=6ca9f9e43b0e44bfa9a8081c2e56f92b, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:51.140046 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2659be-4d8c-4a61-a508-9cf93611f5e3 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:51.239052 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 940/1874] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:33:51 2021] PUT /identity/v3/projects/323ba636e6174e7bba3fbb1c5c8219f2/users/6ca9f9e43b0e44bfa9a8081c2e56f92b/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:51.242902 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19d840-032b-4ba5-84aa-9613e0866a77 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:51.252704 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19d840-032b-4ba5-84aa-9613e0866a77 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:51.307625 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05440094-777a-4398-8e70-e0f8da0bb54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:51.308320 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05440094-777a-4398-8e70-e0f8da0bb54d admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:51.308605 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05440094-777a-4398-8e70-e0f8da0bb54d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:51.308895 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05440094-777a-4398-8e70-e0f8da0bb54d admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:51.309809 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05440094-777a-4398-8e70-e0f8da0bb54d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:51.311695 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05440094-777a-4398-8e70-e0f8da0bb54d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:51.323458 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 935/1875] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:33:51 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:33:51.327960 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2659be-4d8c-4a61-a508-9cf93611f5e3 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:51.341186 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2659be-4d8c-4a61-a508-9cf93611f5e3 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:51.355504 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4557d82-df52-4a5d-9b9d-336442c0fd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:51.356462 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4557d82-df52-4a5d-9b9d-336442c0fd65 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:51.356746 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4557d82-df52-4a5d-9b9d-336442c0fd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:51.357080 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4557d82-df52-4a5d-9b9d-336442c0fd65 admin admin] PATH_INFO: `/v3/projects/323ba636e6174e7bba3fbb1c5c8219f2/users/6ca9f9e43b0e44bfa9a8081c2e56f92b/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:51.359310 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4557d82-df52-4a5d-9b9d-336442c0fd65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=323ba636e6174e7bba3fbb1c5c8219f2, user_id=6ca9f9e43b0e44bfa9a8081c2e56f92b, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:51.362168 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4557d82-df52-4a5d-9b9d-336442c0fd65 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:51.384920 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 941/1876] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:33:51 2021] PUT /identity/v3/projects/323ba636e6174e7bba3fbb1c5c8219f2/users/6ca9f9e43b0e44bfa9a8081c2e56f92b/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:33:51.387438 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0bd8c1-a557-4601-8adc-128dc4ed9835 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:51.387438 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0bd8c1-a557-4601-8adc-128dc4ed9835 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:51.387675 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0bd8c1-a557-4601-8adc-128dc4ed9835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:51.420013 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-6f0bd8c1-a557-4601-8adc-128dc4ed9835 None None] MFA Rules not processed for user `6ca9f9e43b0e44bfa9a8081c2e56f92b`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:33:51.421269 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-6f0bd8c1-a557-4601-8adc-128dc4ed9835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:51.520271 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 936/1877] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:33:51 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:33:51.530932 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4557d82-df52-4a5d-9b9d-336442c0fd65 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:51.532607 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-f4557d82-df52-4a5d-9b9d-336442c0fd65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:51.588575 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4557d82-df52-4a5d-9b9d-336442c0fd65 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:51.592269 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242936e8-5924-42f2-987b-7d7a25e4dd66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:51.592899 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242936e8-5924-42f2-987b-7d7a25e4dd66 service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:51.593175 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242936e8-5924-42f2-987b-7d7a25e4dd66 service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:51.593492 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242936e8-5924-42f2-987b-7d7a25e4dd66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:51.602577 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242936e8-5924-42f2-987b-7d7a25e4dd66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:51.606740 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242936e8-5924-42f2-987b-7d7a25e4dd66 service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:51.613053 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 942/1878] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:51 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:33:51.797990 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0bd8c1-a557-4601-8adc-128dc4ed9835 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:51.808464 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0bd8c1-a557-4601-8adc-128dc4ed9835 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:51.812440 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d766e-3a61-44a6-82a6-b8972bcc2339 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:51.813088 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d766e-3a61-44a6-82a6-b8972bcc2339 service cinder] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:51.813424 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d766e-3a61-44a6-82a6-b8972bcc2339 service cinder] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:51.813731 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d766e-3a61-44a6-82a6-b8972bcc2339 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:51.870098 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d766e-3a61-44a6-82a6-b8972bcc2339 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:51.871526 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d766e-3a61-44a6-82a6-b8972bcc2339 service cinder] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:51.881292 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 937/1879] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:51 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:33:55.061780 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242936e8-5924-42f2-987b-7d7a25e4dd66 service cinder] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:33:55.063909 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-242936e8-5924-42f2-987b-7d7a25e4dd66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:55.075312 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242936e8-5924-42f2-987b-7d7a25e4dd66 service cinder] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:33:55.079007 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5be80-94d5-45bd-ab9f-aabd72f6d85c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:33:55.082741 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5be80-94d5-45bd-ab9f-aabd72f6d85c service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:33:55.082741 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5be80-94d5-45bd-ab9f-aabd72f6d85c service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:33:55.082741 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5be80-94d5-45bd-ab9f-aabd72f6d85c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:33:55.083176 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-4de5be80-94d5-45bd-ab9f-aabd72f6d85c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:33:55.176649 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5be80-94d5-45bd-ab9f-aabd72f6d85c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:33:55.178637 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5be80-94d5-45bd-ab9f-aabd72f6d85c service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:33:55.233007 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 943/1880] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:33:55 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:34:06.830661 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d766e-3a61-44a6-82a6-b8972bcc2339 service cinder] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:06.832271 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-775d766e-3a61-44a6-82a6-b8972bcc2339 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:06.906045 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d766e-3a61-44a6-82a6-b8972bcc2339 service cinder] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:06.910935 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d9a17-d0ef-4543-b04b-49780cc833df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:06.911945 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d9a17-d0ef-4543-b04b-49780cc833df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:06.912243 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d9a17-d0ef-4543-b04b-49780cc833df admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:06.912498 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d9a17-d0ef-4543-b04b-49780cc833df admin admin] PATH_INFO: `/v3/users/f8637b5502a54ba8bb943addae4d726a` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:06.913818 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d9a17-d0ef-4543-b04b-49780cc833df admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8637b5502a54ba8bb943addae4d726a)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:06.915697 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d9a17-d0ef-4543-b04b-49780cc833df admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:06.944152 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5be80-94d5-45bd-ab9f-aabd72f6d85c service cinder] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:06.945586 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-4de5be80-94d5-45bd-ab9f-aabd72f6d85c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:06.959079 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5be80-94d5-45bd-ab9f-aabd72f6d85c service cinder] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:06.963632 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a016d3-84a3-4b4e-8a0f-23095f476121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:06.964480 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a016d3-84a3-4b4e-8a0f-23095f476121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:06.964756 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a016d3-84a3-4b4e-8a0f-23095f476121 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:06.965025 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a016d3-84a3-4b4e-8a0f-23095f476121 admin admin] PATH_INFO: `/v3/users/e4168fdc638d48ba9751cd40d746f0e8` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:06.966233 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a016d3-84a3-4b4e-8a0f-23095f476121 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4168fdc638d48ba9751cd40d746f0e8)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:06.968215 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a016d3-84a3-4b4e-8a0f-23095f476121 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:07.109629 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-292d9a17-d0ef-4543-b04b-49780cc833df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8637b5502a54ba8bb943addae4d726a'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:07.110202 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-292d9a17-d0ef-4543-b04b-49780cc833df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8637b5502a54ba8bb943addae4d726a'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:07.116968 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-292d9a17-d0ef-4543-b04b-49780cc833df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8637b5502a54ba8bb943addae4d726a'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:07.117627 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-292d9a17-d0ef-4543-b04b-49780cc833df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8637b5502a54ba8bb943addae4d726a'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:07.128954 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-292d9a17-d0ef-4543-b04b-49780cc833df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8637b5502a54ba8bb943addae4d726a'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:07.172384 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-91a016d3-84a3-4b4e-8a0f-23095f476121 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4168fdc638d48ba9751cd40d746f0e8'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:07.173035 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-91a016d3-84a3-4b4e-8a0f-23095f476121 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4168fdc638d48ba9751cd40d746f0e8'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:07.216321 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 938/1881] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:34:06 2021] DELETE /identity/v3/users/f8637b5502a54ba8bb943addae4d726a => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:07.220680 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2a475-c15c-4db3-b9b2-c4989335fc80 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:07.220973 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2a475-c15c-4db3-b9b2-c4989335fc80 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:07.221255 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2a475-c15c-4db3-b9b2-c4989335fc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:07.237690 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-adf2a475-c15c-4db3-b9b2-c4989335fc80 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:07.238889 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-adf2a475-c15c-4db3-b9b2-c4989335fc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:07.250549 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-91a016d3-84a3-4b4e-8a0f-23095f476121 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4168fdc638d48ba9751cd40d746f0e8'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:07.251182 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-91a016d3-84a3-4b4e-8a0f-23095f476121 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4168fdc638d48ba9751cd40d746f0e8'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:07.263645 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-91a016d3-84a3-4b4e-8a0f-23095f476121 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4168fdc638d48ba9751cd40d746f0e8'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:07.276213 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 944/1882] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:34:06 2021] DELETE /identity/v3/users/e4168fdc638d48ba9751cd40d746f0e8 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:07.280613 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfdcc5-8fcd-4e7b-8a99-466df37d5d8f None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:07.281159 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfdcc5-8fcd-4e7b-8a99-466df37d5d8f None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:07.281369 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfdcc5-8fcd-4e7b-8a99-466df37d5d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:07.297807 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 939/1883] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:34:07.298990 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-51cfdcc5-8fcd-4e7b-8a99-466df37d5d8f None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:07.300195 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-51cfdcc5-8fcd-4e7b-8a99-466df37d5d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:07.307593 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2a475-c15c-4db3-b9b2-c4989335fc80 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:07.308978 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-adf2a475-c15c-4db3-b9b2-c4989335fc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:07.361557 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 945/1884] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:34:07.367125 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2a475-c15c-4db3-b9b2-c4989335fc80 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:07.370554 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfdcc5-8fcd-4e7b-8a99-466df37d5d8f None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:07.418361 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c898f9-7677-4804-8f5b-39a97c9e6423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:07.419051 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c898f9-7677-4804-8f5b-39a97c9e6423 service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:07.419408 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c898f9-7677-4804-8f5b-39a97c9e6423 service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:07.419620 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c898f9-7677-4804-8f5b-39a97c9e6423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:07.426245 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfdcc5-8fcd-4e7b-8a99-466df37d5d8f None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:07.429683 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c898f9-7677-4804-8f5b-39a97c9e6423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:07.430669 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb38a1a-d614-4966-bdbd-539607b2d2b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:07.431173 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c898f9-7677-4804-8f5b-39a97c9e6423 service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:07.431310 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb38a1a-d614-4966-bdbd-539607b2d2b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:07.431592 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb38a1a-d614-4966-bdbd-539607b2d2b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:07.431864 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb38a1a-d614-4966-bdbd-539607b2d2b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:07.440770 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 940/1885] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:34:07.441498 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb38a1a-d614-4966-bdbd-539607b2d2b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:07.443015 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb38a1a-d614-4966-bdbd-539607b2d2b9 service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:07.453003 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 946/1886] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:34:07.997371 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227c0f0-cf31-4391-a646-6c88b78d254f None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:07.997896 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227c0f0-cf31-4391-a646-6c88b78d254f None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:07.997971 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227c0f0-cf31-4391-a646-6c88b78d254f None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:07.999781 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 941/1887] 10.222.0.62 () {54 vars in 921 bytes} [Tue Nov 23 19:34:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 19:34:08.010448 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb762d-9cab-4b96-a386-e1d6a1da661c None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:08.012843 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb762d-9cab-4b96-a386-e1d6a1da661c None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:08.012843 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb762d-9cab-4b96-a386-e1d6a1da661c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:08.029979 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-01eb762d-9cab-4b96-a386-e1d6a1da661c None None] MFA Rules not processed for user `6d91fe7f996b48b0bc28e1eadc4f8869`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:08.031193 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-01eb762d-9cab-4b96-a386-e1d6a1da661c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:08.128403 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 947/1888] 10.222.0.62 () {58 vars in 1018 bytes} [Tue Nov 23 19:34:08 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:08.160323 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227c0f0-cf31-4391-a646-6c88b78d254f None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:08.163407 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-3227c0f0-cf31-4391-a646-6c88b78d254f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:08.166083 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb762d-9cab-4b96-a386-e1d6a1da661c None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:08.173082 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-01eb762d-9cab-4b96-a386-e1d6a1da661c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:08.188023 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb762d-9cab-4b96-a386-e1d6a1da661c None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:08.193898 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec01533-ff58-4b76-b66e-7420e28f191e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:08.194576 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227c0f0-cf31-4391-a646-6c88b78d254f None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:08.195084 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec01533-ff58-4b76-b66e-7420e28f191e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:08.195440 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec01533-ff58-4b76-b66e-7420e28f191e admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:08.195789 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec01533-ff58-4b76-b66e-7420e28f191e admin admin] PATH_INFO: `/v3/projects/459be06d15174b4b8a4f1092f4e4a5f1` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:08.197744 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec01533-ff58-4b76-b66e-7420e28f191e admin admin] RBAC: Authorizing `identity:delete_project(project_id=459be06d15174b4b8a4f1092f4e4a5f1)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:08.200359 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec01533-ff58-4b76-b66e-7420e28f191e admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:08.202222 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec8daf-383d-4a1c-ad9c-6da1e86e94dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:08.202877 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec8daf-383d-4a1c-ad9c-6da1e86e94dd service nova] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:08.203129 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec8daf-383d-4a1c-ad9c-6da1e86e94dd service nova] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:08.203763 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec8daf-383d-4a1c-ad9c-6da1e86e94dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:08.216347 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec8daf-383d-4a1c-ad9c-6da1e86e94dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:08.218166 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec8daf-383d-4a1c-ad9c-6da1e86e94dd service nova] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:08.233814 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 942/1889] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:08 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:34:08.235012 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec8daf-383d-4a1c-ad9c-6da1e86e94dd service nova] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:08.236967 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-89ec8daf-383d-4a1c-ad9c-6da1e86e94dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:08.251916 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec8daf-383d-4a1c-ad9c-6da1e86e94dd service nova] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:08.257671 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84b703-da72-423a-946a-c647558c2ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:08.258529 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84b703-da72-423a-946a-c647558c2ae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:08.258809 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84b703-da72-423a-946a-c647558c2ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:08.259087 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84b703-da72-423a-946a-c647558c2ae1 admin admin] PATH_INFO: `/v3/projects/d43adfbe38b44fdbbe29abd5429c35eb` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:08.261134 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84b703-da72-423a-946a-c647558c2ae1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d43adfbe38b44fdbbe29abd5429c35eb)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:08.265897 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84b703-da72-423a-946a-c647558c2ae1 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:08.313290 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-dec01533-ff58-4b76-b66e-7420e28f191e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '459be06d15174b4b8a4f1092f4e4a5f1', 'request_id': 'req-dec01533-ff58-4b76-b66e-7420e28f191e'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:08.319308 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-dec01533-ff58-4b76-b66e-7420e28f191e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '459be06d15174b4b8a4f1092f4e4a5f1', 'request_id': 'req-dec01533-ff58-4b76-b66e-7420e28f191e'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:08.326029 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-dec01533-ff58-4b76-b66e-7420e28f191e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '459be06d15174b4b8a4f1092f4e4a5f1', 'request_id': 'req-dec01533-ff58-4b76-b66e-7420e28f191e'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:08.394162 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-4d84b703-da72-423a-946a-c647558c2ae1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd43adfbe38b44fdbbe29abd5429c35eb', 'request_id': 'req-4d84b703-da72-423a-946a-c647558c2ae1'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:08.401125 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-4d84b703-da72-423a-946a-c647558c2ae1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd43adfbe38b44fdbbe29abd5429c35eb', 'request_id': 'req-4d84b703-da72-423a-946a-c647558c2ae1'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:08.406465 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-4d84b703-da72-423a-946a-c647558c2ae1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd43adfbe38b44fdbbe29abd5429c35eb', 'request_id': 'req-4d84b703-da72-423a-946a-c647558c2ae1'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:08.421261 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-dec01533-ff58-4b76-b66e-7420e28f191e admin admin] The token cache is being invalidate because project 459be06d15174b4b8a4f1092f4e4a5f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:34:08.426051 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-dec01533-ff58-4b76-b66e-7420e28f191e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:08.426051 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-dec01533-ff58-4b76-b66e-7420e28f191e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:08.426051 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 948/1890] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:34:08 2021] DELETE /identity/v3/projects/459be06d15174b4b8a4f1092f4e4a5f1 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:08.427841 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec01533-ff58-4b76-b66e-7420e28f191e admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:08.429172 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-dec01533-ff58-4b76-b66e-7420e28f191e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:08.494334 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec01533-ff58-4b76-b66e-7420e28f191e admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:08.519111 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-4d84b703-da72-423a-946a-c647558c2ae1 admin admin] The token cache is being invalidate because project d43adfbe38b44fdbbe29abd5429c35eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:34:08.519635 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-4d84b703-da72-423a-946a-c647558c2ae1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:08.520457 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-4d84b703-da72-423a-946a-c647558c2ae1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:08.523593 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 943/1891] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:34:08 2021] DELETE /identity/v3/projects/d43adfbe38b44fdbbe29abd5429c35eb => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:08.527498 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84b703-da72-423a-946a-c647558c2ae1 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:08.528989 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-4d84b703-da72-423a-946a-c647558c2ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:08.553304 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964d1e4-7c46-46ce-a6c7-7c7e2a857ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:08.554228 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964d1e4-7c46-46ce-a6c7-7c7e2a857ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:08.554512 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964d1e4-7c46-46ce-a6c7-7c7e2a857ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:08.554787 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964d1e4-7c46-46ce-a6c7-7c7e2a857ef0 admin admin] PATH_INFO: `/v3/users/5d6800baf5f347789781c4e5bf4483b1` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:08.556029 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964d1e4-7c46-46ce-a6c7-7c7e2a857ef0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d6800baf5f347789781c4e5bf4483b1)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:08.558380 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964d1e4-7c46-46ce-a6c7-7c7e2a857ef0 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:08.596118 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84b703-da72-423a-946a-c647558c2ae1 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:08.601897 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa061160-de6b-4354-b88b-f74f2b73cdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:08.602763 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa061160-de6b-4354-b88b-f74f2b73cdc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:08.603045 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa061160-de6b-4354-b88b-f74f2b73cdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:08.603316 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa061160-de6b-4354-b88b-f74f2b73cdc0 admin admin] PATH_INFO: `/v3/users/b3f830efc2474990bfebbf11a1d2caa4` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:08.604582 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa061160-de6b-4354-b88b-f74f2b73cdc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3f830efc2474990bfebbf11a1d2caa4)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:08.606542 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa061160-de6b-4354-b88b-f74f2b73cdc0 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:08.756744 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-2964d1e4-7c46-46ce-a6c7-7c7e2a857ef0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d6800baf5f347789781c4e5bf4483b1'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:08.757429 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-2964d1e4-7c46-46ce-a6c7-7c7e2a857ef0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d6800baf5f347789781c4e5bf4483b1'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:08.813028 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-aa061160-de6b-4354-b88b-f74f2b73cdc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3f830efc2474990bfebbf11a1d2caa4'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:08.813702 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-aa061160-de6b-4354-b88b-f74f2b73cdc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3f830efc2474990bfebbf11a1d2caa4'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:08.821088 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-aa061160-de6b-4354-b88b-f74f2b73cdc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3f830efc2474990bfebbf11a1d2caa4'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:08.821736 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-aa061160-de6b-4354-b88b-f74f2b73cdc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3f830efc2474990bfebbf11a1d2caa4'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:08.827920 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-2964d1e4-7c46-46ce-a6c7-7c7e2a857ef0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d6800baf5f347789781c4e5bf4483b1'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:08.828586 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-2964d1e4-7c46-46ce-a6c7-7c7e2a857ef0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d6800baf5f347789781c4e5bf4483b1'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:08.834934 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-aa061160-de6b-4354-b88b-f74f2b73cdc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3f830efc2474990bfebbf11a1d2caa4'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:08.842331 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-2964d1e4-7c46-46ce-a6c7-7c7e2a857ef0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d6800baf5f347789781c4e5bf4483b1'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:08.856190 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 949/1892] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:34:08 2021] DELETE /identity/v3/users/5d6800baf5f347789781c4e5bf4483b1 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:08.925283 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 944/1893] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:34:08 2021] DELETE /identity/v3/users/b3f830efc2474990bfebbf11a1d2caa4 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:09.499955 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964d1e4-7c46-46ce-a6c7-7c7e2a857ef0 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:09.502164 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-2964d1e4-7c46-46ce-a6c7-7c7e2a857ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:09.575799 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964d1e4-7c46-46ce-a6c7-7c7e2a857ef0 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:09.631789 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e6e08-b04c-4d96-b35b-bf8401566bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:09.632585 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e6e08-b04c-4d96-b35b-bf8401566bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:09.632878 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e6e08-b04c-4d96-b35b-bf8401566bce admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:09.633147 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e6e08-b04c-4d96-b35b-bf8401566bce admin admin] PATH_INFO: `/v3/projects/479baebddd6642f39e8dd4e65c609c4b` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:09.634430 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e6e08-b04c-4d96-b35b-bf8401566bce admin admin] RBAC: Authorizing `identity:delete_project(project_id=479baebddd6642f39e8dd4e65c609c4b)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:09.636349 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e6e08-b04c-4d96-b35b-bf8401566bce admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:09.685132 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa061160-de6b-4354-b88b-f74f2b73cdc0 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:09.686944 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-aa061160-de6b-4354-b88b-f74f2b73cdc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:09.702557 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa061160-de6b-4354-b88b-f74f2b73cdc0 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:09.707999 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b83e14-6422-4c4e-8e11-81c8e62740b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:09.709429 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b83e14-6422-4c4e-8e11-81c8e62740b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:09.710443 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b83e14-6422-4c4e-8e11-81c8e62740b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:09.710725 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b83e14-6422-4c4e-8e11-81c8e62740b5 admin admin] PATH_INFO: `/v3/projects/4b3ab6b6253d42d693eaf4b8773f0e45` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:09.712075 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b83e14-6422-4c4e-8e11-81c8e62740b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b3ab6b6253d42d693eaf4b8773f0e45)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:09.714069 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b83e14-6422-4c4e-8e11-81c8e62740b5 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:09.739497 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-991e6e08-b04c-4d96-b35b-bf8401566bce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '479baebddd6642f39e8dd4e65c609c4b', 'request_id': 'req-991e6e08-b04c-4d96-b35b-bf8401566bce'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:09.746065 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-991e6e08-b04c-4d96-b35b-bf8401566bce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '479baebddd6642f39e8dd4e65c609c4b', 'request_id': 'req-991e6e08-b04c-4d96-b35b-bf8401566bce'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:09.752233 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-991e6e08-b04c-4d96-b35b-bf8401566bce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '479baebddd6642f39e8dd4e65c609c4b', 'request_id': 'req-991e6e08-b04c-4d96-b35b-bf8401566bce'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:09.844638 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-f1b83e14-6422-4c4e-8e11-81c8e62740b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b3ab6b6253d42d693eaf4b8773f0e45', 'request_id': 'req-f1b83e14-6422-4c4e-8e11-81c8e62740b5'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:09.851054 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-f1b83e14-6422-4c4e-8e11-81c8e62740b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b3ab6b6253d42d693eaf4b8773f0e45', 'request_id': 'req-f1b83e14-6422-4c4e-8e11-81c8e62740b5'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:09.856990 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-f1b83e14-6422-4c4e-8e11-81c8e62740b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b3ab6b6253d42d693eaf4b8773f0e45', 'request_id': 'req-f1b83e14-6422-4c4e-8e11-81c8e62740b5'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:09.863389 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-991e6e08-b04c-4d96-b35b-bf8401566bce admin admin] The token cache is being invalidate because project 479baebddd6642f39e8dd4e65c609c4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:34:09.863685 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-991e6e08-b04c-4d96-b35b-bf8401566bce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:09.864303 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-991e6e08-b04c-4d96-b35b-bf8401566bce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:09.866397 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 950/1894] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:34:09 2021] DELETE /identity/v3/projects/479baebddd6642f39e8dd4e65c609c4b => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:09.873397 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a067e1e-e990-461b-b063-2be286d31670 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:09.873706 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a067e1e-e990-461b-b063-2be286d31670 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:09.873981 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a067e1e-e990-461b-b063-2be286d31670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:09.892528 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-3a067e1e-e990-461b-b063-2be286d31670 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:09.893745 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-3a067e1e-e990-461b-b063-2be286d31670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:09.919257 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-f1b83e14-6422-4c4e-8e11-81c8e62740b5 admin admin] The token cache is being invalidate because project 4b3ab6b6253d42d693eaf4b8773f0e45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:34:09.919580 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-f1b83e14-6422-4c4e-8e11-81c8e62740b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:09.920158 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-f1b83e14-6422-4c4e-8e11-81c8e62740b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:09.921941 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 945/1895] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:34:09 2021] DELETE /identity/v3/projects/4b3ab6b6253d42d693eaf4b8773f0e45 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:09.928430 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b8e95-c8dc-4889-a708-c2917e36f2ea None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:09.928670 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b8e95-c8dc-4889-a708-c2917e36f2ea None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:09.928976 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b8e95-c8dc-4889-a708-c2917e36f2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:09.947210 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-536b8e95-c8dc-4889-a708-c2917e36f2ea None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:09.948418 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-536b8e95-c8dc-4889-a708-c2917e36f2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:09.956844 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 951/1896] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:34:09.967272 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb592f2-f947-4bd4-b9d2-e164d5662e36 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:09.967553 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb592f2-f947-4bd4-b9d2-e164d5662e36 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:09.967838 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb592f2-f947-4bd4-b9d2-e164d5662e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:09.987546 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-dcb592f2-f947-4bd4-b9d2-e164d5662e36 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:10.003458 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-dcb592f2-f947-4bd4-b9d2-e164d5662e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:10.003458 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 952/1897] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:34:10.006873 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb592f2-f947-4bd4-b9d2-e164d5662e36 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:10.010186 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 946/1898] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:10.015601 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb592f2-f947-4bd4-b9d2-e164d5662e36 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:10.017509 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042f195-9b81-4e6c-96cb-e16e5b653ac4 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:10.017807 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042f195-9b81-4e6c-96cb-e16e5b653ac4 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:10.018069 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042f195-9b81-4e6c-96cb-e16e5b653ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:10.020279 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cffc3-aae1-436c-adc4-2bc483f5786a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:10.020948 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cffc3-aae1-436c-adc4-2bc483f5786a admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:10.021794 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cffc3-aae1-436c-adc4-2bc483f5786a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:10.022091 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cffc3-aae1-436c-adc4-2bc483f5786a admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:10.022811 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7cffc3-aae1-436c-adc4-2bc483f5786a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:34:10.023116 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7cffc3-aae1-436c-adc4-2bc483f5786a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:10.024687 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7cffc3-aae1-436c-adc4-2bc483f5786a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:10.035925 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-3042f195-9b81-4e6c-96cb-e16e5b653ac4 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:10.036090 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 953/1899] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:34:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:34:10.041924 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-3042f195-9b81-4e6c-96cb-e16e5b653ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:10.049563 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 947/1900] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:34:10.049712 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cffc3-aae1-436c-adc4-2bc483f5786a admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:10.051077 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042f195-9b81-4e6c-96cb-e16e5b653ac4 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:10.059867 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cffc3-aae1-436c-adc4-2bc483f5786a admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:10.061587 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042f195-9b81-4e6c-96cb-e16e5b653ac4 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:10.064613 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae2b2a-1fa0-452d-8d5e-f2b219c4ca84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:10.065266 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae2b2a-1fa0-452d-8d5e-f2b219c4ca84 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:10.065593 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae2b2a-1fa0-452d-8d5e-f2b219c4ca84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:10.065872 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae2b2a-1fa0-452d-8d5e-f2b219c4ca84 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:10.066330 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f83aaa-ae4a-40d4-ab5f-f04062823047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:10.066577 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae2b2a-1fa0-452d-8d5e-f2b219c4ca84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:10.067055 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f83aaa-ae4a-40d4-ab5f-f04062823047 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:10.067342 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f83aaa-ae4a-40d4-ab5f-f04062823047 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:10.067623 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f83aaa-ae4a-40d4-ab5f-f04062823047 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:10.069179 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae2b2a-1fa0-452d-8d5e-f2b219c4ca84 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:10.069294 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f83aaa-ae4a-40d4-ab5f-f04062823047 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:34:10.069567 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f83aaa-ae4a-40d4-ab5f-f04062823047 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:10.071484 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f83aaa-ae4a-40d4-ab5f-f04062823047 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:10.083274 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 948/1901] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:34:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:34:10.087460 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f83aaa-ae4a-40d4-ab5f-f04062823047 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:10.096842 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f83aaa-ae4a-40d4-ab5f-f04062823047 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:10.101634 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495bc14-409a-488f-8cc4-87621e453601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:10.102255 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495bc14-409a-488f-8cc4-87621e453601 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:10.102541 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495bc14-409a-488f-8cc4-87621e453601 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:10.102817 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495bc14-409a-488f-8cc4-87621e453601 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:10.103506 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495bc14-409a-488f-8cc4-87621e453601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:10.105347 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495bc14-409a-488f-8cc4-87621e453601 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:10.160478 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 954/1902] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:34:10 2021] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:34:10.165099 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae2b2a-1fa0-452d-8d5e-f2b219c4ca84 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:10.192339 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 949/1903] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:34:10 2021] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:34:10.193953 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495bc14-409a-488f-8cc4-87621e453601 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:10.225286 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae2b2a-1fa0-452d-8d5e-f2b219c4ca84 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:10.254838 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495bc14-409a-488f-8cc4-87621e453601 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:10.260453 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56784d6c-9e3d-45f2-8d1e-a571fca83631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:10.261130 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56784d6c-9e3d-45f2-8d1e-a571fca83631 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:10.261455 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56784d6c-9e3d-45f2-8d1e-a571fca83631 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:10.261718 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56784d6c-9e3d-45f2-8d1e-a571fca83631 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:10.262483 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56784d6c-9e3d-45f2-8d1e-a571fca83631 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:10.264377 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56784d6c-9e3d-45f2-8d1e-a571fca83631 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:10.295575 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2b335-f887-42b3-8e6a-dfc5070ea50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:10.296433 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2b335-f887-42b3-8e6a-dfc5070ea50c admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:10.296781 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2b335-f887-42b3-8e6a-dfc5070ea50c admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:10.297124 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2b335-f887-42b3-8e6a-dfc5070ea50c admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:10.297943 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c2b335-f887-42b3-8e6a-dfc5070ea50c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:10.300357 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c2b335-f887-42b3-8e6a-dfc5070ea50c admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:10.388773 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 950/1904] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:34:10 2021] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:10.401559 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 955/1905] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:34:10 2021] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:34:10.405388 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56784d6c-9e3d-45f2-8d1e-a571fca83631 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:10.408405 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2b335-f887-42b3-8e6a-dfc5070ea50c admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:10.425330 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56784d6c-9e3d-45f2-8d1e-a571fca83631 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:10.426045 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2b335-f887-42b3-8e6a-dfc5070ea50c admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:10.435678 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17960b3-4949-4a27-b83c-03c7bb746209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:10.436353 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17960b3-4949-4a27-b83c-03c7bb746209 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:10.437040 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceacb707-903a-4d75-8cfb-cf718f56fbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:10.437730 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacb707-903a-4d75-8cfb-cf718f56fbeb admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:10.438004 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacb707-903a-4d75-8cfb-cf718f56fbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:10.438272 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacb707-903a-4d75-8cfb-cf718f56fbeb admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:10.439082 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17960b3-4949-4a27-b83c-03c7bb746209 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:10.439355 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17960b3-4949-4a27-b83c-03c7bb746209 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:10.440166 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17960b3-4949-4a27-b83c-03c7bb746209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:10.441786 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17960b3-4949-4a27-b83c-03c7bb746209 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:10.442310 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceacb707-903a-4d75-8cfb-cf718f56fbeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:10.444195 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceacb707-903a-4d75-8cfb-cf718f56fbeb admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:10.472386 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 956/1906] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:10 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:10.473303 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 951/1907] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:10 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:10.474832 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17960b3-4949-4a27-b83c-03c7bb746209 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:10.475632 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceacb707-903a-4d75-8cfb-cf718f56fbeb admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:10.492672 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17960b3-4949-4a27-b83c-03c7bb746209 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:10.495421 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceacb707-903a-4d75-8cfb-cf718f56fbeb admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:10.500285 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b0024-38c6-4744-bb80-44f554afebc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:10.501003 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b0024-38c6-4744-bb80-44f554afebc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:10.501256 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b0024-38c6-4744-bb80-44f554afebc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:10.501578 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b0024-38c6-4744-bb80-44f554afebc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:10.502316 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b0024-38c6-4744-bb80-44f554afebc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:10.503875 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b0024-38c6-4744-bb80-44f554afebc7 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:10.510664 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7d678-d37b-4bb2-82c1-8f3f78861106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:10.510664 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7d678-d37b-4bb2-82c1-8f3f78861106 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:10.511114 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7d678-d37b-4bb2-82c1-8f3f78861106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:10.511475 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7d678-d37b-4bb2-82c1-8f3f78861106 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:10.512548 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7d678-d37b-4bb2-82c1-8f3f78861106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:10.514328 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7d678-d37b-4bb2-82c1-8f3f78861106 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:10.517840 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 957/1908] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:10 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:10.518768 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b0024-38c6-4744-bb80-44f554afebc7 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:10.526311 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 952/1909] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:10 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:10.530572 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7d678-d37b-4bb2-82c1-8f3f78861106 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:10.534097 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b0024-38c6-4744-bb80-44f554afebc7 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:10.539980 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83326aa0-ec5e-4089-a556-7e7639cae1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:10.540926 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83326aa0-ec5e-4089-a556-7e7639cae1ad admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:10.541204 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83326aa0-ec5e-4089-a556-7e7639cae1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:10.541512 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83326aa0-ec5e-4089-a556-7e7639cae1ad admin admin] PATH_INFO: `/v3/projects/782a8506433445c0b68f88fe585578f1/users/8fdfec4e2de24fd781ce570b88c0eb7f/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:10.542506 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7d678-d37b-4bb2-82c1-8f3f78861106 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:10.547403 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b9ea3-cbf6-47a0-9d77-b4eb4c1203ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:10.548410 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b9ea3-cbf6-47a0-9d77-b4eb4c1203ad admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:10.548793 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b9ea3-cbf6-47a0-9d77-b4eb4c1203ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:10.549167 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b9ea3-cbf6-47a0-9d77-b4eb4c1203ad admin admin] PATH_INFO: `/v3/projects/a9f1ee8eeb854e37bdd20f9562452350/users/82bc30b727c34f0180104a556d8ceb46/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:10.557650 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83326aa0-ec5e-4089-a556-7e7639cae1ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=782a8506433445c0b68f88fe585578f1, user_id=8fdfec4e2de24fd781ce570b88c0eb7f, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:10.560238 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83326aa0-ec5e-4089-a556-7e7639cae1ad admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:10.568274 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b9ea3-cbf6-47a0-9d77-b4eb4c1203ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9f1ee8eeb854e37bdd20f9562452350, user_id=82bc30b727c34f0180104a556d8ceb46, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:10.571833 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b9ea3-cbf6-47a0-9d77-b4eb4c1203ad admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:10.645304 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 958/1910] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:10 2021] PUT /identity/v3/projects/782a8506433445c0b68f88fe585578f1/users/8fdfec4e2de24fd781ce570b88c0eb7f/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:10.656256 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b1881-7942-43fa-888b-6c897e9c98ae None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:10.656545 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b1881-7942-43fa-888b-6c897e9c98ae None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:10.656876 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b1881-7942-43fa-888b-6c897e9c98ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:10.672624 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 953/1911] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:10 2021] PUT /identity/v3/projects/a9f1ee8eeb854e37bdd20f9562452350/users/82bc30b727c34f0180104a556d8ceb46/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:10.685011 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b18586-69bc-453e-9a3d-ab5cc811f1e2 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:10.685546 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b18586-69bc-453e-9a3d-ab5cc811f1e2 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:10.686153 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b18586-69bc-453e-9a3d-ab5cc811f1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:10.697171 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-666b1881-7942-43fa-888b-6c897e9c98ae None None] MFA Rules not processed for user `8fdfec4e2de24fd781ce570b88c0eb7f`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:10.697171 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-666b1881-7942-43fa-888b-6c897e9c98ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:10.716674 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-01b18586-69bc-453e-9a3d-ab5cc811f1e2 None None] MFA Rules not processed for user `82bc30b727c34f0180104a556d8ceb46`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:10.717916 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-01b18586-69bc-453e-9a3d-ab5cc811f1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:10.764992 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 959/1912] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:10 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:34:10.776880 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b1881-7942-43fa-888b-6c897e9c98ae None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:10.778312 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-666b1881-7942-43fa-888b-6c897e9c98ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:10.789012 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 954/1913] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:10 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:34:10.794960 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b18586-69bc-453e-9a3d-ab5cc811f1e2 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:10.847327 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b1881-7942-43fa-888b-6c897e9c98ae None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:10.852061 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c136a5d-2c53-48a9-bb4c-734f081bf953 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:10.852706 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c136a5d-2c53-48a9-bb4c-734f081bf953 service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:10.852986 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c136a5d-2c53-48a9-bb4c-734f081bf953 service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:10.853261 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c136a5d-2c53-48a9-bb4c-734f081bf953 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:10.859480 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b18586-69bc-453e-9a3d-ab5cc811f1e2 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:10.861494 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c136a5d-2c53-48a9-bb4c-734f081bf953 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:10.862942 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c136a5d-2c53-48a9-bb4c-734f081bf953 service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:10.864108 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63991293-c00b-4b9c-b164-1ae3db05ee34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:10.864825 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63991293-c00b-4b9c-b164-1ae3db05ee34 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:10.865136 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63991293-c00b-4b9c-b164-1ae3db05ee34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:10.865441 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63991293-c00b-4b9c-b164-1ae3db05ee34 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:10.866170 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63991293-c00b-4b9c-b164-1ae3db05ee34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:10.868053 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63991293-c00b-4b9c-b164-1ae3db05ee34 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:10.871677 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 960/1914] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:10 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:34:10.891452 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c136a5d-2c53-48a9-bb4c-734f081bf953 service cinder] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:10.902497 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c136a5d-2c53-48a9-bb4c-734f081bf953 service cinder] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:10.907114 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a12b7-c5f4-4bb9-8343-26f1217241dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:10.907943 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a12b7-c5f4-4bb9-8343-26f1217241dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:10.908222 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a12b7-c5f4-4bb9-8343-26f1217241dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:10.908494 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a12b7-c5f4-4bb9-8343-26f1217241dc admin admin] PATH_INFO: `/v3/users/8fdfec4e2de24fd781ce570b88c0eb7f` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:10.909722 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a12b7-c5f4-4bb9-8343-26f1217241dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fdfec4e2de24fd781ce570b88c0eb7f)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:10.911592 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a12b7-c5f4-4bb9-8343-26f1217241dc admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:10.939542 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 955/1915] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:34:10 2021] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:10.945537 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63991293-c00b-4b9c-b164-1ae3db05ee34 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:11.003968 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63991293-c00b-4b9c-b164-1ae3db05ee34 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:11.009301 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc66064-991f-4390-9966-83d9ae188302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:11.009984 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc66064-991f-4390-9966-83d9ae188302 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:11.010265 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc66064-991f-4390-9966-83d9ae188302 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:11.010544 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc66064-991f-4390-9966-83d9ae188302 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:11.011237 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc66064-991f-4390-9966-83d9ae188302 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:11.013124 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc66064-991f-4390-9966-83d9ae188302 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:11.093056 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-746a12b7-c5f4-4bb9-8343-26f1217241dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fdfec4e2de24fd781ce570b88c0eb7f'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:11.093688 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-746a12b7-c5f4-4bb9-8343-26f1217241dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fdfec4e2de24fd781ce570b88c0eb7f'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:11.112986 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 956/1916] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:34:10 2021] POST /identity/v3/users => generated 300 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:34:11.117025 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc66064-991f-4390-9966-83d9ae188302 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:11.126346 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc66064-991f-4390-9966-83d9ae188302 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:11.131663 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4af636-c502-4525-b868-189ba1b64edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:11.132289 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4af636-c502-4525-b868-189ba1b64edf admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:11.132567 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4af636-c502-4525-b868-189ba1b64edf admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:11.132839 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4af636-c502-4525-b868-189ba1b64edf admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:11.133590 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4af636-c502-4525-b868-189ba1b64edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:11.135155 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4af636-c502-4525-b868-189ba1b64edf admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:11.144667 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 957/1917] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:11 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:34:11.149322 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4af636-c502-4525-b868-189ba1b64edf admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:11.158448 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4af636-c502-4525-b868-189ba1b64edf admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:11.163039 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8629855-c740-488e-90c3-0ff5c50c8dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:11.163861 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8629855-c740-488e-90c3-0ff5c50c8dcb admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:11.164139 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8629855-c740-488e-90c3-0ff5c50c8dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:11.164410 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8629855-c740-488e-90c3-0ff5c50c8dcb admin admin] PATH_INFO: `/v3/projects/b86e869ee9404677ad2ec024eab2c81a/users/939a8b8c46724c198a2ccc0732fa609d/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:11.179397 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8629855-c740-488e-90c3-0ff5c50c8dcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b86e869ee9404677ad2ec024eab2c81a, user_id=939a8b8c46724c198a2ccc0732fa609d, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:11.181994 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8629855-c740-488e-90c3-0ff5c50c8dcb admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:11.198881 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-746a12b7-c5f4-4bb9-8343-26f1217241dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fdfec4e2de24fd781ce570b88c0eb7f'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:11.199503 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-746a12b7-c5f4-4bb9-8343-26f1217241dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fdfec4e2de24fd781ce570b88c0eb7f'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:11.212867 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-746a12b7-c5f4-4bb9-8343-26f1217241dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fdfec4e2de24fd781ce570b88c0eb7f'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:11.225321 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 961/1918] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:34:10 2021] DELETE /identity/v3/users/8fdfec4e2de24fd781ce570b88c0eb7f => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:11.229721 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0840019-b604-419f-b202-8868cb9a347e None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:11.230010 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0840019-b604-419f-b202-8868cb9a347e None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:11.230290 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0840019-b604-419f-b202-8868cb9a347e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:11.247350 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-d0840019-b604-419f-b202-8868cb9a347e None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:11.248537 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-d0840019-b604-419f-b202-8868cb9a347e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:11.251628 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 958/1919] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:11 2021] PUT /identity/v3/projects/b86e869ee9404677ad2ec024eab2c81a/users/939a8b8c46724c198a2ccc0732fa609d/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:11.258574 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8629855-c740-488e-90c3-0ff5c50c8dcb admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:11.260292 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-c8629855-c740-488e-90c3-0ff5c50c8dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:11.311259 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 962/1920] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:34:11.321732 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0840019-b604-419f-b202-8868cb9a347e None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:11.323381 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-d0840019-b604-419f-b202-8868cb9a347e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:11.324176 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8629855-c740-488e-90c3-0ff5c50c8dcb admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:11.329159 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed665d-287b-4da7-bffd-422a2d380723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:11.329852 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed665d-287b-4da7-bffd-422a2d380723 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:11.330138 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed665d-287b-4da7-bffd-422a2d380723 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:11.330407 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed665d-287b-4da7-bffd-422a2d380723 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:11.331147 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed665d-287b-4da7-bffd-422a2d380723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:11.332708 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed665d-287b-4da7-bffd-422a2d380723 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:11.342432 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 959/1921] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:11 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:34:11.346540 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed665d-287b-4da7-bffd-422a2d380723 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:11.355562 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed665d-287b-4da7-bffd-422a2d380723 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:11.360219 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77aa01-93f6-4334-98cd-19ce2d4045c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:11.361071 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77aa01-93f6-4334-98cd-19ce2d4045c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:11.361352 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77aa01-93f6-4334-98cd-19ce2d4045c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:11.361660 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77aa01-93f6-4334-98cd-19ce2d4045c2 admin admin] PATH_INFO: `/v3/projects/b86e869ee9404677ad2ec024eab2c81a/users/939a8b8c46724c198a2ccc0732fa609d/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:11.363629 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d77aa01-93f6-4334-98cd-19ce2d4045c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b86e869ee9404677ad2ec024eab2c81a, user_id=939a8b8c46724c198a2ccc0732fa609d, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:11.366765 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d77aa01-93f6-4334-98cd-19ce2d4045c2 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:11.376552 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 960/1922] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:11 2021] PUT /identity/v3/projects/b86e869ee9404677ad2ec024eab2c81a/users/939a8b8c46724c198a2ccc0732fa609d/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:11.378837 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0840019-b604-419f-b202-8868cb9a347e None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:11.387026 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de332c08-412d-4495-968d-0043284fc17a None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:11.387315 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de332c08-412d-4495-968d-0043284fc17a None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:11.387599 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de332c08-412d-4495-968d-0043284fc17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:11.412988 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-de332c08-412d-4495-968d-0043284fc17a None None] MFA Rules not processed for user `939a8b8c46724c198a2ccc0732fa609d`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:11.414242 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-de332c08-412d-4495-968d-0043284fc17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:11.425785 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09bd6b-a8c8-436b-a761-07c387848874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:11.429554 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09bd6b-a8c8-436b-a761-07c387848874 service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:11.429554 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09bd6b-a8c8-436b-a761-07c387848874 service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:11.429554 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09bd6b-a8c8-436b-a761-07c387848874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:11.481078 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 961/1923] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:11 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:34:11.486820 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09bd6b-a8c8-436b-a761-07c387848874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:11.492828 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09bd6b-a8c8-436b-a761-07c387848874 service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:11.492937 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de332c08-412d-4495-968d-0043284fc17a None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:11.492937 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-de332c08-412d-4495-968d-0043284fc17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:11.501012 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 963/1924] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:34:11.549991 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de332c08-412d-4495-968d-0043284fc17a None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:11.558356 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89821d98-1640-43fa-858d-74b0ac4f7790 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:11.559025 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89821d98-1640-43fa-858d-74b0ac4f7790 service cinder] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:11.559310 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89821d98-1640-43fa-858d-74b0ac4f7790 service cinder] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:11.559642 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89821d98-1640-43fa-858d-74b0ac4f7790 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:11.570503 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89821d98-1640-43fa-858d-74b0ac4f7790 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:11.572329 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89821d98-1640-43fa-858d-74b0ac4f7790 service cinder] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:11.585292 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 962/1925] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:11 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:34:12.052285 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09bd6b-a8c8-436b-a761-07c387848874 service neutron] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:12.054213 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-9f09bd6b-a8c8-436b-a761-07c387848874 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:12.071748 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09bd6b-a8c8-436b-a761-07c387848874 service neutron] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:12.076997 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb24d72-7bca-4f61-9957-d5df7e198fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:12.077893 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb24d72-7bca-4f61-9957-d5df7e198fae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:12.078654 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb24d72-7bca-4f61-9957-d5df7e198fae admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:12.079003 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb24d72-7bca-4f61-9957-d5df7e198fae admin admin] PATH_INFO: `/v3/projects/782a8506433445c0b68f88fe585578f1` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:12.080239 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb24d72-7bca-4f61-9957-d5df7e198fae admin admin] RBAC: Authorizing `identity:delete_project(project_id=782a8506433445c0b68f88fe585578f1)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:12.082148 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb24d72-7bca-4f61-9957-d5df7e198fae admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:12.175638 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-5fb24d72-7bca-4f61-9957-d5df7e198fae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '782a8506433445c0b68f88fe585578f1', 'request_id': 'req-5fb24d72-7bca-4f61-9957-d5df7e198fae'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:12.181301 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-5fb24d72-7bca-4f61-9957-d5df7e198fae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '782a8506433445c0b68f88fe585578f1', 'request_id': 'req-5fb24d72-7bca-4f61-9957-d5df7e198fae'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:12.187476 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-5fb24d72-7bca-4f61-9957-d5df7e198fae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '782a8506433445c0b68f88fe585578f1', 'request_id': 'req-5fb24d72-7bca-4f61-9957-d5df7e198fae'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:12.266836 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-5fb24d72-7bca-4f61-9957-d5df7e198fae admin admin] The token cache is being invalidate because project 782a8506433445c0b68f88fe585578f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:34:12.267128 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-5fb24d72-7bca-4f61-9957-d5df7e198fae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:12.267745 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-5fb24d72-7bca-4f61-9957-d5df7e198fae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:12.269313 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 964/1926] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:34:12 2021] DELETE /identity/v3/projects/782a8506433445c0b68f88fe585578f1 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:12.276027 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28374ed8-d36d-438e-8596-3d07f056900f None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:12.276488 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28374ed8-d36d-438e-8596-3d07f056900f None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:12.276604 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28374ed8-d36d-438e-8596-3d07f056900f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:12.295159 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-28374ed8-d36d-438e-8596-3d07f056900f None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:12.296345 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-28374ed8-d36d-438e-8596-3d07f056900f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:12.357672 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 963/1927] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:12.366249 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7cf38-d7e3-4a97-90e9-5f6e70000ef2 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:12.366614 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7cf38-d7e3-4a97-90e9-5f6e70000ef2 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:12.366961 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7cf38-d7e3-4a97-90e9-5f6e70000ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:12.386174 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-0ee7cf38-d7e3-4a97-90e9-5f6e70000ef2 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:12.387377 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-0ee7cf38-d7e3-4a97-90e9-5f6e70000ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:12.395244 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 965/1928] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:12.400270 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28374ed8-d36d-438e-8596-3d07f056900f None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:12.409695 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28374ed8-d36d-438e-8596-3d07f056900f None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:12.414364 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560fc343-7d38-4b93-b9f3-e8c63ef70ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:12.415058 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fc343-7d38-4b93-b9f3-e8c63ef70ade admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:12.415333 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fc343-7d38-4b93-b9f3-e8c63ef70ade admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:12.415601 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fc343-7d38-4b93-b9f3-e8c63ef70ade admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:12.416332 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560fc343-7d38-4b93-b9f3-e8c63ef70ade admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:34:12.416633 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560fc343-7d38-4b93-b9f3-e8c63ef70ade admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:12.418242 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560fc343-7d38-4b93-b9f3-e8c63ef70ade admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:12.431799 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 964/1929] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:34:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:34:12.434721 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7cf38-d7e3-4a97-90e9-5f6e70000ef2 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:12.445007 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7cf38-d7e3-4a97-90e9-5f6e70000ef2 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:12.449886 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3feee-f52f-438a-b06f-177fc06f9694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:12.454879 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3feee-f52f-438a-b06f-177fc06f9694 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:12.454879 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3feee-f52f-438a-b06f-177fc06f9694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:12.454879 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3feee-f52f-438a-b06f-177fc06f9694 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:12.454879 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3feee-f52f-438a-b06f-177fc06f9694 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:12.454879 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3feee-f52f-438a-b06f-177fc06f9694 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:12.526959 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 966/1930] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:34:12 2021] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:34:12.531072 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560fc343-7d38-4b93-b9f3-e8c63ef70ade admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:12.541758 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560fc343-7d38-4b93-b9f3-e8c63ef70ade admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:12.604034 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912d0b4-73e0-48e4-a0d6-cb432d462ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:12.604803 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912d0b4-73e0-48e4-a0d6-cb432d462ecb admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:12.605090 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912d0b4-73e0-48e4-a0d6-cb432d462ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:12.605364 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912d0b4-73e0-48e4-a0d6-cb432d462ecb admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:12.606115 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4912d0b4-73e0-48e4-a0d6-cb432d462ecb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:12.608002 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4912d0b4-73e0-48e4-a0d6-cb432d462ecb admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:12.673908 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 965/1931] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:34:12 2021] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:12.678178 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3feee-f52f-438a-b06f-177fc06f9694 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:12.689094 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3feee-f52f-438a-b06f-177fc06f9694 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:12.697976 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fb013-ea66-4efc-9152-415a90b5d794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:12.698252 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fb013-ea66-4efc-9152-415a90b5d794 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:12.698540 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fb013-ea66-4efc-9152-415a90b5d794 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:12.698819 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fb013-ea66-4efc-9152-415a90b5d794 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:12.699567 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fb013-ea66-4efc-9152-415a90b5d794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:12.701425 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fb013-ea66-4efc-9152-415a90b5d794 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:12.712901 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 967/1932] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:12 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:12.716862 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912d0b4-73e0-48e4-a0d6-cb432d462ecb admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:12.727623 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912d0b4-73e0-48e4-a0d6-cb432d462ecb admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:12.731226 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fb013-ea66-4efc-9152-415a90b5d794 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:12.733824 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-509fb013-ea66-4efc-9152-415a90b5d794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:12.735799 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e5ffc-9f60-424a-8ab4-582b337a7474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:12.736466 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e5ffc-9f60-424a-8ab4-582b337a7474 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:12.736752 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e5ffc-9f60-424a-8ab4-582b337a7474 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:12.737026 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e5ffc-9f60-424a-8ab4-582b337a7474 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:12.737962 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e5ffc-9f60-424a-8ab4-582b337a7474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:12.739540 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e5ffc-9f60-424a-8ab4-582b337a7474 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:12.748081 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fb013-ea66-4efc-9152-415a90b5d794 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:12.753813 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 966/1933] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:12 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:12.754921 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e5ffc-9f60-424a-8ab4-582b337a7474 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:12.756981 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eda045-2547-465c-a968-4c69e029de20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:12.758159 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eda045-2547-465c-a968-4c69e029de20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:12.758449 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eda045-2547-465c-a968-4c69e029de20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:12.758725 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eda045-2547-465c-a968-4c69e029de20 admin admin] PATH_INFO: `/v3/users/82bc30b727c34f0180104a556d8ceb46` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:12.759970 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eda045-2547-465c-a968-4c69e029de20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82bc30b727c34f0180104a556d8ceb46)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:12.762035 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eda045-2547-465c-a968-4c69e029de20 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:12.766866 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e5ffc-9f60-424a-8ab4-582b337a7474 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:12.772331 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376d4d0-c0fd-47cd-b71d-d1269dca65ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:12.773232 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376d4d0-c0fd-47cd-b71d-d1269dca65ce admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:12.773554 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376d4d0-c0fd-47cd-b71d-d1269dca65ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:12.773833 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376d4d0-c0fd-47cd-b71d-d1269dca65ce admin admin] PATH_INFO: `/v3/projects/36b0e454874347efa954172edc69c5c8/users/7b326869f3d74dfd8334e82f60c73a86/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:12.790490 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376d4d0-c0fd-47cd-b71d-d1269dca65ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=36b0e454874347efa954172edc69c5c8, user_id=7b326869f3d74dfd8334e82f60c73a86, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:12.798214 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376d4d0-c0fd-47cd-b71d-d1269dca65ce admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:12.914705 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 967/1934] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:12 2021] PUT /identity/v3/projects/36b0e454874347efa954172edc69c5c8/users/7b326869f3d74dfd8334e82f60c73a86/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:12.925664 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d616d-b815-4aee-bce9-09e1e415f6d0 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:12.925960 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d616d-b815-4aee-bce9-09e1e415f6d0 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:12.926242 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d616d-b815-4aee-bce9-09e1e415f6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:12.976329 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-1f7d616d-b815-4aee-bce9-09e1e415f6d0 None None] MFA Rules not processed for user `7b326869f3d74dfd8334e82f60c73a86`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:12.977619 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-1f7d616d-b815-4aee-bce9-09e1e415f6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:13.005386 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-d9eda045-2547-465c-a968-4c69e029de20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82bc30b727c34f0180104a556d8ceb46'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:13.007836 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-d9eda045-2547-465c-a968-4c69e029de20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82bc30b727c34f0180104a556d8ceb46'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:13.118043 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-d9eda045-2547-465c-a968-4c69e029de20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82bc30b727c34f0180104a556d8ceb46'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:13.119194 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-d9eda045-2547-465c-a968-4c69e029de20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82bc30b727c34f0180104a556d8ceb46'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:13.132572 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 968/1935] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:12 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:13.146908 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d616d-b815-4aee-bce9-09e1e415f6d0 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:13.147746 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-d9eda045-2547-465c-a968-4c69e029de20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82bc30b727c34f0180104a556d8ceb46'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:13.148380 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-1f7d616d-b815-4aee-bce9-09e1e415f6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:13.170355 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 968/1936] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:34:12 2021] DELETE /identity/v3/users/82bc30b727c34f0180104a556d8ceb46 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:13.174962 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622b755-f1ca-4911-80f1-5963e39ae63f None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:13.175431 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622b755-f1ca-4911-80f1-5963e39ae63f None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:13.175707 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622b755-f1ca-4911-80f1-5963e39ae63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:13.198800 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-0622b755-f1ca-4911-80f1-5963e39ae63f None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:13.200358 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-0622b755-f1ca-4911-80f1-5963e39ae63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:13.223460 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d616d-b815-4aee-bce9-09e1e415f6d0 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:13.275583 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 969/1937] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:13.279651 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830267b-3ab2-48ae-9d5f-c948922497e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:13.280551 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830267b-3ab2-48ae-9d5f-c948922497e2 service cinder] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:13.280867 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830267b-3ab2-48ae-9d5f-c948922497e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:13.281219 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830267b-3ab2-48ae-9d5f-c948922497e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:13.284316 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-c830267b-3ab2-48ae-9d5f-c948922497e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:13.290790 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0622b755-f1ca-4911-80f1-5963e39ae63f None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:13.292727 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-0622b755-f1ca-4911-80f1-5963e39ae63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:13.351016 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830267b-3ab2-48ae-9d5f-c948922497e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:13.352474 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830267b-3ab2-48ae-9d5f-c948922497e2 service cinder] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:13.363198 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 969/1938] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:13 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:34:13.376679 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0622b755-f1ca-4911-80f1-5963e39ae63f None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:13.382812 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a5e61-5e18-48fd-ae29-e1b4d84fb1ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:13.383513 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a5e61-5e18-48fd-ae29-e1b4d84fb1ca service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:13.383808 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a5e61-5e18-48fd-ae29-e1b4d84fb1ca service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:13.384096 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a5e61-5e18-48fd-ae29-e1b4d84fb1ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:13.394630 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98a5e61-5e18-48fd-ae29-e1b4d84fb1ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:13.396698 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98a5e61-5e18-48fd-ae29-e1b4d84fb1ca service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:13.409645 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 970/1939] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:34:13.827799 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830267b-3ab2-48ae-9d5f-c948922497e2 service cinder] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:13.829439 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-c830267b-3ab2-48ae-9d5f-c948922497e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:13.852729 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830267b-3ab2-48ae-9d5f-c948922497e2 service cinder] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:13.857982 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342979e-456d-410d-97de-3d392750909f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:13.859307 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342979e-456d-410d-97de-3d392750909f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:13.859591 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342979e-456d-410d-97de-3d392750909f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:13.859869 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342979e-456d-410d-97de-3d392750909f admin admin] PATH_INFO: `/v3/projects/a9f1ee8eeb854e37bdd20f9562452350` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:13.861128 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342979e-456d-410d-97de-3d392750909f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9f1ee8eeb854e37bdd20f9562452350)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:13.863075 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342979e-456d-410d-97de-3d392750909f admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:13.971644 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-d342979e-456d-410d-97de-3d392750909f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9f1ee8eeb854e37bdd20f9562452350', 'request_id': 'req-d342979e-456d-410d-97de-3d392750909f'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:13.978254 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-d342979e-456d-410d-97de-3d392750909f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9f1ee8eeb854e37bdd20f9562452350', 'request_id': 'req-d342979e-456d-410d-97de-3d392750909f'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:13.984937 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-d342979e-456d-410d-97de-3d392750909f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9f1ee8eeb854e37bdd20f9562452350', 'request_id': 'req-d342979e-456d-410d-97de-3d392750909f'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:14.062304 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-d342979e-456d-410d-97de-3d392750909f admin admin] The token cache is being invalidate because project a9f1ee8eeb854e37bdd20f9562452350 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:34:14.062650 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-d342979e-456d-410d-97de-3d392750909f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:14.063263 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-d342979e-456d-410d-97de-3d392750909f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:14.068684 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 970/1940] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:34:13 2021] DELETE /identity/v3/projects/a9f1ee8eeb854e37bdd20f9562452350 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:14.070159 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a5e61-5e18-48fd-ae29-e1b4d84fb1ca service neutron] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:14.086403 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a5e61-5e18-48fd-ae29-e1b4d84fb1ca service neutron] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:14.154815 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4173b9-fe2e-4b80-b1f5-9c1dab7a32c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:14.154815 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4173b9-fe2e-4b80-b1f5-9c1dab7a32c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:14.154815 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4173b9-fe2e-4b80-b1f5-9c1dab7a32c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:14.154815 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4173b9-fe2e-4b80-b1f5-9c1dab7a32c3 admin admin] PATH_INFO: `/v3/users/939a8b8c46724c198a2ccc0732fa609d` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:14.155161 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4173b9-fe2e-4b80-b1f5-9c1dab7a32c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=939a8b8c46724c198a2ccc0732fa609d)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:14.156759 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4173b9-fe2e-4b80-b1f5-9c1dab7a32c3 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:14.367232 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-9d4173b9-fe2e-4b80-b1f5-9c1dab7a32c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '939a8b8c46724c198a2ccc0732fa609d'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:14.367988 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-9d4173b9-fe2e-4b80-b1f5-9c1dab7a32c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '939a8b8c46724c198a2ccc0732fa609d'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:14.450845 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-9d4173b9-fe2e-4b80-b1f5-9c1dab7a32c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '939a8b8c46724c198a2ccc0732fa609d'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:14.451511 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-9d4173b9-fe2e-4b80-b1f5-9c1dab7a32c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '939a8b8c46724c198a2ccc0732fa609d'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:14.464183 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-9d4173b9-fe2e-4b80-b1f5-9c1dab7a32c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '939a8b8c46724c198a2ccc0732fa609d'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:14.476604 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 971/1941] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:34:14 2021] DELETE /identity/v3/users/939a8b8c46724c198a2ccc0732fa609d => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:14.929673 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342979e-456d-410d-97de-3d392750909f admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:14.932125 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-d342979e-456d-410d-97de-3d392750909f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:14.955223 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342979e-456d-410d-97de-3d392750909f admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:15.016629 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc96e4-7a10-48a0-b816-f318c1fa3b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:15.017866 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc96e4-7a10-48a0-b816-f318c1fa3b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:15.018351 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc96e4-7a10-48a0-b816-f318c1fa3b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:15.018768 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc96e4-7a10-48a0-b816-f318c1fa3b71 admin admin] PATH_INFO: `/v3/projects/b86e869ee9404677ad2ec024eab2c81a` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:15.020631 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc96e4-7a10-48a0-b816-f318c1fa3b71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b86e869ee9404677ad2ec024eab2c81a)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:15.023555 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc96e4-7a10-48a0-b816-f318c1fa3b71 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:15.137212 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-cbcc96e4-7a10-48a0-b816-f318c1fa3b71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b86e869ee9404677ad2ec024eab2c81a', 'request_id': 'req-cbcc96e4-7a10-48a0-b816-f318c1fa3b71'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:15.143253 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-cbcc96e4-7a10-48a0-b816-f318c1fa3b71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b86e869ee9404677ad2ec024eab2c81a', 'request_id': 'req-cbcc96e4-7a10-48a0-b816-f318c1fa3b71'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:15.149382 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-cbcc96e4-7a10-48a0-b816-f318c1fa3b71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b86e869ee9404677ad2ec024eab2c81a', 'request_id': 'req-cbcc96e4-7a10-48a0-b816-f318c1fa3b71'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:15.279125 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-cbcc96e4-7a10-48a0-b816-f318c1fa3b71 admin admin] The token cache is being invalidate because project b86e869ee9404677ad2ec024eab2c81a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:34:15.279413 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-cbcc96e4-7a10-48a0-b816-f318c1fa3b71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:15.286488 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-cbcc96e4-7a10-48a0-b816-f318c1fa3b71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:15.286488 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 971/1942] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:34:14 2021] DELETE /identity/v3/projects/b86e869ee9404677ad2ec024eab2c81a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:15.289212 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbda18-ae07-4278-b6ad-2369ad5d2376 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:15.289747 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbda18-ae07-4278-b6ad-2369ad5d2376 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:15.290004 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbda18-ae07-4278-b6ad-2369ad5d2376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:15.309080 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-dbcbda18-ae07-4278-b6ad-2369ad5d2376 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:15.310412 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-dbcbda18-ae07-4278-b6ad-2369ad5d2376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:15.379454 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 972/1943] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:15.394508 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2d37f-c146-483b-9bac-c140e17ea4e4 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:15.394508 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2d37f-c146-483b-9bac-c140e17ea4e4 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:15.394508 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2d37f-c146-483b-9bac-c140e17ea4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:15.411249 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-8ef2d37f-c146-483b-9bac-c140e17ea4e4 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:15.413582 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-8ef2d37f-c146-483b-9bac-c140e17ea4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:15.426955 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 972/1944] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:15.431408 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbda18-ae07-4278-b6ad-2369ad5d2376 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:15.446538 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbda18-ae07-4278-b6ad-2369ad5d2376 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:15.470051 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bf38b-9472-4ee8-ada3-10a141c6d77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:15.470749 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bf38b-9472-4ee8-ada3-10a141c6d77b admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:15.471075 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bf38b-9472-4ee8-ada3-10a141c6d77b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:15.471739 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bf38b-9472-4ee8-ada3-10a141c6d77b admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:15.472057 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421bf38b-9472-4ee8-ada3-10a141c6d77b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:34:15.472366 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421bf38b-9472-4ee8-ada3-10a141c6d77b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:15.473980 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421bf38b-9472-4ee8-ada3-10a141c6d77b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:15.509692 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 973/1945] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:34:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:34:15.514713 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2d37f-c146-483b-9bac-c140e17ea4e4 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:15.528296 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2d37f-c146-483b-9bac-c140e17ea4e4 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:15.549780 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4b994-e0ca-40bb-b25f-2d8aac19240e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:15.549780 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4b994-e0ca-40bb-b25f-2d8aac19240e admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:15.549780 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4b994-e0ca-40bb-b25f-2d8aac19240e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:15.549780 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4b994-e0ca-40bb-b25f-2d8aac19240e admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:15.550950 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b4b994-e0ca-40bb-b25f-2d8aac19240e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:15.553519 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b4b994-e0ca-40bb-b25f-2d8aac19240e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:15.647929 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 973/1946] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:34:15 2021] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:15.652149 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bf38b-9472-4ee8-ada3-10a141c6d77b admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:15.668561 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bf38b-9472-4ee8-ada3-10a141c6d77b admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:15.743293 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd6a10-6ad3-4fc4-894d-849e72ba4ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:15.744234 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd6a10-6ad3-4fc4-894d-849e72ba4ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:15.744512 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd6a10-6ad3-4fc4-894d-849e72ba4ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:15.744779 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd6a10-6ad3-4fc4-894d-849e72ba4ad0 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:15.745528 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd6a10-6ad3-4fc4-894d-849e72ba4ad0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:15.747484 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd6a10-6ad3-4fc4-894d-849e72ba4ad0 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:15.823013 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 974/1947] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:34:15 2021] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:15.827458 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4b994-e0ca-40bb-b25f-2d8aac19240e admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:15.838961 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4b994-e0ca-40bb-b25f-2d8aac19240e admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:15.843667 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31f6e7-8959-42d3-9ab6-f1814b36c64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:15.844327 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31f6e7-8959-42d3-9ab6-f1814b36c64d admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:15.844612 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31f6e7-8959-42d3-9ab6-f1814b36c64d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:15.844890 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31f6e7-8959-42d3-9ab6-f1814b36c64d admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:15.845802 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31f6e7-8959-42d3-9ab6-f1814b36c64d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:15.847374 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31f6e7-8959-42d3-9ab6-f1814b36c64d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:15.861482 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 974/1948] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:15 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:15.862836 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd6a10-6ad3-4fc4-894d-849e72ba4ad0 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:15.873357 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd6a10-6ad3-4fc4-894d-849e72ba4ad0 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:15.878222 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfebeaa-45ab-4e80-87a2-426925166767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:15.878878 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfebeaa-45ab-4e80-87a2-426925166767 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:15.879162 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfebeaa-45ab-4e80-87a2-426925166767 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:15.879433 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfebeaa-45ab-4e80-87a2-426925166767 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:15.880160 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfebeaa-45ab-4e80-87a2-426925166767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:15.882221 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfebeaa-45ab-4e80-87a2-426925166767 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:15.900681 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 975/1949] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:15 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:15.902552 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31f6e7-8959-42d3-9ab6-f1814b36c64d admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:15.914366 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31f6e7-8959-42d3-9ab6-f1814b36c64d admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:15.919531 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c2cc3-42a5-412d-acde-13a51b15ea37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:15.920625 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c2cc3-42a5-412d-acde-13a51b15ea37 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:15.920998 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c2cc3-42a5-412d-acde-13a51b15ea37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:15.921345 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c2cc3-42a5-412d-acde-13a51b15ea37 admin admin] PATH_INFO: `/v3/projects/45afce4bbc5f4ec1adc958c9ae38812f/users/7636e6ab97ba401f8d1cc695b97f1775/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:15.940565 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c2cc3-42a5-412d-acde-13a51b15ea37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45afce4bbc5f4ec1adc958c9ae38812f, user_id=7636e6ab97ba401f8d1cc695b97f1775, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:15.943218 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c2cc3-42a5-412d-acde-13a51b15ea37 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:16.041111 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 975/1950] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:15 2021] PUT /identity/v3/projects/45afce4bbc5f4ec1adc958c9ae38812f/users/7636e6ab97ba401f8d1cc695b97f1775/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:16.052254 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a7938-8088-4736-8853-264dae8c6525 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:16.052726 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a7938-8088-4736-8853-264dae8c6525 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:16.053101 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a7938-8088-4736-8853-264dae8c6525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:16.086392 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-c18a7938-8088-4736-8853-264dae8c6525 None None] MFA Rules not processed for user `7636e6ab97ba401f8d1cc695b97f1775`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:16.087665 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-c18a7938-8088-4736-8853-264dae8c6525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:16.158583 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 976/1951] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:16 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:16.162991 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c2cc3-42a5-412d-acde-13a51b15ea37 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:16.222967 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c2cc3-42a5-412d-acde-13a51b15ea37 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:16.227782 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60277a-eca2-4bbb-9fbf-43debaeaa03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:16.228439 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60277a-eca2-4bbb-9fbf-43debaeaa03f admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:16.228723 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60277a-eca2-4bbb-9fbf-43debaeaa03f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:16.229000 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60277a-eca2-4bbb-9fbf-43debaeaa03f admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:16.229736 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a60277a-eca2-4bbb-9fbf-43debaeaa03f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:16.231609 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a60277a-eca2-4bbb-9fbf-43debaeaa03f admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:16.325491 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 976/1952] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:34:16 2021] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:16.326977 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a7938-8088-4736-8853-264dae8c6525 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:16.340849 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a7938-8088-4736-8853-264dae8c6525 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:16.398202 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ea72e-8cce-4e7e-adc8-dde10026a829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:16.398989 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ea72e-8cce-4e7e-adc8-dde10026a829 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:16.399270 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ea72e-8cce-4e7e-adc8-dde10026a829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:16.399548 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ea72e-8cce-4e7e-adc8-dde10026a829 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:16.400261 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ea72e-8cce-4e7e-adc8-dde10026a829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:16.402195 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ea72e-8cce-4e7e-adc8-dde10026a829 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:16.482066 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 977/1953] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:34:16 2021] POST /identity/v3/users => generated 298 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:16.485597 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60277a-eca2-4bbb-9fbf-43debaeaa03f admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:16.496073 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60277a-eca2-4bbb-9fbf-43debaeaa03f admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:16.500986 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48d6e8-7bd4-46e9-879b-3a2c5af1f509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:16.501685 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48d6e8-7bd4-46e9-879b-3a2c5af1f509 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:16.501971 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48d6e8-7bd4-46e9-879b-3a2c5af1f509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:16.502248 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48d6e8-7bd4-46e9-879b-3a2c5af1f509 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:16.502989 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48d6e8-7bd4-46e9-879b-3a2c5af1f509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:16.504567 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48d6e8-7bd4-46e9-879b-3a2c5af1f509 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:16.515802 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 977/1954] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:16 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:34:16.520245 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ea72e-8cce-4e7e-adc8-dde10026a829 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:16.530872 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ea72e-8cce-4e7e-adc8-dde10026a829 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:16.535814 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa9caf-03db-4e35-a2d9-84f8b3e6faae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:16.537152 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa9caf-03db-4e35-a2d9-84f8b3e6faae admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:16.537311 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa9caf-03db-4e35-a2d9-84f8b3e6faae admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:16.537670 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa9caf-03db-4e35-a2d9-84f8b3e6faae admin admin] PATH_INFO: `/v3/projects/ab26ce103b4c4d39bbb0f1cb7f8b1b36/users/0bae4a841118465c99522e78667f68e5/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:16.552272 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa9caf-03db-4e35-a2d9-84f8b3e6faae admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab26ce103b4c4d39bbb0f1cb7f8b1b36, user_id=0bae4a841118465c99522e78667f68e5, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:16.555397 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa9caf-03db-4e35-a2d9-84f8b3e6faae admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:16.610907 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 978/1955] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:16 2021] PUT /identity/v3/projects/ab26ce103b4c4d39bbb0f1cb7f8b1b36/users/0bae4a841118465c99522e78667f68e5/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:16.615713 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48d6e8-7bd4-46e9-879b-3a2c5af1f509 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:16.626515 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48d6e8-7bd4-46e9-879b-3a2c5af1f509 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:16.696734 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f56b8d-7759-48e8-ad3c-3e867dda24c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:16.697698 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f56b8d-7759-48e8-ad3c-3e867dda24c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:16.698275 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f56b8d-7759-48e8-ad3c-3e867dda24c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:16.699232 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f56b8d-7759-48e8-ad3c-3e867dda24c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:16.701220 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f56b8d-7759-48e8-ad3c-3e867dda24c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:16.703707 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f56b8d-7759-48e8-ad3c-3e867dda24c4 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:16.717481 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 978/1956] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:16 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:16.721790 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa9caf-03db-4e35-a2d9-84f8b3e6faae admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:16.733929 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa9caf-03db-4e35-a2d9-84f8b3e6faae admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:16.741316 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f830f5f-d484-416c-adf7-ada41ddc6d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:16.742563 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f830f5f-d484-416c-adf7-ada41ddc6d26 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:16.743063 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f830f5f-d484-416c-adf7-ada41ddc6d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:16.743550 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f830f5f-d484-416c-adf7-ada41ddc6d26 admin admin] PATH_INFO: `/v3/projects/ab26ce103b4c4d39bbb0f1cb7f8b1b36/users/0bae4a841118465c99522e78667f68e5/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:16.746144 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f830f5f-d484-416c-adf7-ada41ddc6d26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab26ce103b4c4d39bbb0f1cb7f8b1b36, user_id=0bae4a841118465c99522e78667f68e5, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:16.749301 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f830f5f-d484-416c-adf7-ada41ddc6d26 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:16.776623 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 979/1957] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:16 2021] PUT /identity/v3/projects/ab26ce103b4c4d39bbb0f1cb7f8b1b36/users/0bae4a841118465c99522e78667f68e5/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:16.782554 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbc6df-3ffc-4fa9-aa98-1630abccc5ea None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:16.782843 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbc6df-3ffc-4fa9-aa98-1630abccc5ea None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:16.783119 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbc6df-3ffc-4fa9-aa98-1630abccc5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:16.828772 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-8dcbc6df-3ffc-4fa9-aa98-1630abccc5ea None None] MFA Rules not processed for user `0bae4a841118465c99522e78667f68e5`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:16.830102 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-8dcbc6df-3ffc-4fa9-aa98-1630abccc5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:16.897587 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 979/1958] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:16 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:16.908069 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f830f5f-d484-416c-adf7-ada41ddc6d26 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:16.909809 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-9f830f5f-d484-416c-adf7-ada41ddc6d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:16.972562 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f830f5f-d484-416c-adf7-ada41ddc6d26 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:16.977006 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88403ba6-8a03-4a37-82dc-c3fc9693886f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:16.977700 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88403ba6-8a03-4a37-82dc-c3fc9693886f service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:16.977986 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88403ba6-8a03-4a37-82dc-c3fc9693886f service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:16.978262 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88403ba6-8a03-4a37-82dc-c3fc9693886f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:16.987457 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88403ba6-8a03-4a37-82dc-c3fc9693886f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:16.988856 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88403ba6-8a03-4a37-82dc-c3fc9693886f service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:16.998876 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 980/1959] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:16 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:34:17.163641 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbc6df-3ffc-4fa9-aa98-1630abccc5ea None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:17.174060 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbc6df-3ffc-4fa9-aa98-1630abccc5ea None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:17.178901 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bece88d-6f93-4162-a9c8-889ddf312d58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:17.182583 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bece88d-6f93-4162-a9c8-889ddf312d58 service cinder] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:17.182583 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bece88d-6f93-4162-a9c8-889ddf312d58 service cinder] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:17.182583 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bece88d-6f93-4162-a9c8-889ddf312d58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:17.216171 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88403ba6-8a03-4a37-82dc-c3fc9693886f service cinder] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:17.217591 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-88403ba6-8a03-4a37-82dc-c3fc9693886f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:17.243646 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bece88d-6f93-4162-a9c8-889ddf312d58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:17.245218 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bece88d-6f93-4162-a9c8-889ddf312d58 service cinder] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:17.259737 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 980/1960] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:17 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:34:17.310479 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88403ba6-8a03-4a37-82dc-c3fc9693886f service cinder] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:17.317677 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4454e-dba4-4ab3-9630-1282586c47c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:17.319999 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4454e-dba4-4ab3-9630-1282586c47c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:17.320380 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4454e-dba4-4ab3-9630-1282586c47c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:17.320760 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4454e-dba4-4ab3-9630-1282586c47c5 admin admin] PATH_INFO: `/v3/users/23d85a50876f4bf89793a5cf58ae3b22` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:17.322381 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4454e-dba4-4ab3-9630-1282586c47c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23d85a50876f4bf89793a5cf58ae3b22)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:17.324559 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4454e-dba4-4ab3-9630-1282586c47c5 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:17.510647 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-add4454e-dba4-4ab3-9630-1282586c47c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23d85a50876f4bf89793a5cf58ae3b22'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:17.511345 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-add4454e-dba4-4ab3-9630-1282586c47c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23d85a50876f4bf89793a5cf58ae3b22'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:17.582242 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-add4454e-dba4-4ab3-9630-1282586c47c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23d85a50876f4bf89793a5cf58ae3b22'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:17.583233 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-add4454e-dba4-4ab3-9630-1282586c47c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23d85a50876f4bf89793a5cf58ae3b22'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:17.601521 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-add4454e-dba4-4ab3-9630-1282586c47c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23d85a50876f4bf89793a5cf58ae3b22'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:17.613981 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 981/1961] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:34:17 2021] DELETE /identity/v3/users/23d85a50876f4bf89793a5cf58ae3b22 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:17.620411 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb3209-816d-4fbb-8494-259f4aba80fa None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:17.620761 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb3209-816d-4fbb-8494-259f4aba80fa None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:17.621042 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb3209-816d-4fbb-8494-259f4aba80fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:17.638495 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-2bfb3209-816d-4fbb-8494-259f4aba80fa None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:17.639704 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-2bfb3209-816d-4fbb-8494-259f4aba80fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:17.696174 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 981/1962] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:17.706913 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4454e-dba4-4ab3-9630-1282586c47c5 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:17.708469 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-add4454e-dba4-4ab3-9630-1282586c47c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:17.766815 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb3209-816d-4fbb-8494-259f4aba80fa None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:17.768147 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-2bfb3209-816d-4fbb-8494-259f4aba80fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:17.773810 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4454e-dba4-4ab3-9630-1282586c47c5 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:17.778288 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0385003-5f8d-4757-8195-f4077b81da2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:17.779276 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0385003-5f8d-4757-8195-f4077b81da2a service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:17.779582 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0385003-5f8d-4757-8195-f4077b81da2a service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:17.779852 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0385003-5f8d-4757-8195-f4077b81da2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:17.782041 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb3209-816d-4fbb-8494-259f4aba80fa None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:17.795296 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0385003-5f8d-4757-8195-f4077b81da2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:17.795410 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30605c07-ef12-4fc9-aca2-d4460f993949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:17.795537 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0385003-5f8d-4757-8195-f4077b81da2a service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:17.795632 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30605c07-ef12-4fc9-aca2-d4460f993949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:17.795632 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30605c07-ef12-4fc9-aca2-d4460f993949 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:17.795632 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30605c07-ef12-4fc9-aca2-d4460f993949 admin admin] PATH_INFO: `/v3/users/7636e6ab97ba401f8d1cc695b97f1775` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:17.796722 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30605c07-ef12-4fc9-aca2-d4460f993949 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7636e6ab97ba401f8d1cc695b97f1775)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:17.798592 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30605c07-ef12-4fc9-aca2-d4460f993949 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:17.809699 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 982/1963] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:34:17.932491 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-30605c07-ef12-4fc9-aca2-d4460f993949 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7636e6ab97ba401f8d1cc695b97f1775'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:17.933154 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-30605c07-ef12-4fc9-aca2-d4460f993949 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7636e6ab97ba401f8d1cc695b97f1775'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:17.940055 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-30605c07-ef12-4fc9-aca2-d4460f993949 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7636e6ab97ba401f8d1cc695b97f1775'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:17.943629 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-30605c07-ef12-4fc9-aca2-d4460f993949 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7636e6ab97ba401f8d1cc695b97f1775'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:17.953238 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-30605c07-ef12-4fc9-aca2-d4460f993949 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7636e6ab97ba401f8d1cc695b97f1775'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:18.012113 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 982/1964] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:34:17 2021] DELETE /identity/v3/users/7636e6ab97ba401f8d1cc695b97f1775 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:18.016793 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9a0a2-b802-4a6f-a081-a440de6d8b5c None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:18.017219 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9a0a2-b802-4a6f-a081-a440de6d8b5c None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:18.017553 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9a0a2-b802-4a6f-a081-a440de6d8b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:18.034846 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-2cf9a0a2-b802-4a6f-a081-a440de6d8b5c None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:18.036065 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-2cf9a0a2-b802-4a6f-a081-a440de6d8b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:18.093980 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 983/1965] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:18.104929 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30605c07-ef12-4fc9-aca2-d4460f993949 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:18.109463 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-30605c07-ef12-4fc9-aca2-d4460f993949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:18.161203 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9a0a2-b802-4a6f-a081-a440de6d8b5c None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:18.162780 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-2cf9a0a2-b802-4a6f-a081-a440de6d8b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:18.163694 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30605c07-ef12-4fc9-aca2-d4460f993949 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:18.172384 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03f5bc-d83b-4fc6-9fe8-e1e8539b07e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:18.172384 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03f5bc-d83b-4fc6-9fe8-e1e8539b07e5 service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:18.172384 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03f5bc-d83b-4fc6-9fe8-e1e8539b07e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:18.172751 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03f5bc-d83b-4fc6-9fe8-e1e8539b07e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:18.176792 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9a0a2-b802-4a6f-a081-a440de6d8b5c None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:18.183129 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f232ae-394b-4138-acb8-e61f8a58f6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:18.184011 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f232ae-394b-4138-acb8-e61f8a58f6cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:18.184349 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f232ae-394b-4138-acb8-e61f8a58f6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:18.184621 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f232ae-394b-4138-acb8-e61f8a58f6cb admin admin] PATH_INFO: `/v3/projects/cbf01f9dce2e4734b7cd7574cf1820ce` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:18.184998 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc03f5bc-d83b-4fc6-9fe8-e1e8539b07e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:18.185878 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f232ae-394b-4138-acb8-e61f8a58f6cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbf01f9dce2e4734b7cd7574cf1820ce)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:18.186696 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc03f5bc-d83b-4fc6-9fe8-e1e8539b07e5 service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:18.188085 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f232ae-394b-4138-acb8-e61f8a58f6cb admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:18.200758 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 983/1966] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:34:18.273325 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-f3f232ae-394b-4138-acb8-e61f8a58f6cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbf01f9dce2e4734b7cd7574cf1820ce', 'request_id': 'req-f3f232ae-394b-4138-acb8-e61f8a58f6cb'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:18.278600 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-f3f232ae-394b-4138-acb8-e61f8a58f6cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbf01f9dce2e4734b7cd7574cf1820ce', 'request_id': 'req-f3f232ae-394b-4138-acb8-e61f8a58f6cb'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:18.284618 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-f3f232ae-394b-4138-acb8-e61f8a58f6cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbf01f9dce2e4734b7cd7574cf1820ce', 'request_id': 'req-f3f232ae-394b-4138-acb8-e61f8a58f6cb'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:18.382371 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-f3f232ae-394b-4138-acb8-e61f8a58f6cb admin admin] The token cache is being invalidate because project cbf01f9dce2e4734b7cd7574cf1820ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:34:18.384272 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-f3f232ae-394b-4138-acb8-e61f8a58f6cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:18.384272 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-f3f232ae-394b-4138-acb8-e61f8a58f6cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:18.385045 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 984/1967] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:34:18 2021] DELETE /identity/v3/projects/cbf01f9dce2e4734b7cd7574cf1820ce => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:18.389851 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03f5bc-d83b-4fc6-9fe8-e1e8539b07e5 service neutron] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:18.399485 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03f5bc-d83b-4fc6-9fe8-e1e8539b07e5 service neutron] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:18.464504 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163f2c7-71a9-43bf-841a-9f042644ccdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:18.465555 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163f2c7-71a9-43bf-841a-9f042644ccdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:18.465994 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163f2c7-71a9-43bf-841a-9f042644ccdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:18.466376 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163f2c7-71a9-43bf-841a-9f042644ccdf admin admin] PATH_INFO: `/v3/users/6ca9f9e43b0e44bfa9a8081c2e56f92b` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:18.467761 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8163f2c7-71a9-43bf-841a-9f042644ccdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ca9f9e43b0e44bfa9a8081c2e56f92b)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:18.469796 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8163f2c7-71a9-43bf-841a-9f042644ccdf admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:18.601449 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f232ae-394b-4138-acb8-e61f8a58f6cb admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:18.609740 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-f3f232ae-394b-4138-acb8-e61f8a58f6cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:18.617628 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f232ae-394b-4138-acb8-e61f8a58f6cb admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:18.622526 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece6ced-c553-43b3-ab1c-cfcea8c4add0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:18.623608 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece6ced-c553-43b3-ab1c-cfcea8c4add0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:18.623903 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece6ced-c553-43b3-ab1c-cfcea8c4add0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:18.624351 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece6ced-c553-43b3-ab1c-cfcea8c4add0 admin admin] PATH_INFO: `/v3/projects/45afce4bbc5f4ec1adc958c9ae38812f` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:18.638457 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece6ced-c553-43b3-ab1c-cfcea8c4add0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45afce4bbc5f4ec1adc958c9ae38812f)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:18.640552 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece6ced-c553-43b3-ab1c-cfcea8c4add0 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:18.675797 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-8163f2c7-71a9-43bf-841a-9f042644ccdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ca9f9e43b0e44bfa9a8081c2e56f92b'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:18.678485 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-8163f2c7-71a9-43bf-841a-9f042644ccdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ca9f9e43b0e44bfa9a8081c2e56f92b'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:18.683943 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-8163f2c7-71a9-43bf-841a-9f042644ccdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ca9f9e43b0e44bfa9a8081c2e56f92b'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:18.684576 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-8163f2c7-71a9-43bf-841a-9f042644ccdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ca9f9e43b0e44bfa9a8081c2e56f92b'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:18.696148 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-8163f2c7-71a9-43bf-841a-9f042644ccdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ca9f9e43b0e44bfa9a8081c2e56f92b'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:18.736212 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-7ece6ced-c553-43b3-ab1c-cfcea8c4add0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45afce4bbc5f4ec1adc958c9ae38812f', 'request_id': 'req-7ece6ced-c553-43b3-ab1c-cfcea8c4add0'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:18.744127 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-7ece6ced-c553-43b3-ab1c-cfcea8c4add0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45afce4bbc5f4ec1adc958c9ae38812f', 'request_id': 'req-7ece6ced-c553-43b3-ab1c-cfcea8c4add0'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:18.751198 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-7ece6ced-c553-43b3-ab1c-cfcea8c4add0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45afce4bbc5f4ec1adc958c9ae38812f', 'request_id': 'req-7ece6ced-c553-43b3-ab1c-cfcea8c4add0'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:18.782774 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 984/1968] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:34:18 2021] DELETE /identity/v3/users/6ca9f9e43b0e44bfa9a8081c2e56f92b => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:18.840528 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-7ece6ced-c553-43b3-ab1c-cfcea8c4add0 admin admin] The token cache is being invalidate because project 45afce4bbc5f4ec1adc958c9ae38812f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:34:18.840916 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-7ece6ced-c553-43b3-ab1c-cfcea8c4add0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:18.841703 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-7ece6ced-c553-43b3-ab1c-cfcea8c4add0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:18.843259 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 985/1969] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:34:18 2021] DELETE /identity/v3/projects/45afce4bbc5f4ec1adc958c9ae38812f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:18.847121 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163f2c7-71a9-43bf-841a-9f042644ccdf admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:18.848526 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-8163f2c7-71a9-43bf-841a-9f042644ccdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:18.916872 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163f2c7-71a9-43bf-841a-9f042644ccdf admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:18.922434 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4a556-2754-443e-842e-fcf70244d46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:18.923307 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4a556-2754-443e-842e-fcf70244d46c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:18.923956 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4a556-2754-443e-842e-fcf70244d46c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:18.923956 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4a556-2754-443e-842e-fcf70244d46c admin admin] PATH_INFO: `/v3/users/0bae4a841118465c99522e78667f68e5` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:18.925338 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4a556-2754-443e-842e-fcf70244d46c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bae4a841118465c99522e78667f68e5)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:18.977531 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4a556-2754-443e-842e-fcf70244d46c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:19.141026 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-f4a4a556-2754-443e-842e-fcf70244d46c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bae4a841118465c99522e78667f68e5'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:19.143929 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-f4a4a556-2754-443e-842e-fcf70244d46c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bae4a841118465c99522e78667f68e5'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:19.152272 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-f4a4a556-2754-443e-842e-fcf70244d46c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bae4a841118465c99522e78667f68e5'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:19.153021 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-f4a4a556-2754-443e-842e-fcf70244d46c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bae4a841118465c99522e78667f68e5'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:19.169170 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-f4a4a556-2754-443e-842e-fcf70244d46c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bae4a841118465c99522e78667f68e5'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:19.202304 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece6ced-c553-43b3-ab1c-cfcea8c4add0 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:19.203738 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-7ece6ced-c553-43b3-ab1c-cfcea8c4add0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:19.230035 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 985/1970] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:34:18 2021] DELETE /identity/v3/users/0bae4a841118465c99522e78667f68e5 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:19.283179 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece6ced-c553-43b3-ab1c-cfcea8c4add0 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:19.342216 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2be9f1-8658-45a7-a4f1-d50570de285f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:19.342998 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2be9f1-8658-45a7-a4f1-d50570de285f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:19.343277 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2be9f1-8658-45a7-a4f1-d50570de285f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:19.343547 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2be9f1-8658-45a7-a4f1-d50570de285f admin admin] PATH_INFO: `/v3/projects/323ba636e6174e7bba3fbb1c5c8219f2` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:19.344753 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2be9f1-8658-45a7-a4f1-d50570de285f admin admin] RBAC: Authorizing `identity:delete_project(project_id=323ba636e6174e7bba3fbb1c5c8219f2)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:19.346758 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2be9f1-8658-45a7-a4f1-d50570de285f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:19.450765 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-3f2be9f1-8658-45a7-a4f1-d50570de285f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '323ba636e6174e7bba3fbb1c5c8219f2', 'request_id': 'req-3f2be9f1-8658-45a7-a4f1-d50570de285f'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:19.455902 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-3f2be9f1-8658-45a7-a4f1-d50570de285f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '323ba636e6174e7bba3fbb1c5c8219f2', 'request_id': 'req-3f2be9f1-8658-45a7-a4f1-d50570de285f'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:19.462344 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-3f2be9f1-8658-45a7-a4f1-d50570de285f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '323ba636e6174e7bba3fbb1c5c8219f2', 'request_id': 'req-3f2be9f1-8658-45a7-a4f1-d50570de285f'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:19.559101 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-3f2be9f1-8658-45a7-a4f1-d50570de285f admin admin] The token cache is being invalidate because project 323ba636e6174e7bba3fbb1c5c8219f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:34:19.559391 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-3f2be9f1-8658-45a7-a4f1-d50570de285f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:19.560027 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-3f2be9f1-8658-45a7-a4f1-d50570de285f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:19.565781 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 986/1971] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:34:19 2021] DELETE /identity/v3/projects/323ba636e6174e7bba3fbb1c5c8219f2 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:19.567678 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06262f3c-79c4-42dc-9fc2-5735c95b37ca None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:19.568030 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06262f3c-79c4-42dc-9fc2-5735c95b37ca None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:19.568339 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06262f3c-79c4-42dc-9fc2-5735c95b37ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:19.587339 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-06262f3c-79c4-42dc-9fc2-5735c95b37ca None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:19.588643 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-06262f3c-79c4-42dc-9fc2-5735c95b37ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:19.662883 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 986/1972] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:19.670241 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f70012-abbd-474a-aeab-560f5a4cd9cb None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:19.670738 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f70012-abbd-474a-aeab-560f5a4cd9cb None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:19.670838 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f70012-abbd-474a-aeab-560f5a4cd9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:19.689902 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-12f70012-abbd-474a-aeab-560f5a4cd9cb None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:19.691387 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-12f70012-abbd-474a-aeab-560f5a4cd9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:19.700430 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 987/1973] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:19.704492 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06262f3c-79c4-42dc-9fc2-5735c95b37ca None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:19.715015 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06262f3c-79c4-42dc-9fc2-5735c95b37ca None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:19.720063 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8687770-1d3f-4d7a-82ea-e67051df8173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:19.720710 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8687770-1d3f-4d7a-82ea-e67051df8173 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:19.720997 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8687770-1d3f-4d7a-82ea-e67051df8173 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:19.721274 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8687770-1d3f-4d7a-82ea-e67051df8173 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:19.722046 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8687770-1d3f-4d7a-82ea-e67051df8173 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:34:19.722361 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8687770-1d3f-4d7a-82ea-e67051df8173 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:19.723947 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8687770-1d3f-4d7a-82ea-e67051df8173 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:19.736629 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 987/1974] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:34:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:34:19.741097 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f70012-abbd-474a-aeab-560f5a4cd9cb None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:19.750160 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f70012-abbd-474a-aeab-560f5a4cd9cb None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:19.754924 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2140b-ce4f-4ef9-a31a-09e5270e32e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:19.755654 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2140b-ce4f-4ef9-a31a-09e5270e32e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:19.755933 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2140b-ce4f-4ef9-a31a-09e5270e32e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:19.756204 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2140b-ce4f-4ef9-a31a-09e5270e32e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:19.756906 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2140b-ce4f-4ef9-a31a-09e5270e32e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:19.758837 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2140b-ce4f-4ef9-a31a-09e5270e32e4 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:19.790098 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8687770-1d3f-4d7a-82ea-e67051df8173 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:19.791812 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-b8687770-1d3f-4d7a-82ea-e67051df8173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:19.823958 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8687770-1d3f-4d7a-82ea-e67051df8173 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:19.829567 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883a17c-2b8d-4ae9-b27e-f7ed047a8584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:19.830618 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883a17c-2b8d-4ae9-b27e-f7ed047a8584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:19.830903 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883a17c-2b8d-4ae9-b27e-f7ed047a8584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:19.831205 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883a17c-2b8d-4ae9-b27e-f7ed047a8584 admin admin] PATH_INFO: `/v3/projects/ab26ce103b4c4d39bbb0f1cb7f8b1b36` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:19.832695 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883a17c-2b8d-4ae9-b27e-f7ed047a8584 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab26ce103b4c4d39bbb0f1cb7f8b1b36)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:19.836177 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883a17c-2b8d-4ae9-b27e-f7ed047a8584 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:19.843177 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 988/1975] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:34:19 2021] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:19.856079 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2140b-ce4f-4ef9-a31a-09e5270e32e4 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:19.918225 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2140b-ce4f-4ef9-a31a-09e5270e32e4 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:19.923166 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8723eae-ae94-4a0c-86ec-98a755cc0c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:19.923911 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8723eae-ae94-4a0c-86ec-98a755cc0c09 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:19.924309 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8723eae-ae94-4a0c-86ec-98a755cc0c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:19.924609 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8723eae-ae94-4a0c-86ec-98a755cc0c09 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:19.925441 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8723eae-ae94-4a0c-86ec-98a755cc0c09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:19.927468 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8723eae-ae94-4a0c-86ec-98a755cc0c09 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:19.942908 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-9883a17c-2b8d-4ae9-b27e-f7ed047a8584 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab26ce103b4c4d39bbb0f1cb7f8b1b36', 'request_id': 'req-9883a17c-2b8d-4ae9-b27e-f7ed047a8584'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:19.950703 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-9883a17c-2b8d-4ae9-b27e-f7ed047a8584 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab26ce103b4c4d39bbb0f1cb7f8b1b36', 'request_id': 'req-9883a17c-2b8d-4ae9-b27e-f7ed047a8584'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:19.956332 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-9883a17c-2b8d-4ae9-b27e-f7ed047a8584 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab26ce103b4c4d39bbb0f1cb7f8b1b36', 'request_id': 'req-9883a17c-2b8d-4ae9-b27e-f7ed047a8584'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:20.011293 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 989/1976] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:34:19 2021] POST /identity/v3/users => generated 294 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:20.015375 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8723eae-ae94-4a0c-86ec-98a755cc0c09 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:20.025483 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8723eae-ae94-4a0c-86ec-98a755cc0c09 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:20.032882 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-9883a17c-2b8d-4ae9-b27e-f7ed047a8584 admin admin] The token cache is being invalidate because project ab26ce103b4c4d39bbb0f1cb7f8b1b36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:34:20.036497 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-9883a17c-2b8d-4ae9-b27e-f7ed047a8584 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:20.036497 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-9883a17c-2b8d-4ae9-b27e-f7ed047a8584 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:20.036497 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 988/1977] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:34:19 2021] DELETE /identity/v3/projects/ab26ce103b4c4d39bbb0f1cb7f8b1b36 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:20.040985 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071b8d8-0c59-46db-92d5-fbc4d3a40204 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:20.041390 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071b8d8-0c59-46db-92d5-fbc4d3a40204 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:20.041692 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071b8d8-0c59-46db-92d5-fbc4d3a40204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:20.058785 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-1071b8d8-0c59-46db-92d5-fbc4d3a40204 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:20.059981 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-1071b8d8-0c59-46db-92d5-fbc4d3a40204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:20.081194 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91de5ce-2b2f-4ede-905c-1d98adc2f059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:20.081915 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91de5ce-2b2f-4ede-905c-1d98adc2f059 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:20.082218 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91de5ce-2b2f-4ede-905c-1d98adc2f059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:20.082498 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91de5ce-2b2f-4ede-905c-1d98adc2f059 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:20.083240 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91de5ce-2b2f-4ede-905c-1d98adc2f059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:20.085684 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91de5ce-2b2f-4ede-905c-1d98adc2f059 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:20.095490 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 990/1978] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:20 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:34:20.099737 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91de5ce-2b2f-4ede-905c-1d98adc2f059 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:20.101501 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-f91de5ce-2b2f-4ede-905c-1d98adc2f059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:20.113371 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91de5ce-2b2f-4ede-905c-1d98adc2f059 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:20.117150 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 989/1979] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:34:20.121276 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8967b29-a8e2-43d3-a79b-e3b87ea6b8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:20.122009 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8967b29-a8e2-43d3-a79b-e3b87ea6b8ce admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:20.122311 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8967b29-a8e2-43d3-a79b-e3b87ea6b8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:20.122588 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8967b29-a8e2-43d3-a79b-e3b87ea6b8ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:20.123317 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8967b29-a8e2-43d3-a79b-e3b87ea6b8ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:20.124923 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8967b29-a8e2-43d3-a79b-e3b87ea6b8ce admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:20.125981 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2bcc6a-1e6c-437b-b9bc-22d6fc9b9efd None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:20.126275 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2bcc6a-1e6c-437b-b9bc-22d6fc9b9efd None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:20.126556 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2bcc6a-1e6c-437b-b9bc-22d6fc9b9efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:20.135440 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 991/1980] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:20 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:34:20.139696 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8967b29-a8e2-43d3-a79b-e3b87ea6b8ce admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:20.148044 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-4e2bcc6a-1e6c-437b-b9bc-22d6fc9b9efd None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:20.149254 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-4e2bcc6a-1e6c-437b-b9bc-22d6fc9b9efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:20.150519 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8967b29-a8e2-43d3-a79b-e3b87ea6b8ce admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:20.155431 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e346a69-7386-49dd-8cbd-6911b185baee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:20.156301 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e346a69-7386-49dd-8cbd-6911b185baee admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:20.156582 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e346a69-7386-49dd-8cbd-6911b185baee admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:20.156857 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e346a69-7386-49dd-8cbd-6911b185baee admin admin] PATH_INFO: `/v3/projects/ad8610e84f554da7913c01b5c3d2daaa/users/9a980b4256e54ebaa6c7666b1318e89c/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:20.160901 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 990/1981] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:34:20.161750 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2bcc6a-1e6c-437b-b9bc-22d6fc9b9efd None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:20.171009 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2bcc6a-1e6c-437b-b9bc-22d6fc9b9efd None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:20.172255 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e346a69-7386-49dd-8cbd-6911b185baee admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad8610e84f554da7913c01b5c3d2daaa, user_id=9a980b4256e54ebaa6c7666b1318e89c, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:20.174879 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e346a69-7386-49dd-8cbd-6911b185baee admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:20.175767 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ee266-5601-4ebb-9ec1-83d931168c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:20.176416 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ee266-5601-4ebb-9ec1-83d931168c84 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:20.176703 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ee266-5601-4ebb-9ec1-83d931168c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:20.176989 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ee266-5601-4ebb-9ec1-83d931168c84 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:20.177862 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ee266-5601-4ebb-9ec1-83d931168c84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:34:20.178141 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ee266-5601-4ebb-9ec1-83d931168c84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:20.179710 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ee266-5601-4ebb-9ec1-83d931168c84 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:20.191432 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 991/1982] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:34:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:34:20.196657 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ee266-5601-4ebb-9ec1-83d931168c84 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:20.206007 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ee266-5601-4ebb-9ec1-83d931168c84 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:20.211338 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e2b9f-8e8d-42a7-b8b9-b5c18562da02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:20.211944 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e2b9f-8e8d-42a7-b8b9-b5c18562da02 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:20.212222 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e2b9f-8e8d-42a7-b8b9-b5c18562da02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:20.212493 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e2b9f-8e8d-42a7-b8b9-b5c18562da02 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:20.213182 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e2b9f-8e8d-42a7-b8b9-b5c18562da02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:20.215027 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e2b9f-8e8d-42a7-b8b9-b5c18562da02 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:20.285758 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 992/1983] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:20 2021] PUT /identity/v3/projects/ad8610e84f554da7913c01b5c3d2daaa/users/9a980b4256e54ebaa6c7666b1318e89c/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:20.296352 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc13cf-e0f0-4ddf-9716-c84260aa8ef0 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:20.296639 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc13cf-e0f0-4ddf-9716-c84260aa8ef0 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:20.297011 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc13cf-e0f0-4ddf-9716-c84260aa8ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:20.308704 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 992/1984] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:34:20 2021] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:20.309849 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e2b9f-8e8d-42a7-b8b9-b5c18562da02 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:20.336557 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-c9cc13cf-e0f0-4ddf-9716-c84260aa8ef0 None None] MFA Rules not processed for user `9a980b4256e54ebaa6c7666b1318e89c`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:20.337799 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-c9cc13cf-e0f0-4ddf-9716-c84260aa8ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:20.374290 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e2b9f-8e8d-42a7-b8b9-b5c18562da02 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:20.378990 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6846fa-4f64-4b51-836f-78be176bf1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:20.379834 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6846fa-4f64-4b51-836f-78be176bf1bf admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:20.380444 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6846fa-4f64-4b51-836f-78be176bf1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:20.381462 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6846fa-4f64-4b51-836f-78be176bf1bf admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:20.382358 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6846fa-4f64-4b51-836f-78be176bf1bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:20.384771 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6846fa-4f64-4b51-836f-78be176bf1bf admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:20.408603 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 993/1985] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:20 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:34:20.411488 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc13cf-e0f0-4ddf-9716-c84260aa8ef0 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:20.421801 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc13cf-e0f0-4ddf-9716-c84260aa8ef0 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:20.426417 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f19c8c-42e1-4014-91f6-93b6e905b74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:20.427059 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f19c8c-42e1-4014-91f6-93b6e905b74f admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:20.427857 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f19c8c-42e1-4014-91f6-93b6e905b74f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:20.428638 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f19c8c-42e1-4014-91f6-93b6e905b74f admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:20.429345 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f19c8c-42e1-4014-91f6-93b6e905b74f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:20.431247 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f19c8c-42e1-4014-91f6-93b6e905b74f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:20.500388 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 993/1986] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:34:20 2021] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:20.501815 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6846fa-4f64-4b51-836f-78be176bf1bf admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:20.512161 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6846fa-4f64-4b51-836f-78be176bf1bf admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:20.516869 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51322754-54fe-43cc-afee-a1bae7f62f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:20.517546 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51322754-54fe-43cc-afee-a1bae7f62f4d admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:20.517827 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51322754-54fe-43cc-afee-a1bae7f62f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:20.518100 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51322754-54fe-43cc-afee-a1bae7f62f4d admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:20.518830 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51322754-54fe-43cc-afee-a1bae7f62f4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:20.520493 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51322754-54fe-43cc-afee-a1bae7f62f4d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:20.530506 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 994/1987] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:20 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:34:20.534352 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51322754-54fe-43cc-afee-a1bae7f62f4d admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:20.544440 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51322754-54fe-43cc-afee-a1bae7f62f4d admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:20.551311 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ecefd4-f73c-4b85-ae84-5b40d54805b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:20.553050 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecefd4-f73c-4b85-ae84-5b40d54805b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:20.553376 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecefd4-f73c-4b85-ae84-5b40d54805b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:20.553791 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecefd4-f73c-4b85-ae84-5b40d54805b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:20.554748 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ecefd4-f73c-4b85-ae84-5b40d54805b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:20.556449 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 994/1988] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:34:20 2021] POST /identity/v3/projects => generated 389 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:34:20.559670 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ecefd4-f73c-4b85-ae84-5b40d54805b6 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:20.560508 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f19c8c-42e1-4014-91f6-93b6e905b74f admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:20.572155 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 995/1989] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:20 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:34:20.578449 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ecefd4-f73c-4b85-ae84-5b40d54805b6 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:20.589495 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ecefd4-f73c-4b85-ae84-5b40d54805b6 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:20.627180 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f19c8c-42e1-4014-91f6-93b6e905b74f admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:20.632634 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bea76-1ace-4daf-8ae3-46b37c6c5d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:20.633325 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bea76-1ace-4daf-8ae3-46b37c6c5d89 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:20.633646 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bea76-1ace-4daf-8ae3-46b37c6c5d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:20.633915 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bea76-1ace-4daf-8ae3-46b37c6c5d89 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:20.634612 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72bea76-1ace-4daf-8ae3-46b37c6c5d89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:20.636485 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72bea76-1ace-4daf-8ae3-46b37c6c5d89 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:20.646956 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6acb27-bc01-467e-9c57-6126bf276bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:20.647854 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6acb27-bc01-467e-9c57-6126bf276bab admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:20.648134 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6acb27-bc01-467e-9c57-6126bf276bab admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:20.648407 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6acb27-bc01-467e-9c57-6126bf276bab admin admin] PATH_INFO: `/v3/projects/11b44d27020442f1a83627c7c46cce22/users/c0882b11fb2f468395c2157f4eb2451b/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:20.663310 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6acb27-bc01-467e-9c57-6126bf276bab admin admin] RBAC: Authorizing `identity:create_grant(project_id=11b44d27020442f1a83627c7c46cce22, user_id=c0882b11fb2f468395c2157f4eb2451b, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:20.666185 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6acb27-bc01-467e-9c57-6126bf276bab admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:20.725692 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 995/1990] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:34:20 2021] POST /identity/v3/users => generated 301 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:20.729623 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bea76-1ace-4daf-8ae3-46b37c6c5d89 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:20.740577 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bea76-1ace-4daf-8ae3-46b37c6c5d89 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:20.743578 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 996/1991] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:20 2021] PUT /identity/v3/projects/11b44d27020442f1a83627c7c46cce22/users/c0882b11fb2f468395c2157f4eb2451b/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:20.753252 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb335f0-2a98-41fc-aa45-84a308c4e4c3 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:20.753577 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb335f0-2a98-41fc-aa45-84a308c4e4c3 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:20.753849 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb335f0-2a98-41fc-aa45-84a308c4e4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:20.770712 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-acb335f0-2a98-41fc-aa45-84a308c4e4c3 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:20.771991 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-acb335f0-2a98-41fc-aa45-84a308c4e4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:20.808858 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633363e-6cec-4459-a7c5-1007694f4632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:20.810669 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633363e-6cec-4459-a7c5-1007694f4632 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:20.810669 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633363e-6cec-4459-a7c5-1007694f4632 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:20.811169 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633363e-6cec-4459-a7c5-1007694f4632 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:20.811998 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633363e-6cec-4459-a7c5-1007694f4632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:20.813945 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633363e-6cec-4459-a7c5-1007694f4632 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:20.835309 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 996/1992] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:20 2021] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:34:20.839164 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633363e-6cec-4459-a7c5-1007694f4632 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:20.844094 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 997/1993] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:34:20.853220 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633363e-6cec-4459-a7c5-1007694f4632 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:20.855547 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb335f0-2a98-41fc-aa45-84a308c4e4c3 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:20.857073 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-acb335f0-2a98-41fc-aa45-84a308c4e4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:20.868557 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02537cf7-26ce-4a64-b46a-ffa892e1aa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:20.869708 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02537cf7-26ce-4a64-b46a-ffa892e1aa8d admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:20.871925 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02537cf7-26ce-4a64-b46a-ffa892e1aa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:20.871925 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02537cf7-26ce-4a64-b46a-ffa892e1aa8d admin admin] PATH_INFO: `/v3/projects/7ec7ed9c11634959a176e9dfa16aaa31/users/611119fb9cd74d848e1aef7648e20b6e/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:20.886970 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02537cf7-26ce-4a64-b46a-ffa892e1aa8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec7ed9c11634959a176e9dfa16aaa31, user_id=611119fb9cd74d848e1aef7648e20b6e, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:20.889596 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02537cf7-26ce-4a64-b46a-ffa892e1aa8d admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:20.938889 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb335f0-2a98-41fc-aa45-84a308c4e4c3 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:20.942616 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf39742-6aff-4bdb-bb6d-fbd01317a351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:20.943295 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf39742-6aff-4bdb-bb6d-fbd01317a351 service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:20.943630 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf39742-6aff-4bdb-bb6d-fbd01317a351 service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:20.943915 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf39742-6aff-4bdb-bb6d-fbd01317a351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:20.954031 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf39742-6aff-4bdb-bb6d-fbd01317a351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:20.955472 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf39742-6aff-4bdb-bb6d-fbd01317a351 service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:20.966785 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 998/1994] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:34:20.970600 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 997/1995] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:20 2021] PUT /identity/v3/projects/7ec7ed9c11634959a176e9dfa16aaa31/users/611119fb9cd74d848e1aef7648e20b6e/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:20.975075 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf39742-6aff-4bdb-bb6d-fbd01317a351 service neutron] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:20.985288 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf39742-6aff-4bdb-bb6d-fbd01317a351 service neutron] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:21.043413 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe4f8a-f2ed-4bf4-8616-dd615f211e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:21.044085 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe4f8a-f2ed-4bf4-8616-dd615f211e1f admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:21.044365 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe4f8a-f2ed-4bf4-8616-dd615f211e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:21.044638 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe4f8a-f2ed-4bf4-8616-dd615f211e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:21.045454 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe4f8a-f2ed-4bf4-8616-dd615f211e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:21.047029 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe4f8a-f2ed-4bf4-8616-dd615f211e1f admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:21.061883 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 999/1996] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:20 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:21.066307 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02537cf7-26ce-4a64-b46a-ffa892e1aa8d admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:21.074843 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02537cf7-26ce-4a64-b46a-ffa892e1aa8d admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:21.080298 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f478a-bce8-4b38-be27-7d691ed99e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:21.081305 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f478a-bce8-4b38-be27-7d691ed99e72 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:21.081716 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f478a-bce8-4b38-be27-7d691ed99e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:21.082332 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f478a-bce8-4b38-be27-7d691ed99e72 admin admin] PATH_INFO: `/v3/projects/7ec7ed9c11634959a176e9dfa16aaa31/users/611119fb9cd74d848e1aef7648e20b6e/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:21.086413 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f478a-bce8-4b38-be27-7d691ed99e72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec7ed9c11634959a176e9dfa16aaa31, user_id=611119fb9cd74d848e1aef7648e20b6e, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:21.089663 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f478a-bce8-4b38-be27-7d691ed99e72 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:21.107484 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 998/1997] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:21 2021] PUT /identity/v3/projects/7ec7ed9c11634959a176e9dfa16aaa31/users/611119fb9cd74d848e1aef7648e20b6e/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:21.117634 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a729c-0864-4092-a22f-123c253e3c36 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:21.118041 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a729c-0864-4092-a22f-123c253e3c36 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:21.118383 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a729c-0864-4092-a22f-123c253e3c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:21.146784 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-835a729c-0864-4092-a22f-123c253e3c36 None None] MFA Rules not processed for user `611119fb9cd74d848e1aef7648e20b6e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:21.147874 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-835a729c-0864-4092-a22f-123c253e3c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:21.222897 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1000/1998] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:21 2021] POST /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:21.233473 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f478a-bce8-4b38-be27-7d691ed99e72 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:21.235151 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-d85f478a-bce8-4b38-be27-7d691ed99e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:21.294589 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f478a-bce8-4b38-be27-7d691ed99e72 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:21.303183 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbf5a7-d667-4f67-826a-a497c242e5ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:21.303183 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbf5a7-d667-4f67-826a-a497c242e5ae service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:21.303183 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbf5a7-d667-4f67-826a-a497c242e5ae service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:21.303443 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbf5a7-d667-4f67-826a-a497c242e5ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:21.312986 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fbf5a7-d667-4f67-826a-a497c242e5ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:21.314492 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fbf5a7-d667-4f67-826a-a497c242e5ae service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:21.324434 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 999/1999] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:21 2021] GET /identity/v3/auth/tokens => generated 3323 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:34:21.454374 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a729c-0864-4092-a22f-123c253e3c36 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:21.524099 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a729c-0864-4092-a22f-123c253e3c36 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:21.537014 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a7159-bb2a-442e-a0df-3cae407b3743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:21.537014 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a7159-bb2a-442e-a0df-3cae407b3743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:21.537014 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a7159-bb2a-442e-a0df-3cae407b3743 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:21.537014 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a7159-bb2a-442e-a0df-3cae407b3743 admin admin] PATH_INFO: `/v3/users/9a980b4256e54ebaa6c7666b1318e89c` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:21.537332 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a7159-bb2a-442e-a0df-3cae407b3743 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a980b4256e54ebaa6c7666b1318e89c)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:21.537332 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a7159-bb2a-442e-a0df-3cae407b3743 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:21.682173 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-4d6a7159-bb2a-442e-a0df-3cae407b3743 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a980b4256e54ebaa6c7666b1318e89c'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:21.682763 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-4d6a7159-bb2a-442e-a0df-3cae407b3743 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a980b4256e54ebaa6c7666b1318e89c'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:21.689451 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-4d6a7159-bb2a-442e-a0df-3cae407b3743 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a980b4256e54ebaa6c7666b1318e89c'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:21.690151 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-4d6a7159-bb2a-442e-a0df-3cae407b3743 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a980b4256e54ebaa6c7666b1318e89c'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:21.703415 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-4d6a7159-bb2a-442e-a0df-3cae407b3743 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a980b4256e54ebaa6c7666b1318e89c'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:21.793630 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1001/2000] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:34:21 2021] DELETE /identity/v3/users/9a980b4256e54ebaa6c7666b1318e89c => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:21.798247 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c4858-86cd-43d6-8b36-f11e73688ec6 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:21.798707 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c4858-86cd-43d6-8b36-f11e73688ec6 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:21.798948 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c4858-86cd-43d6-8b36-f11e73688ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:21.817563 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-473c4858-86cd-43d6-8b36-f11e73688ec6 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:21.819563 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-473c4858-86cd-43d6-8b36-f11e73688ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:21.878930 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1000/2001] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:21.889859 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a7159-bb2a-442e-a0df-3cae407b3743 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:21.891291 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-4d6a7159-bb2a-442e-a0df-3cae407b3743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:21.963353 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a7159-bb2a-442e-a0df-3cae407b3743 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:21.967062 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c2fef-c43e-473c-83b1-8da6a0d866e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:21.967707 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c2fef-c43e-473c-83b1-8da6a0d866e5 service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:21.967995 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c2fef-c43e-473c-83b1-8da6a0d866e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:21.968269 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c2fef-c43e-473c-83b1-8da6a0d866e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:21.979520 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c2fef-c43e-473c-83b1-8da6a0d866e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:21.979520 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c2fef-c43e-473c-83b1-8da6a0d866e5 service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:21.988739 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1002/2002] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:34:22.161107 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb85463-5150-41a6-a2c4-37a1bf360602 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:22.161660 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb85463-5150-41a6-a2c4-37a1bf360602 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:22.162684 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb85463-5150-41a6-a2c4-37a1bf360602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:22.202678 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-5bb85463-5150-41a6-a2c4-37a1bf360602 None None] MFA Rules not processed for user `c0882b11fb2f468395c2157f4eb2451b`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:22.203961 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-5bb85463-5150-41a6-a2c4-37a1bf360602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:22.285941 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1001/2003] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:22 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:22.293720 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c2fef-c43e-473c-83b1-8da6a0d866e5 service neutron] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:22.299488 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-249c2fef-c43e-473c-83b1-8da6a0d866e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:22.328165 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c2fef-c43e-473c-83b1-8da6a0d866e5 service neutron] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:22.335213 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4982bec-d5d1-4adc-838c-9f923786760e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:22.335876 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4982bec-d5d1-4adc-838c-9f923786760e admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:22.336210 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4982bec-d5d1-4adc-838c-9f923786760e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:22.336498 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4982bec-d5d1-4adc-838c-9f923786760e admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:22.337306 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4982bec-d5d1-4adc-838c-9f923786760e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:22.339439 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4982bec-d5d1-4adc-838c-9f923786760e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:22.414394 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1003/2004] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:34:22 2021] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:22.418718 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb85463-5150-41a6-a2c4-37a1bf360602 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:22.430979 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb85463-5150-41a6-a2c4-37a1bf360602 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:22.487043 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4982bec-d5d1-4adc-838c-9f923786760e admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:22.487221 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a93f6-9e54-4bd6-aa32-93280e5a205f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:22.488026 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a93f6-9e54-4bd6-aa32-93280e5a205f admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:22.488141 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a93f6-9e54-4bd6-aa32-93280e5a205f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:22.488387 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a93f6-9e54-4bd6-aa32-93280e5a205f admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:22.489142 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-a4982bec-d5d1-4adc-838c-9f923786760e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:22.489265 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a93f6-9e54-4bd6-aa32-93280e5a205f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:22.492430 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a93f6-9e54-4bd6-aa32-93280e5a205f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:22.503483 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4982bec-d5d1-4adc-838c-9f923786760e admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:22.508545 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a55ecc-5823-4144-aaa1-a9c674cf49e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:22.509512 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a55ecc-5823-4144-aaa1-a9c674cf49e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:22.509879 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a55ecc-5823-4144-aaa1-a9c674cf49e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:22.510230 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a55ecc-5823-4144-aaa1-a9c674cf49e6 admin admin] PATH_INFO: `/v3/projects/ad8610e84f554da7913c01b5c3d2daaa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:22.511511 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a55ecc-5823-4144-aaa1-a9c674cf49e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad8610e84f554da7913c01b5c3d2daaa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:22.513711 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a55ecc-5823-4144-aaa1-a9c674cf49e6 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:22.565473 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1002/2005] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:34:22 2021] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:22.569743 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a93f6-9e54-4bd6-aa32-93280e5a205f admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:22.579738 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a93f6-9e54-4bd6-aa32-93280e5a205f admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:22.585855 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c2385-fb2e-405c-b7cc-b11bb3fcf4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:22.586559 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c2385-fb2e-405c-b7cc-b11bb3fcf4f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:22.586844 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c2385-fb2e-405c-b7cc-b11bb3fcf4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:22.587122 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c2385-fb2e-405c-b7cc-b11bb3fcf4f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:22.587954 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c2385-fb2e-405c-b7cc-b11bb3fcf4f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:22.589664 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c2385-fb2e-405c-b7cc-b11bb3fcf4f3 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:22.604700 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1003/2006] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:22 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:34:22.606126 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c2385-fb2e-405c-b7cc-b11bb3fcf4f3 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:22.611865 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-88a55ecc-5823-4144-aaa1-a9c674cf49e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad8610e84f554da7913c01b5c3d2daaa', 'request_id': 'req-88a55ecc-5823-4144-aaa1-a9c674cf49e6'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:22.618576 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-88a55ecc-5823-4144-aaa1-a9c674cf49e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad8610e84f554da7913c01b5c3d2daaa', 'request_id': 'req-88a55ecc-5823-4144-aaa1-a9c674cf49e6'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:22.618734 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c2385-fb2e-405c-b7cc-b11bb3fcf4f3 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:22.624215 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-88a55ecc-5823-4144-aaa1-a9c674cf49e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad8610e84f554da7913c01b5c3d2daaa', 'request_id': 'req-88a55ecc-5823-4144-aaa1-a9c674cf49e6'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:22.672323 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbb029-113a-4d46-81fc-085bafe3483c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:22.673207 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbb029-113a-4d46-81fc-085bafe3483c admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:22.673518 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbb029-113a-4d46-81fc-085bafe3483c admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:22.673794 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbb029-113a-4d46-81fc-085bafe3483c admin admin] PATH_INFO: `/v3/projects/0f471fb0d1ee46ceac1bf2ea7ca3ab29/users/267a98c2f23a4af3b13fbbada52d7ac0/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:22.678927 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-88a55ecc-5823-4144-aaa1-a9c674cf49e6 admin admin] The token cache is being invalidate because project ad8610e84f554da7913c01b5c3d2daaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:34:22.679220 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-88a55ecc-5823-4144-aaa1-a9c674cf49e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:22.680092 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-88a55ecc-5823-4144-aaa1-a9c674cf49e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:22.681613 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1004/2007] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:34:22 2021] DELETE /identity/v3/projects/ad8610e84f554da7913c01b5c3d2daaa => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:22.685558 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a55ecc-5823-4144-aaa1-a9c674cf49e6 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:22.686896 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-88a55ecc-5823-4144-aaa1-a9c674cf49e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:22.689975 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcbb029-113a-4d46-81fc-085bafe3483c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f471fb0d1ee46ceac1bf2ea7ca3ab29, user_id=267a98c2f23a4af3b13fbbada52d7ac0, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:22.692669 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcbb029-113a-4d46-81fc-085bafe3483c admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:22.699903 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a55ecc-5823-4144-aaa1-a9c674cf49e6 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:22.704838 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4785c44-d977-46fc-b55a-21c3799a23f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:22.705748 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4785c44-d977-46fc-b55a-21c3799a23f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:22.706034 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4785c44-d977-46fc-b55a-21c3799a23f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:22.706312 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4785c44-d977-46fc-b55a-21c3799a23f1 admin admin] PATH_INFO: `/v3/users/611119fb9cd74d848e1aef7648e20b6e` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:22.707516 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4785c44-d977-46fc-b55a-21c3799a23f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=611119fb9cd74d848e1aef7648e20b6e)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:22.709939 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4785c44-d977-46fc-b55a-21c3799a23f1 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:22.754484 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1004/2008] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:22 2021] PUT /identity/v3/projects/0f471fb0d1ee46ceac1bf2ea7ca3ab29/users/267a98c2f23a4af3b13fbbada52d7ac0/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:22.758332 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbb029-113a-4d46-81fc-085bafe3483c admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:22.759891 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-3bcbb029-113a-4d46-81fc-085bafe3483c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:22.820959 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbb029-113a-4d46-81fc-085bafe3483c admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:22.825845 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9afdb-8ec1-486c-98ab-7bee6115d38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:22.826552 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9afdb-8ec1-486c-98ab-7bee6115d38a admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:22.826842 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9afdb-8ec1-486c-98ab-7bee6115d38a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:22.827114 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9afdb-8ec1-486c-98ab-7bee6115d38a admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:22.827839 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9afdb-8ec1-486c-98ab-7bee6115d38a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:22.829382 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9afdb-8ec1-486c-98ab-7bee6115d38a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:22.839859 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1005/2009] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:22 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:34:22.843935 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9afdb-8ec1-486c-98ab-7bee6115d38a admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:22.854097 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9afdb-8ec1-486c-98ab-7bee6115d38a admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:22.858756 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90571547-b809-4974-b073-47c1e93c5548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:22.859598 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90571547-b809-4974-b073-47c1e93c5548 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:22.859873 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90571547-b809-4974-b073-47c1e93c5548 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:22.860141 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90571547-b809-4974-b073-47c1e93c5548 admin admin] PATH_INFO: `/v3/projects/0f471fb0d1ee46ceac1bf2ea7ca3ab29/users/267a98c2f23a4af3b13fbbada52d7ac0/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:22.862146 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90571547-b809-4974-b073-47c1e93c5548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f471fb0d1ee46ceac1bf2ea7ca3ab29, user_id=267a98c2f23a4af3b13fbbada52d7ac0, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:22.864653 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90571547-b809-4974-b073-47c1e93c5548 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:22.874934 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1006/2010] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:22 2021] PUT /identity/v3/projects/0f471fb0d1ee46ceac1bf2ea7ca3ab29/users/267a98c2f23a4af3b13fbbada52d7ac0/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:22.910772 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-e4785c44-d977-46fc-b55a-21c3799a23f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '611119fb9cd74d848e1aef7648e20b6e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:22.911431 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-e4785c44-d977-46fc-b55a-21c3799a23f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '611119fb9cd74d848e1aef7648e20b6e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:22.918164 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-e4785c44-d977-46fc-b55a-21c3799a23f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '611119fb9cd74d848e1aef7648e20b6e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:22.919239 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-e4785c44-d977-46fc-b55a-21c3799a23f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '611119fb9cd74d848e1aef7648e20b6e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:22.931421 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-e4785c44-d977-46fc-b55a-21c3799a23f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '611119fb9cd74d848e1aef7648e20b6e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:23.001988 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1005/2011] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:34:22 2021] DELETE /identity/v3/users/611119fb9cd74d848e1aef7648e20b6e => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:23.595145 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90571547-b809-4974-b073-47c1e93c5548 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:23.596920 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-90571547-b809-4974-b073-47c1e93c5548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:23.671933 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90571547-b809-4974-b073-47c1e93c5548 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:23.737964 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab5479-8bd8-4b2d-a073-f9acba03fb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:23.738888 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab5479-8bd8-4b2d-a073-f9acba03fb4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:23.739173 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab5479-8bd8-4b2d-a073-f9acba03fb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:23.739449 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab5479-8bd8-4b2d-a073-f9acba03fb4a admin admin] PATH_INFO: `/v3/projects/7ec7ed9c11634959a176e9dfa16aaa31` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:23.741585 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab5479-8bd8-4b2d-a073-f9acba03fb4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ec7ed9c11634959a176e9dfa16aaa31)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:23.743765 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab5479-8bd8-4b2d-a073-f9acba03fb4a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:23.918052 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-5dab5479-8bd8-4b2d-a073-f9acba03fb4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ec7ed9c11634959a176e9dfa16aaa31', 'request_id': 'req-5dab5479-8bd8-4b2d-a073-f9acba03fb4a'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:23.930801 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-5dab5479-8bd8-4b2d-a073-f9acba03fb4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ec7ed9c11634959a176e9dfa16aaa31', 'request_id': 'req-5dab5479-8bd8-4b2d-a073-f9acba03fb4a'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:23.942596 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-5dab5479-8bd8-4b2d-a073-f9acba03fb4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ec7ed9c11634959a176e9dfa16aaa31', 'request_id': 'req-5dab5479-8bd8-4b2d-a073-f9acba03fb4a'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:24.048072 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-5dab5479-8bd8-4b2d-a073-f9acba03fb4a admin admin] The token cache is being invalidate because project 7ec7ed9c11634959a176e9dfa16aaa31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:34:24.048969 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-5dab5479-8bd8-4b2d-a073-f9acba03fb4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:24.049379 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-5dab5479-8bd8-4b2d-a073-f9acba03fb4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:24.051479 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1007/2012] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:34:23 2021] DELETE /identity/v3/projects/7ec7ed9c11634959a176e9dfa16aaa31 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:24.058255 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0be221-bf45-4ed7-9249-a63d3e95c38f None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:24.058789 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0be221-bf45-4ed7-9249-a63d3e95c38f None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:24.059028 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0be221-bf45-4ed7-9249-a63d3e95c38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:24.092786 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-dd0be221-bf45-4ed7-9249-a63d3e95c38f None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:24.094357 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-dd0be221-bf45-4ed7-9249-a63d3e95c38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:24.164051 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1006/2013] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:24.176061 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8cd8a9-73ba-4259-9955-4a9a981cb465 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:24.178049 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8cd8a9-73ba-4259-9955-4a9a981cb465 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:24.178666 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8cd8a9-73ba-4259-9955-4a9a981cb465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:24.218947 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-0e8cd8a9-73ba-4259-9955-4a9a981cb465 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:24.220336 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-0e8cd8a9-73ba-4259-9955-4a9a981cb465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:24.243660 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1008/2014] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:24.254317 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0be221-bf45-4ed7-9249-a63d3e95c38f None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:24.265507 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0be221-bf45-4ed7-9249-a63d3e95c38f None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:24.275964 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8cd8a9-73ba-4259-9955-4a9a981cb465 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:24.277544 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-0e8cd8a9-73ba-4259-9955-4a9a981cb465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:24.301359 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c27b7-7cdf-4e61-bee1-d7045c7ea7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:24.302159 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c27b7-7cdf-4e61-bee1-d7045c7ea7ba admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:24.302803 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c27b7-7cdf-4e61-bee1-d7045c7ea7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:24.303420 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c27b7-7cdf-4e61-bee1-d7045c7ea7ba admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:24.304824 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c27b7-7cdf-4e61-bee1-d7045c7ea7ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:34:24.306650 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c27b7-7cdf-4e61-bee1-d7045c7ea7ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:24.311063 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c27b7-7cdf-4e61-bee1-d7045c7ea7ba admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:24.338625 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8cd8a9-73ba-4259-9955-4a9a981cb465 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:24.354910 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907bfb3-2c20-4d89-afd1-98e3c8be27e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:24.355909 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907bfb3-2c20-4d89-afd1-98e3c8be27e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:24.356182 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907bfb3-2c20-4d89-afd1-98e3c8be27e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:24.356466 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907bfb3-2c20-4d89-afd1-98e3c8be27e3 admin admin] PATH_INFO: `/v3/users/7b326869f3d74dfd8334e82f60c73a86` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:24.356946 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1007/2015] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:34:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:34:24.358621 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6907bfb3-2c20-4d89-afd1-98e3c8be27e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b326869f3d74dfd8334e82f60c73a86)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:24.360562 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6907bfb3-2c20-4d89-afd1-98e3c8be27e3 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:24.361961 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c27b7-7cdf-4e61-bee1-d7045c7ea7ba admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:24.390184 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c27b7-7cdf-4e61-bee1-d7045c7ea7ba admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:24.395792 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa37cbc-00a6-4af0-a914-d2e05c989284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:24.398824 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa37cbc-00a6-4af0-a914-d2e05c989284 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:24.399497 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa37cbc-00a6-4af0-a914-d2e05c989284 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:24.400351 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa37cbc-00a6-4af0-a914-d2e05c989284 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:24.401543 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa37cbc-00a6-4af0-a914-d2e05c989284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:24.403857 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa37cbc-00a6-4af0-a914-d2e05c989284 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:24.518669 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1008/2016] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:34:24 2021] POST /identity/v3/projects => generated 379 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:24.518669 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa37cbc-00a6-4af0-a914-d2e05c989284 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:24.598708 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa37cbc-00a6-4af0-a914-d2e05c989284 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:24.604419 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55edda1-93bd-41d2-a923-71cea3f62278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:24.605109 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55edda1-93bd-41d2-a923-71cea3f62278 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:24.605593 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55edda1-93bd-41d2-a923-71cea3f62278 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:24.609271 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55edda1-93bd-41d2-a923-71cea3f62278 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:24.609271 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55edda1-93bd-41d2-a923-71cea3f62278 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:24.609271 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55edda1-93bd-41d2-a923-71cea3f62278 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:24.613716 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-6907bfb3-2c20-4d89-afd1-98e3c8be27e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b326869f3d74dfd8334e82f60c73a86'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:24.614515 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-6907bfb3-2c20-4d89-afd1-98e3c8be27e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b326869f3d74dfd8334e82f60c73a86'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:24.709781 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-6907bfb3-2c20-4d89-afd1-98e3c8be27e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b326869f3d74dfd8334e82f60c73a86'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:24.709781 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-6907bfb3-2c20-4d89-afd1-98e3c8be27e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b326869f3d74dfd8334e82f60c73a86'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:24.732274 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1009/2017] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:34:24 2021] POST /identity/v3/users => generated 290 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:24.734234 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55edda1-93bd-41d2-a923-71cea3f62278 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:24.741570 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-c55edda1-93bd-41d2-a923-71cea3f62278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:24.744475 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-6907bfb3-2c20-4d89-afd1-98e3c8be27e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b326869f3d74dfd8334e82f60c73a86'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:24.759257 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55edda1-93bd-41d2-a923-71cea3f62278 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:24.766109 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1b0de-a120-4d4a-9412-1b175a99a35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:24.766944 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1b0de-a120-4d4a-9412-1b175a99a35d admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:24.767235 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1b0de-a120-4d4a-9412-1b175a99a35d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:24.767551 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1b0de-a120-4d4a-9412-1b175a99a35d admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:24.768326 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1b0de-a120-4d4a-9412-1b175a99a35d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:24.773139 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1b0de-a120-4d4a-9412-1b175a99a35d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:24.773908 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1009/2018] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:34:24 2021] DELETE /identity/v3/users/7b326869f3d74dfd8334e82f60c73a86 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:24.775690 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1520f05-0196-47c6-910c-90481415285e None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:24.776137 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1520f05-0196-47c6-910c-90481415285e None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:24.776584 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1520f05-0196-47c6-910c-90481415285e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:24.801354 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1010/2019] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:24 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:24.805764 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8acdbe-6675-46a4-8753-711a3f8e792e None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:24.806436 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8acdbe-6675-46a4-8753-711a3f8e792e None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:24.806719 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8acdbe-6675-46a4-8753-711a3f8e792e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:24.810284 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-c1520f05-0196-47c6-910c-90481415285e None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:24.812162 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-c1520f05-0196-47c6-910c-90481415285e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:24.874019 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-6e8acdbe-6675-46a4-8753-711a3f8e792e None None] MFA Rules not processed for user `267a98c2f23a4af3b13fbbada52d7ac0`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:24.876625 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-6e8acdbe-6675-46a4-8753-711a3f8e792e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:24.898557 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1010/2020] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:24.899290 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1520f05-0196-47c6-910c-90481415285e None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:24.911195 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1520f05-0196-47c6-910c-90481415285e None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:24.918954 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab54ae6-e81a-4cf9-80b8-78e940929ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:24.920737 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab54ae6-e81a-4cf9-80b8-78e940929ebf admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:24.921614 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab54ae6-e81a-4cf9-80b8-78e940929ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:24.922222 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab54ae6-e81a-4cf9-80b8-78e940929ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:24.923382 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab54ae6-e81a-4cf9-80b8-78e940929ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:24.928925 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab54ae6-e81a-4cf9-80b8-78e940929ebf admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:24.946169 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1011/2021] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:24 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:24.947689 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab54ae6-e81a-4cf9-80b8-78e940929ebf admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:24.949987 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-1ab54ae6-e81a-4cf9-80b8-78e940929ebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:24.979840 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1011/2022] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:24 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:24.980967 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8acdbe-6675-46a4-8753-711a3f8e792e None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:24.995831 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8acdbe-6675-46a4-8753-711a3f8e792e None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:25.001387 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e467f-a349-4bf2-b7fc-26e37658b05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:25.002656 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e467f-a349-4bf2-b7fc-26e37658b05f admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:25.003005 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e467f-a349-4bf2-b7fc-26e37658b05f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:25.003346 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e467f-a349-4bf2-b7fc-26e37658b05f admin admin] PATH_INFO: `/v3/projects/58b51d4f1c344c87ba70a815b1450701/users/98e7492748be44b89de74d14566d3072/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:25.020458 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e467f-a349-4bf2-b7fc-26e37658b05f admin admin] RBAC: Authorizing `identity:create_grant(project_id=58b51d4f1c344c87ba70a815b1450701, user_id=98e7492748be44b89de74d14566d3072, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:25.023909 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e467f-a349-4bf2-b7fc-26e37658b05f admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:25.035525 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab54ae6-e81a-4cf9-80b8-78e940929ebf admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:25.041358 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcdc41-6cda-440d-9d1e-1fc19a098af7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:25.042358 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcdc41-6cda-440d-9d1e-1fc19a098af7 service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:25.042875 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcdc41-6cda-440d-9d1e-1fc19a098af7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:25.043374 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcdc41-6cda-440d-9d1e-1fc19a098af7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:25.054613 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bcdc41-6cda-440d-9d1e-1fc19a098af7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:25.056195 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bcdc41-6cda-440d-9d1e-1fc19a098af7 service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:25.067219 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1012/2023] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:34:25.067861 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcdc41-6cda-440d-9d1e-1fc19a098af7 service neutron] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:25.069829 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-e9bcdc41-6cda-440d-9d1e-1fc19a098af7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:25.126621 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1012/2024] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:24 2021] PUT /identity/v3/projects/58b51d4f1c344c87ba70a815b1450701/users/98e7492748be44b89de74d14566d3072/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:25.138436 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86e776-6fef-4349-ac23-334cd9c9acc3 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:25.139128 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86e776-6fef-4349-ac23-334cd9c9acc3 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:25.139464 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86e776-6fef-4349-ac23-334cd9c9acc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:25.160647 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcdc41-6cda-440d-9d1e-1fc19a098af7 service neutron] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:25.179478 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-ae86e776-6fef-4349-ac23-334cd9c9acc3 None None] MFA Rules not processed for user `98e7492748be44b89de74d14566d3072`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:25.181059 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-ae86e776-6fef-4349-ac23-334cd9c9acc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:25.228960 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaaaef8-dded-4cac-a334-71db40a368f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:25.229644 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaaaef8-dded-4cac-a334-71db40a368f9 service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:25.230069 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaaaef8-dded-4cac-a334-71db40a368f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:25.230354 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaaaef8-dded-4cac-a334-71db40a368f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:25.232654 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-dbaaaef8-dded-4cac-a334-71db40a368f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:25.269218 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1013/2025] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:25 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:34:25.274249 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86e776-6fef-4349-ac23-334cd9c9acc3 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:25.300043 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaaaef8-dded-4cac-a334-71db40a368f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:25.301634 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaaaef8-dded-4cac-a334-71db40a368f9 service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:25.314435 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1013/2026] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:25 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:34:25.373265 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86e776-6fef-4349-ac23-334cd9c9acc3 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:25.378604 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5726d-2d13-496a-9b65-90eb7ffa4e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:25.379064 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5726d-2d13-496a-9b65-90eb7ffa4e4d admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:25.379421 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5726d-2d13-496a-9b65-90eb7ffa4e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:25.379772 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5726d-2d13-496a-9b65-90eb7ffa4e4d admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:25.380562 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5726d-2d13-496a-9b65-90eb7ffa4e4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:25.383646 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5726d-2d13-496a-9b65-90eb7ffa4e4d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:25.490163 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1014/2027] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:34:25 2021] POST /identity/v3/projects => generated 375 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:34:25.492293 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaaaef8-dded-4cac-a334-71db40a368f9 service cinder] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:25.503069 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaaaef8-dded-4cac-a334-71db40a368f9 service cinder] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:25.539780 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5726d-2d13-496a-9b65-90eb7ffa4e4d admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:25.541656 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-cbc5726d-2d13-496a-9b65-90eb7ffa4e4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:25.588309 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3d79d-fd0c-411c-8c2d-40cc6cac3b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:25.589253 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3d79d-fd0c-411c-8c2d-40cc6cac3b59 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:25.589499 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3d79d-fd0c-411c-8c2d-40cc6cac3b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:25.595148 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3d79d-fd0c-411c-8c2d-40cc6cac3b59 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:25.595148 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3d79d-fd0c-411c-8c2d-40cc6cac3b59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:25.595148 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3d79d-fd0c-411c-8c2d-40cc6cac3b59 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:25.625755 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5726d-2d13-496a-9b65-90eb7ffa4e4d admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:25.631064 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee1744-fc38-4c7c-8e73-3bf7670ca7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:25.631934 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee1744-fc38-4c7c-8e73-3bf7670ca7ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:25.632213 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee1744-fc38-4c7c-8e73-3bf7670ca7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:25.632483 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee1744-fc38-4c7c-8e73-3bf7670ca7ae admin admin] PATH_INFO: `/v3/projects/36b0e454874347efa954172edc69c5c8` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:25.633977 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee1744-fc38-4c7c-8e73-3bf7670ca7ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=36b0e454874347efa954172edc69c5c8)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:25.635610 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee1744-fc38-4c7c-8e73-3bf7670ca7ae admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:25.669882 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1014/2028] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:34:25 2021] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:34:25.673906 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3d79d-fd0c-411c-8c2d-40cc6cac3b59 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:25.683502 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3d79d-fd0c-411c-8c2d-40cc6cac3b59 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:25.688477 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bdf9b7-05c0-4448-b016-8ad072544ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:25.689201 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdf9b7-05c0-4448-b016-8ad072544ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:25.689882 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdf9b7-05c0-4448-b016-8ad072544ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:25.689882 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdf9b7-05c0-4448-b016-8ad072544ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:25.690607 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bdf9b7-05c0-4448-b016-8ad072544ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:25.692489 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bdf9b7-05c0-4448-b016-8ad072544ee4 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:25.713836 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1015/2029] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:25 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:25.718290 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bdf9b7-05c0-4448-b016-8ad072544ee4 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:25.732158 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-18ee1744-fc38-4c7c-8e73-3bf7670ca7ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36b0e454874347efa954172edc69c5c8', 'request_id': 'req-18ee1744-fc38-4c7c-8e73-3bf7670ca7ae'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:25.736375 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bdf9b7-05c0-4448-b016-8ad072544ee4 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:25.741639 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-18ee1744-fc38-4c7c-8e73-3bf7670ca7ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36b0e454874347efa954172edc69c5c8', 'request_id': 'req-18ee1744-fc38-4c7c-8e73-3bf7670ca7ae'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:25.749060 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-18ee1744-fc38-4c7c-8e73-3bf7670ca7ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36b0e454874347efa954172edc69c5c8', 'request_id': 'req-18ee1744-fc38-4c7c-8e73-3bf7670ca7ae'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:25.819719 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7ffe4-b805-4520-906e-a83c6eeb6ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:25.821037 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7ffe4-b805-4520-906e-a83c6eeb6ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:25.821340 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7ffe4-b805-4520-906e-a83c6eeb6ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:25.823145 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7ffe4-b805-4520-906e-a83c6eeb6ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:25.823145 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7ffe4-b805-4520-906e-a83c6eeb6ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:25.824036 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7ffe4-b805-4520-906e-a83c6eeb6ac1 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:25.829436 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-18ee1744-fc38-4c7c-8e73-3bf7670ca7ae admin admin] The token cache is being invalidate because project 36b0e454874347efa954172edc69c5c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:34:25.829820 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-18ee1744-fc38-4c7c-8e73-3bf7670ca7ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:25.830542 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-18ee1744-fc38-4c7c-8e73-3bf7670ca7ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:25.832322 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1015/2030] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:34:25 2021] DELETE /identity/v3/projects/36b0e454874347efa954172edc69c5c8 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:25.836093 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1016/2031] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:25 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:25.839708 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7ffe4-b805-4520-906e-a83c6eeb6ac1 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:25.840464 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdaff31-7e05-4657-82be-d01f047c7469 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:25.840763 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdaff31-7e05-4657-82be-d01f047c7469 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:25.841057 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdaff31-7e05-4657-82be-d01f047c7469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:25.841794 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-91d7ffe4-b805-4520-906e-a83c6eeb6ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:25.855040 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7ffe4-b805-4520-906e-a83c6eeb6ac1 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:25.860036 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345ea13-0cce-4985-92c2-eda68e239788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:25.861013 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345ea13-0cce-4985-92c2-eda68e239788 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:25.861297 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345ea13-0cce-4985-92c2-eda68e239788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:25.861441 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-ccdaff31-7e05-4657-82be-d01f047c7469 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:25.861721 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345ea13-0cce-4985-92c2-eda68e239788 admin admin] PATH_INFO: `/v3/projects/22d82e3212ff4217ac83f1d2c7c124e0/users/934fe1b25a7c451bac113ed9d1111b44/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:25.862550 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-ccdaff31-7e05-4657-82be-d01f047c7469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:25.870937 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1016/2032] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:25.879139 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9345ea13-0cce-4985-92c2-eda68e239788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22d82e3212ff4217ac83f1d2c7c124e0, user_id=934fe1b25a7c451bac113ed9d1111b44, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:25.879264 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432eaac-e5d8-4afe-ab05-730039f3c8a4 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:25.879457 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432eaac-e5d8-4afe-ab05-730039f3c8a4 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:25.881247 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432eaac-e5d8-4afe-ab05-730039f3c8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:25.882690 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9345ea13-0cce-4985-92c2-eda68e239788 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:25.902875 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-2432eaac-e5d8-4afe-ab05-730039f3c8a4 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:25.903376 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-2432eaac-e5d8-4afe-ab05-730039f3c8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:25.913432 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1017/2033] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:25.917270 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432eaac-e5d8-4afe-ab05-730039f3c8a4 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:25.933023 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432eaac-e5d8-4afe-ab05-730039f3c8a4 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:25.939685 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9742c46c-7fbe-43c3-9aa1-5709b4215e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:25.940385 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742c46c-7fbe-43c3-9aa1-5709b4215e11 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:25.940909 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742c46c-7fbe-43c3-9aa1-5709b4215e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:25.941235 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742c46c-7fbe-43c3-9aa1-5709b4215e11 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:25.942048 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9742c46c-7fbe-43c3-9aa1-5709b4215e11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:34:25.942357 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9742c46c-7fbe-43c3-9aa1-5709b4215e11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:25.944807 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9742c46c-7fbe-43c3-9aa1-5709b4215e11 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:25.957379 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1017/2034] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:25 2021] PUT /identity/v3/projects/22d82e3212ff4217ac83f1d2c7c124e0/users/934fe1b25a7c451bac113ed9d1111b44/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:25.958601 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1018/2035] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:34:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:34:25.963526 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345ea13-0cce-4985-92c2-eda68e239788 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:25.973367 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd54f39-dbea-42ca-8f45-cfa041145448 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:25.973675 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd54f39-dbea-42ca-8f45-cfa041145448 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:25.973954 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd54f39-dbea-42ca-8f45-cfa041145448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:26.017496 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-0fd54f39-dbea-42ca-8f45-cfa041145448 None None] MFA Rules not processed for user `934fe1b25a7c451bac113ed9d1111b44`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:26.018995 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-0fd54f39-dbea-42ca-8f45-cfa041145448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:26.081979 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345ea13-0cce-4985-92c2-eda68e239788 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:26.095515 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f909f-f2eb-4e64-a258-e9cf94527499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:26.097165 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f909f-f2eb-4e64-a258-e9cf94527499 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:26.097743 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f909f-f2eb-4e64-a258-e9cf94527499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:26.098231 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f909f-f2eb-4e64-a258-e9cf94527499 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:26.099533 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f909f-f2eb-4e64-a258-e9cf94527499 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:26.103375 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f909f-f2eb-4e64-a258-e9cf94527499 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:26.134115 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1019/2036] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:25 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:26.138116 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd54f39-dbea-42ca-8f45-cfa041145448 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:26.150064 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd54f39-dbea-42ca-8f45-cfa041145448 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:26.155980 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf0fdb-950c-4e2e-ba4f-ae91e794b608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:26.156647 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf0fdb-950c-4e2e-ba4f-ae91e794b608 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:26.156933 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf0fdb-950c-4e2e-ba4f-ae91e794b608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:26.157208 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf0fdb-950c-4e2e-ba4f-ae91e794b608 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:26.157958 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf0fdb-950c-4e2e-ba4f-ae91e794b608 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:26.159853 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf0fdb-950c-4e2e-ba4f-ae91e794b608 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:26.189626 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1018/2037] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:34:25 2021] POST /identity/v3/projects => generated 397 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:34:26.194650 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f909f-f2eb-4e64-a258-e9cf94527499 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:26.259263 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f909f-f2eb-4e64-a258-e9cf94527499 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:26.264051 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa8153-d6f8-4978-9f21-4ae55a6faa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:26.264720 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa8153-d6f8-4978-9f21-4ae55a6faa49 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:26.265002 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa8153-d6f8-4978-9f21-4ae55a6faa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:26.265277 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa8153-d6f8-4978-9f21-4ae55a6faa49 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:26.271085 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa8153-d6f8-4978-9f21-4ae55a6faa49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:26.275605 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa8153-d6f8-4978-9f21-4ae55a6faa49 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:26.321600 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1020/2038] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:34:26 2021] POST /identity/v3/projects => generated 379 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:26.322528 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf0fdb-950c-4e2e-ba4f-ae91e794b608 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:26.374425 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1019/2039] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:34:26 2021] POST /identity/v3/users => generated 299 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:34:26.379217 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa8153-d6f8-4978-9f21-4ae55a6faa49 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:26.397471 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf0fdb-950c-4e2e-ba4f-ae91e794b608 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:26.404520 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6cd48-7dc7-4d6f-bbac-c26808bc4320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:26.405207 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6cd48-7dc7-4d6f-bbac-c26808bc4320 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:26.405796 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6cd48-7dc7-4d6f-bbac-c26808bc4320 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:26.406082 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6cd48-7dc7-4d6f-bbac-c26808bc4320 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:26.406175 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa8153-d6f8-4978-9f21-4ae55a6faa49 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:26.406854 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6cd48-7dc7-4d6f-bbac-c26808bc4320 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:26.408978 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6cd48-7dc7-4d6f-bbac-c26808bc4320 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:26.416497 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350eadb-c118-46a8-a3cc-1abe520affac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:26.417215 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350eadb-c118-46a8-a3cc-1abe520affac admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:26.417532 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350eadb-c118-46a8-a3cc-1abe520affac admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:26.417830 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350eadb-c118-46a8-a3cc-1abe520affac admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:26.418619 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350eadb-c118-46a8-a3cc-1abe520affac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:26.420257 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350eadb-c118-46a8-a3cc-1abe520affac admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:26.434069 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1020/2040] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:26 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:26.435695 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350eadb-c118-46a8-a3cc-1abe520affac admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:26.446470 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350eadb-c118-46a8-a3cc-1abe520affac admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:26.452291 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a381dd-165a-4769-ad27-5be3ae4ab29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:26.453054 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a381dd-165a-4769-ad27-5be3ae4ab29a admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:26.453337 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a381dd-165a-4769-ad27-5be3ae4ab29a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:26.453684 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a381dd-165a-4769-ad27-5be3ae4ab29a admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:26.454441 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a381dd-165a-4769-ad27-5be3ae4ab29a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:26.456201 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a381dd-165a-4769-ad27-5be3ae4ab29a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:26.468493 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1021/2041] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:26 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:34:26.472741 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a381dd-165a-4769-ad27-5be3ae4ab29a admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:26.497554 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a381dd-165a-4769-ad27-5be3ae4ab29a admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:26.497554 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa7ab1-2555-426e-8379-1585955e7659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:26.497554 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa7ab1-2555-426e-8379-1585955e7659 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:26.497554 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa7ab1-2555-426e-8379-1585955e7659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:26.497913 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa7ab1-2555-426e-8379-1585955e7659 admin admin] PATH_INFO: `/v3/projects/f10ec19eeb9644d691133393f4700520/users/b2d109441fcc4b87bb41397e0ec4d53f/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:26.512169 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa7ab1-2555-426e-8379-1585955e7659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f10ec19eeb9644d691133393f4700520, user_id=b2d109441fcc4b87bb41397e0ec4d53f, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:26.515233 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1021/2042] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:34:26 2021] POST /identity/v3/users => generated 296 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:26.517944 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa7ab1-2555-426e-8379-1585955e7659 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:26.520592 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6cd48-7dc7-4d6f-bbac-c26808bc4320 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:26.531169 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6cd48-7dc7-4d6f-bbac-c26808bc4320 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:26.536653 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139fbf1-d15f-4071-9721-acc2f2e9cdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:26.537952 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139fbf1-d15f-4071-9721-acc2f2e9cdc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:26.538463 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139fbf1-d15f-4071-9721-acc2f2e9cdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:26.538729 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139fbf1-d15f-4071-9721-acc2f2e9cdc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:26.539483 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139fbf1-d15f-4071-9721-acc2f2e9cdc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:26.541079 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139fbf1-d15f-4071-9721-acc2f2e9cdc7 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:26.551103 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1022/2043] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:26 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:34:26.555246 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139fbf1-d15f-4071-9721-acc2f2e9cdc7 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:26.565694 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139fbf1-d15f-4071-9721-acc2f2e9cdc7 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:26.570385 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44638877-4b02-4200-95d6-4d4251ab3e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:26.571299 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44638877-4b02-4200-95d6-4d4251ab3e98 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:26.571731 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44638877-4b02-4200-95d6-4d4251ab3e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:26.571890 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44638877-4b02-4200-95d6-4d4251ab3e98 admin admin] PATH_INFO: `/v3/projects/b8bda7b7e19a453d92dec7cb9cda930f/users/65d5a7b4c7c84bf9bdb926c3bd12c1f4/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:26.587358 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44638877-4b02-4200-95d6-4d4251ab3e98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8bda7b7e19a453d92dec7cb9cda930f, user_id=65d5a7b4c7c84bf9bdb926c3bd12c1f4, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:26.590832 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44638877-4b02-4200-95d6-4d4251ab3e98 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:26.594605 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1022/2044] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:26 2021] PUT /identity/v3/projects/f10ec19eeb9644d691133393f4700520/users/b2d109441fcc4b87bb41397e0ec4d53f/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:26.605459 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5bc4f-0e9f-4156-b7da-4d4ff1a8f49b None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:26.605762 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5bc4f-0e9f-4156-b7da-4d4ff1a8f49b None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:26.606037 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5bc4f-0e9f-4156-b7da-4d4ff1a8f49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:26.632175 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-47b5bc4f-0e9f-4156-b7da-4d4ff1a8f49b None None] MFA Rules not processed for user `b2d109441fcc4b87bb41397e0ec4d53f`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:26.633397 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-47b5bc4f-0e9f-4156-b7da-4d4ff1a8f49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:26.664058 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1023/2045] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:26 2021] PUT /identity/v3/projects/b8bda7b7e19a453d92dec7cb9cda930f/users/65d5a7b4c7c84bf9bdb926c3bd12c1f4/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:26.667724 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44638877-4b02-4200-95d6-4d4251ab3e98 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:26.701034 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1023/2046] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:26 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:26.712133 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5bc4f-0e9f-4156-b7da-4d4ff1a8f49b None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:26.714079 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-47b5bc4f-0e9f-4156-b7da-4d4ff1a8f49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:26.735848 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44638877-4b02-4200-95d6-4d4251ab3e98 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:26.741890 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3442d2-28f5-4abc-956a-08df343e8958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:26.742655 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3442d2-28f5-4abc-956a-08df343e8958 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:26.743014 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3442d2-28f5-4abc-956a-08df343e8958 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:26.743360 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3442d2-28f5-4abc-956a-08df343e8958 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:26.744201 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3442d2-28f5-4abc-956a-08df343e8958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:26.745818 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3442d2-28f5-4abc-956a-08df343e8958 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:26.756136 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1024/2047] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:26 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:34:26.760508 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3442d2-28f5-4abc-956a-08df343e8958 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:26.770630 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3442d2-28f5-4abc-956a-08df343e8958 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:26.775500 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86c1b5-4798-43a0-81e1-e83f867adae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:26.776404 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86c1b5-4798-43a0-81e1-e83f867adae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:26.776688 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86c1b5-4798-43a0-81e1-e83f867adae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:26.776962 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86c1b5-4798-43a0-81e1-e83f867adae1 admin admin] PATH_INFO: `/v3/projects/b8bda7b7e19a453d92dec7cb9cda930f/users/65d5a7b4c7c84bf9bdb926c3bd12c1f4/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:26.779044 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d86c1b5-4798-43a0-81e1-e83f867adae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8bda7b7e19a453d92dec7cb9cda930f, user_id=65d5a7b4c7c84bf9bdb926c3bd12c1f4, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:26.779703 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5bc4f-0e9f-4156-b7da-4d4ff1a8f49b None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:26.781681 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d86c1b5-4798-43a0-81e1-e83f867adae1 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:26.795880 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1025/2048] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:26 2021] PUT /identity/v3/projects/b8bda7b7e19a453d92dec7cb9cda930f/users/65d5a7b4c7c84bf9bdb926c3bd12c1f4/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:26.806971 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973f1e8-9089-4f99-8372-3a41587d1de2 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:26.807261 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973f1e8-9089-4f99-8372-3a41587d1de2 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:26.807543 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973f1e8-9089-4f99-8372-3a41587d1de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:26.842090 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-5973f1e8-9089-4f99-8372-3a41587d1de2 None None] MFA Rules not processed for user `65d5a7b4c7c84bf9bdb926c3bd12c1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:26.843522 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-5973f1e8-9089-4f99-8372-3a41587d1de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:26.844851 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad5c6f-dd75-4118-b6fb-ac326ad97239 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:26.845547 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad5c6f-dd75-4118-b6fb-ac326ad97239 service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:26.845829 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad5c6f-dd75-4118-b6fb-ac326ad97239 service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:26.846184 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad5c6f-dd75-4118-b6fb-ac326ad97239 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:26.902975 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad5c6f-dd75-4118-b6fb-ac326ad97239 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:26.904423 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad5c6f-dd75-4118-b6fb-ac326ad97239 service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:26.914337 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1024/2049] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:26 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:34:26.933571 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1026/2050] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:26 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:26.951629 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad5c6f-dd75-4118-b6fb-ac326ad97239 service cinder] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:26.960400 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad5c6f-dd75-4118-b6fb-ac326ad97239 service cinder] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:27.014245 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983013c8-0c87-4317-8eea-1aef21804bfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:27.015005 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983013c8-0c87-4317-8eea-1aef21804bfa service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:27.015289 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983013c8-0c87-4317-8eea-1aef21804bfa service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:27.015598 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983013c8-0c87-4317-8eea-1aef21804bfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:27.026364 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983013c8-0c87-4317-8eea-1aef21804bfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:27.027777 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983013c8-0c87-4317-8eea-1aef21804bfa service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:27.038179 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1025/2051] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:26 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:34:27.370697 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973f1e8-9089-4f99-8372-3a41587d1de2 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:27.381481 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973f1e8-9089-4f99-8372-3a41587d1de2 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:27.385202 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dca600-9b6e-40b6-9e7c-3c7293d853fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:27.385948 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dca600-9b6e-40b6-9e7c-3c7293d853fc service cinder] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:27.386302 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dca600-9b6e-40b6-9e7c-3c7293d853fc service cinder] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:27.386684 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dca600-9b6e-40b6-9e7c-3c7293d853fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:27.388505 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-77dca600-9b6e-40b6-9e7c-3c7293d853fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:27.454156 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dca600-9b6e-40b6-9e7c-3c7293d853fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:27.455610 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dca600-9b6e-40b6-9e7c-3c7293d853fc service cinder] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:27.465776 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1027/2052] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:27 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:34:29.981033 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983013c8-0c87-4317-8eea-1aef21804bfa service cinder] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:29.982495 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-983013c8-0c87-4317-8eea-1aef21804bfa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:29.993386 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983013c8-0c87-4317-8eea-1aef21804bfa service cinder] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:29.996981 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ea126-4cc5-42f4-bdf3-b1d4df002f20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:29.997631 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ea126-4cc5-42f4-bdf3-b1d4df002f20 service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:29.997912 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ea126-4cc5-42f4-bdf3-b1d4df002f20 service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:29.998183 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ea126-4cc5-42f4-bdf3-b1d4df002f20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:29.999855 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-ec6ea126-4cc5-42f4-bdf3-b1d4df002f20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:30.063136 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ea126-4cc5-42f4-bdf3-b1d4df002f20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:30.064620 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ea126-4cc5-42f4-bdf3-b1d4df002f20 service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:30.076253 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1026/2053] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:29 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:34:31.841534 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dca600-9b6e-40b6-9e7c-3c7293d853fc service cinder] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:31.904730 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dca600-9b6e-40b6-9e7c-3c7293d853fc service cinder] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:31.909436 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfbb07-d730-4afb-9115-aa86e0da1c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:31.910370 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfbb07-d730-4afb-9115-aa86e0da1c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:31.910652 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfbb07-d730-4afb-9115-aa86e0da1c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:31.911226 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfbb07-d730-4afb-9115-aa86e0da1c33 admin admin] PATH_INFO: `/v3/users/98e7492748be44b89de74d14566d3072` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:31.912293 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfbb07-d730-4afb-9115-aa86e0da1c33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98e7492748be44b89de74d14566d3072)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:31.914383 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfbb07-d730-4afb-9115-aa86e0da1c33 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:32.106259 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-e3bfbb07-d730-4afb-9115-aa86e0da1c33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98e7492748be44b89de74d14566d3072'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:32.107023 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-e3bfbb07-d730-4afb-9115-aa86e0da1c33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98e7492748be44b89de74d14566d3072'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:32.113746 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-e3bfbb07-d730-4afb-9115-aa86e0da1c33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98e7492748be44b89de74d14566d3072'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:32.114553 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-e3bfbb07-d730-4afb-9115-aa86e0da1c33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98e7492748be44b89de74d14566d3072'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:32.126453 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-e3bfbb07-d730-4afb-9115-aa86e0da1c33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98e7492748be44b89de74d14566d3072'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:32.187949 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1028/2054] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:34:31 2021] DELETE /identity/v3/users/98e7492748be44b89de74d14566d3072 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:32.192581 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5ecb2-7707-42b4-90ba-a9c9f85597df None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:32.193040 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5ecb2-7707-42b4-90ba-a9c9f85597df None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:32.193170 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5ecb2-7707-42b4-90ba-a9c9f85597df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:32.211753 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-f8a5ecb2-7707-42b4-90ba-a9c9f85597df None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:32.212961 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-f8a5ecb2-7707-42b4-90ba-a9c9f85597df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:32.270873 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1027/2055] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:32.281977 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfbb07-d730-4afb-9115-aa86e0da1c33 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:32.283355 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-e3bfbb07-d730-4afb-9115-aa86e0da1c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:32.340081 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfbb07-d730-4afb-9115-aa86e0da1c33 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:32.343961 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d4cf2-bb2a-4711-be9d-9e568973d252 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:32.344599 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d4cf2-bb2a-4711-be9d-9e568973d252 service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:32.344884 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d4cf2-bb2a-4711-be9d-9e568973d252 service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:32.345160 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d4cf2-bb2a-4711-be9d-9e568973d252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:32.354158 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d4cf2-bb2a-4711-be9d-9e568973d252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:32.355575 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d4cf2-bb2a-4711-be9d-9e568973d252 service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:32.364686 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1029/2056] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:34:32.721366 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5ecb2-7707-42b4-90ba-a9c9f85597df None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:32.725272 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-f8a5ecb2-7707-42b4-90ba-a9c9f85597df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:32.735865 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5ecb2-7707-42b4-90ba-a9c9f85597df None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:32.741140 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c25e1-3541-407e-b4f0-17bae9aa8e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:32.745330 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c25e1-3541-407e-b4f0-17bae9aa8e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:32.745330 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c25e1-3541-407e-b4f0-17bae9aa8e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:32.745330 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c25e1-3541-407e-b4f0-17bae9aa8e18 admin admin] PATH_INFO: `/v3/projects/58b51d4f1c344c87ba70a815b1450701` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:32.745330 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c25e1-3541-407e-b4f0-17bae9aa8e18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58b51d4f1c344c87ba70a815b1450701)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:32.745960 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c25e1-3541-407e-b4f0-17bae9aa8e18 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:32.844475 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-b07c25e1-3541-407e-b4f0-17bae9aa8e18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58b51d4f1c344c87ba70a815b1450701', 'request_id': 'req-b07c25e1-3541-407e-b4f0-17bae9aa8e18'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:32.850048 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-b07c25e1-3541-407e-b4f0-17bae9aa8e18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58b51d4f1c344c87ba70a815b1450701', 'request_id': 'req-b07c25e1-3541-407e-b4f0-17bae9aa8e18'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:32.856115 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-b07c25e1-3541-407e-b4f0-17bae9aa8e18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58b51d4f1c344c87ba70a815b1450701', 'request_id': 'req-b07c25e1-3541-407e-b4f0-17bae9aa8e18'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:32.919663 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-b07c25e1-3541-407e-b4f0-17bae9aa8e18 admin admin] The token cache is being invalidate because project 58b51d4f1c344c87ba70a815b1450701 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:34:32.920057 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-b07c25e1-3541-407e-b4f0-17bae9aa8e18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:32.920688 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-b07c25e1-3541-407e-b4f0-17bae9aa8e18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:32.922298 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1028/2057] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:34:32 2021] DELETE /identity/v3/projects/58b51d4f1c344c87ba70a815b1450701 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:32.926220 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d4cf2-bb2a-4711-be9d-9e568973d252 service neutron] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:32.936464 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d4cf2-bb2a-4711-be9d-9e568973d252 service neutron] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:32.992422 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0cef9-ab7e-4835-ba25-ea6833cfe9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:32.993400 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0cef9-ab7e-4835-ba25-ea6833cfe9f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:32.993716 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0cef9-ab7e-4835-ba25-ea6833cfe9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:32.993991 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0cef9-ab7e-4835-ba25-ea6833cfe9f8 admin admin] PATH_INFO: `/v3/users/934fe1b25a7c451bac113ed9d1111b44` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:32.995182 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0cef9-ab7e-4835-ba25-ea6833cfe9f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=934fe1b25a7c451bac113ed9d1111b44)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:32.997066 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0cef9-ab7e-4835-ba25-ea6833cfe9f8 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:33.156342 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-0cd0cef9-ab7e-4835-ba25-ea6833cfe9f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '934fe1b25a7c451bac113ed9d1111b44'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:33.157007 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-0cd0cef9-ab7e-4835-ba25-ea6833cfe9f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '934fe1b25a7c451bac113ed9d1111b44'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:33.163741 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-0cd0cef9-ab7e-4835-ba25-ea6833cfe9f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '934fe1b25a7c451bac113ed9d1111b44'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:33.164363 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-0cd0cef9-ab7e-4835-ba25-ea6833cfe9f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '934fe1b25a7c451bac113ed9d1111b44'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:33.175886 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-0cd0cef9-ab7e-4835-ba25-ea6833cfe9f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '934fe1b25a7c451bac113ed9d1111b44'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:33.227620 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1030/2058] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:34:32 2021] DELETE /identity/v3/users/934fe1b25a7c451bac113ed9d1111b44 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:33.624790 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c25e1-3541-407e-b4f0-17bae9aa8e18 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:33.626500 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-b07c25e1-3541-407e-b4f0-17bae9aa8e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:33.639474 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c25e1-3541-407e-b4f0-17bae9aa8e18 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:33.696390 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f6f2a-963d-4247-a231-90bc801b7e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:33.697244 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f6f2a-963d-4247-a231-90bc801b7e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:33.697563 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f6f2a-963d-4247-a231-90bc801b7e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:33.697844 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f6f2a-963d-4247-a231-90bc801b7e53 admin admin] PATH_INFO: `/v3/projects/22d82e3212ff4217ac83f1d2c7c124e0` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:33.699032 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f6f2a-963d-4247-a231-90bc801b7e53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22d82e3212ff4217ac83f1d2c7c124e0)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:33.701176 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f6f2a-963d-4247-a231-90bc801b7e53 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:33.828470 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-c26f6f2a-963d-4247-a231-90bc801b7e53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22d82e3212ff4217ac83f1d2c7c124e0', 'request_id': 'req-c26f6f2a-963d-4247-a231-90bc801b7e53'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:33.833844 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-c26f6f2a-963d-4247-a231-90bc801b7e53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22d82e3212ff4217ac83f1d2c7c124e0', 'request_id': 'req-c26f6f2a-963d-4247-a231-90bc801b7e53'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:33.840709 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-c26f6f2a-963d-4247-a231-90bc801b7e53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22d82e3212ff4217ac83f1d2c7c124e0', 'request_id': 'req-c26f6f2a-963d-4247-a231-90bc801b7e53'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:33.895953 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-c26f6f2a-963d-4247-a231-90bc801b7e53 admin admin] The token cache is being invalidate because project 22d82e3212ff4217ac83f1d2c7c124e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:34:33.896241 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-c26f6f2a-963d-4247-a231-90bc801b7e53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:33.897597 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-c26f6f2a-963d-4247-a231-90bc801b7e53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:33.899046 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1029/2059] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:34:33 2021] DELETE /identity/v3/projects/22d82e3212ff4217ac83f1d2c7c124e0 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:33.902996 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0cef9-ab7e-4835-ba25-ea6833cfe9f8 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:33.904465 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-0cd0cef9-ab7e-4835-ba25-ea6833cfe9f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:33.918036 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0cef9-ab7e-4835-ba25-ea6833cfe9f8 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:33.971868 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d3fc9-68cc-4d2f-acd4-4965cfb4943c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:33.972738 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d3fc9-68cc-4d2f-acd4-4965cfb4943c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:33.973016 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d3fc9-68cc-4d2f-acd4-4965cfb4943c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:33.973284 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d3fc9-68cc-4d2f-acd4-4965cfb4943c admin admin] PATH_INFO: `/v3/users/65d5a7b4c7c84bf9bdb926c3bd12c1f4` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:33.974508 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d3fc9-68cc-4d2f-acd4-4965cfb4943c admin admin] RBAC: Authorizing `identity:delete_user(user_id=65d5a7b4c7c84bf9bdb926c3bd12c1f4)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:33.977135 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d3fc9-68cc-4d2f-acd4-4965cfb4943c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:34.204185 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-d11d3fc9-68cc-4d2f-acd4-4965cfb4943c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65d5a7b4c7c84bf9bdb926c3bd12c1f4'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:34.204854 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-d11d3fc9-68cc-4d2f-acd4-4965cfb4943c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65d5a7b4c7c84bf9bdb926c3bd12c1f4'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:34.212736 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-d11d3fc9-68cc-4d2f-acd4-4965cfb4943c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65d5a7b4c7c84bf9bdb926c3bd12c1f4'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:34.213360 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-d11d3fc9-68cc-4d2f-acd4-4965cfb4943c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65d5a7b4c7c84bf9bdb926c3bd12c1f4'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:34.224409 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-d11d3fc9-68cc-4d2f-acd4-4965cfb4943c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65d5a7b4c7c84bf9bdb926c3bd12c1f4'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:34.295992 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1031/2060] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:34:33 2021] DELETE /identity/v3/users/65d5a7b4c7c84bf9bdb926c3bd12c1f4 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:34.762228 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f6f2a-963d-4247-a231-90bc801b7e53 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:34.763623 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-c26f6f2a-963d-4247-a231-90bc801b7e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:34.775900 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f6f2a-963d-4247-a231-90bc801b7e53 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:34.841368 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392dabe6-8b08-40fb-963f-159bda839661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:34.842079 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dabe6-8b08-40fb-963f-159bda839661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:34.842380 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dabe6-8b08-40fb-963f-159bda839661 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:34.842629 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dabe6-8b08-40fb-963f-159bda839661 admin admin] PATH_INFO: `/v3/projects/b8bda7b7e19a453d92dec7cb9cda930f` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:34.843827 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392dabe6-8b08-40fb-963f-159bda839661 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8bda7b7e19a453d92dec7cb9cda930f)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:34.846382 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392dabe6-8b08-40fb-963f-159bda839661 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:35.000198 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-392dabe6-8b08-40fb-963f-159bda839661 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8bda7b7e19a453d92dec7cb9cda930f', 'request_id': 'req-392dabe6-8b08-40fb-963f-159bda839661'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:35.006402 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-392dabe6-8b08-40fb-963f-159bda839661 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8bda7b7e19a453d92dec7cb9cda930f', 'request_id': 'req-392dabe6-8b08-40fb-963f-159bda839661'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:35.013517 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-392dabe6-8b08-40fb-963f-159bda839661 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8bda7b7e19a453d92dec7cb9cda930f', 'request_id': 'req-392dabe6-8b08-40fb-963f-159bda839661'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:35.107567 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-392dabe6-8b08-40fb-963f-159bda839661 admin admin] The token cache is being invalidate because project b8bda7b7e19a453d92dec7cb9cda930f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:34:35.107855 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-392dabe6-8b08-40fb-963f-159bda839661 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:35.108481 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-392dabe6-8b08-40fb-963f-159bda839661 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:35.110007 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1030/2061] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:34:34 2021] DELETE /identity/v3/projects/b8bda7b7e19a453d92dec7cb9cda930f => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:35.117522 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df114912-1c75-44df-bb0b-599c26f88d27 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:35.117978 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df114912-1c75-44df-bb0b-599c26f88d27 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:35.118273 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df114912-1c75-44df-bb0b-599c26f88d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:35.131742 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392dabe6-8b08-40fb-963f-159bda839661 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:35.135414 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-392dabe6-8b08-40fb-963f-159bda839661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:35.137425 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-df114912-1c75-44df-bb0b-599c26f88d27 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:35.138778 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-df114912-1c75-44df-bb0b-599c26f88d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:35.202003 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392dabe6-8b08-40fb-963f-159bda839661 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:35.205545 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1032/2062] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:35.215246 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817984f-6ba5-4a4d-8254-ed15d103c8d6 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:35.215799 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817984f-6ba5-4a4d-8254-ed15d103c8d6 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:35.216110 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817984f-6ba5-4a4d-8254-ed15d103c8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:35.219869 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27604b72-98d0-4a3c-90c7-b7366bdba36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:35.221107 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27604b72-98d0-4a3c-90c7-b7366bdba36b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:35.221668 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27604b72-98d0-4a3c-90c7-b7366bdba36b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:35.222156 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27604b72-98d0-4a3c-90c7-b7366bdba36b admin admin] PATH_INFO: `/v3/users/45f8573c6b8444058cf3a33e24ab1efa` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:35.223808 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27604b72-98d0-4a3c-90c7-b7366bdba36b admin admin] RBAC: Authorizing `identity:delete_user(user_id=45f8573c6b8444058cf3a33e24ab1efa)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:35.226869 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27604b72-98d0-4a3c-90c7-b7366bdba36b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:35.244058 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-e817984f-6ba5-4a4d-8254-ed15d103c8d6 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:35.246705 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-e817984f-6ba5-4a4d-8254-ed15d103c8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:35.254496 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1033/2063] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:35.258947 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817984f-6ba5-4a4d-8254-ed15d103c8d6 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:35.268492 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817984f-6ba5-4a4d-8254-ed15d103c8d6 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:35.274242 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797184ef-c610-4116-a99f-c850f92dd157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:35.274907 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797184ef-c610-4116-a99f-c850f92dd157 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:35.275193 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797184ef-c610-4116-a99f-c850f92dd157 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:35.275472 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797184ef-c610-4116-a99f-c850f92dd157 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:35.276215 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797184ef-c610-4116-a99f-c850f92dd157 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:34:35.276542 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797184ef-c610-4116-a99f-c850f92dd157 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:35.278145 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797184ef-c610-4116-a99f-c850f92dd157 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:35.291377 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1034/2064] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:34:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:34:35.296359 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797184ef-c610-4116-a99f-c850f92dd157 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:35.306266 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797184ef-c610-4116-a99f-c850f92dd157 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:35.311436 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d090db0-3aa6-4209-ae44-d84ac4f09d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:35.312154 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d090db0-3aa6-4209-ae44-d84ac4f09d27 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:35.312611 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d090db0-3aa6-4209-ae44-d84ac4f09d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:35.312890 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d090db0-3aa6-4209-ae44-d84ac4f09d27 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:35.313787 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d090db0-3aa6-4209-ae44-d84ac4f09d27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:35.315670 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d090db0-3aa6-4209-ae44-d84ac4f09d27 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:35.406529 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1035/2065] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:34:35 2021] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:34:35.410757 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d090db0-3aa6-4209-ae44-d84ac4f09d27 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:35.413164 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-27604b72-98d0-4a3c-90c7-b7366bdba36b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45f8573c6b8444058cf3a33e24ab1efa'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:35.413927 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-27604b72-98d0-4a3c-90c7-b7366bdba36b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45f8573c6b8444058cf3a33e24ab1efa'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:35.471919 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d090db0-3aa6-4209-ae44-d84ac4f09d27 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:35.477390 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d6e2a-b622-4f0c-bec2-402539800119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:35.478078 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d6e2a-b622-4f0c-bec2-402539800119 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:35.478361 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d6e2a-b622-4f0c-bec2-402539800119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:35.478641 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d6e2a-b622-4f0c-bec2-402539800119 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:35.479339 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d6e2a-b622-4f0c-bec2-402539800119 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:35.481241 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d6e2a-b622-4f0c-bec2-402539800119 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:35.531343 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-27604b72-98d0-4a3c-90c7-b7366bdba36b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45f8573c6b8444058cf3a33e24ab1efa'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:35.531932 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-27604b72-98d0-4a3c-90c7-b7366bdba36b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45f8573c6b8444058cf3a33e24ab1efa'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:35.544771 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-27604b72-98d0-4a3c-90c7-b7366bdba36b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45f8573c6b8444058cf3a33e24ab1efa'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:35.556662 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1031/2066] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:34:35 2021] DELETE /identity/v3/users/45f8573c6b8444058cf3a33e24ab1efa => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:35.560895 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277ee06-7311-4ea3-82b1-e18c88e6d6b0 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:35.561185 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277ee06-7311-4ea3-82b1-e18c88e6d6b0 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:35.561498 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277ee06-7311-4ea3-82b1-e18c88e6d6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:35.577986 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-1277ee06-7311-4ea3-82b1-e18c88e6d6b0 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:35.579261 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-1277ee06-7311-4ea3-82b1-e18c88e6d6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:35.619470 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1036/2067] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:34:35 2021] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:35.619470 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d6e2a-b622-4f0c-bec2-402539800119 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:35.619470 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-469d6e2a-b622-4f0c-bec2-402539800119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:35.630203 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d6e2a-b622-4f0c-bec2-402539800119 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:35.642768 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1032/2068] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:34:35.654682 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277ee06-7311-4ea3-82b1-e18c88e6d6b0 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:35.656041 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-1277ee06-7311-4ea3-82b1-e18c88e6d6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:35.691729 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73899e80-5695-4e22-89d4-e96456fe2536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:35.692293 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73899e80-5695-4e22-89d4-e96456fe2536 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:35.692977 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73899e80-5695-4e22-89d4-e96456fe2536 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:35.693862 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73899e80-5695-4e22-89d4-e96456fe2536 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:35.695060 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73899e80-5695-4e22-89d4-e96456fe2536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:35.696883 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73899e80-5695-4e22-89d4-e96456fe2536 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:35.714367 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1037/2069] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:35 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:35.715235 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277ee06-7311-4ea3-82b1-e18c88e6d6b0 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:35.715510 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73899e80-5695-4e22-89d4-e96456fe2536 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:35.719374 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e06c0f-fc1e-4e9d-b72c-fcf609f3e559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:35.720021 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e06c0f-fc1e-4e9d-b72c-fcf609f3e559 service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:35.720302 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e06c0f-fc1e-4e9d-b72c-fcf609f3e559 service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:35.720580 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e06c0f-fc1e-4e9d-b72c-fcf609f3e559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:35.726953 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73899e80-5695-4e22-89d4-e96456fe2536 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:35.734698 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ec67d-09ad-400d-89e2-3139963dd7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:35.735539 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ec67d-09ad-400d-89e2-3139963dd7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:35.735921 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ec67d-09ad-400d-89e2-3139963dd7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:35.736329 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ec67d-09ad-400d-89e2-3139963dd7e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:35.736876 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e06c0f-fc1e-4e9d-b72c-fcf609f3e559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:35.737294 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ec67d-09ad-400d-89e2-3139963dd7e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:35.738343 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e06c0f-fc1e-4e9d-b72c-fcf609f3e559 service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:35.739107 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ec67d-09ad-400d-89e2-3139963dd7e0 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:35.753893 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1038/2071] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:35 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:35.754097 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1033/2071] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:34:35.755152 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ec67d-09ad-400d-89e2-3139963dd7e0 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:35.765573 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ec67d-09ad-400d-89e2-3139963dd7e0 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:35.770380 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae6c88-9b10-429b-9a47-3f3c3006644f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:35.771239 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae6c88-9b10-429b-9a47-3f3c3006644f admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:35.772007 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae6c88-9b10-429b-9a47-3f3c3006644f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:35.772294 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae6c88-9b10-429b-9a47-3f3c3006644f admin admin] PATH_INFO: `/v3/projects/2226f93483d94e5b9fb564e4e5fa9306/users/f6aac46ee94f40b2bec57ab6105fb94a/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:35.798351 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae6c88-9b10-429b-9a47-3f3c3006644f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2226f93483d94e5b9fb564e4e5fa9306, user_id=f6aac46ee94f40b2bec57ab6105fb94a, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:35.798821 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae6c88-9b10-429b-9a47-3f3c3006644f admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:35.876858 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1039/2072] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:35 2021] PUT /identity/v3/projects/2226f93483d94e5b9fb564e4e5fa9306/users/f6aac46ee94f40b2bec57ab6105fb94a/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:35.898080 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf8c0c-e541-46cc-9406-1d301a55b17d None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:35.898625 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf8c0c-e541-46cc-9406-1d301a55b17d None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:35.898625 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf8c0c-e541-46cc-9406-1d301a55b17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:35.945872 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-8aaf8c0c-e541-46cc-9406-1d301a55b17d None None] MFA Rules not processed for user `f6aac46ee94f40b2bec57ab6105fb94a`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:35.947158 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-8aaf8c0c-e541-46cc-9406-1d301a55b17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:36.013572 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1034/2073] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:35 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:36.025361 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae6c88-9b10-429b-9a47-3f3c3006644f admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:36.027600 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-e0ae6c88-9b10-429b-9a47-3f3c3006644f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:36.107473 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae6c88-9b10-429b-9a47-3f3c3006644f admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:36.111336 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943bca7-8b61-48d4-ba72-96fb5266217b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:36.112042 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943bca7-8b61-48d4-ba72-96fb5266217b service cinder] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:36.112306 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943bca7-8b61-48d4-ba72-96fb5266217b service cinder] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:36.112577 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943bca7-8b61-48d4-ba72-96fb5266217b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:36.121997 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943bca7-8b61-48d4-ba72-96fb5266217b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:36.123499 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943bca7-8b61-48d4-ba72-96fb5266217b service cinder] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:36.133231 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1040/2074] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:36 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:34:36.242551 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf8c0c-e541-46cc-9406-1d301a55b17d None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:36.244861 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-8aaf8c0c-e541-46cc-9406-1d301a55b17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:36.322820 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf8c0c-e541-46cc-9406-1d301a55b17d None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:36.328609 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f099c1-551d-4b62-98c0-066b2e7f2139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:36.329887 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f099c1-551d-4b62-98c0-066b2e7f2139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:36.330450 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f099c1-551d-4b62-98c0-066b2e7f2139 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:36.330928 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f099c1-551d-4b62-98c0-066b2e7f2139 admin admin] PATH_INFO: `/v3/projects/c376d25cfd0645a1bd0d2dea2e61b14e` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:36.332373 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f099c1-551d-4b62-98c0-066b2e7f2139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c376d25cfd0645a1bd0d2dea2e61b14e)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:36.336017 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f099c1-551d-4b62-98c0-066b2e7f2139 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:36.463549 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-86f099c1-551d-4b62-98c0-066b2e7f2139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c376d25cfd0645a1bd0d2dea2e61b14e', 'request_id': 'req-86f099c1-551d-4b62-98c0-066b2e7f2139'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:36.468715 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-86f099c1-551d-4b62-98c0-066b2e7f2139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c376d25cfd0645a1bd0d2dea2e61b14e', 'request_id': 'req-86f099c1-551d-4b62-98c0-066b2e7f2139'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:36.474687 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-86f099c1-551d-4b62-98c0-066b2e7f2139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c376d25cfd0645a1bd0d2dea2e61b14e', 'request_id': 'req-86f099c1-551d-4b62-98c0-066b2e7f2139'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:36.582814 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-86f099c1-551d-4b62-98c0-066b2e7f2139 admin admin] The token cache is being invalidate because project c376d25cfd0645a1bd0d2dea2e61b14e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:34:36.583197 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-86f099c1-551d-4b62-98c0-066b2e7f2139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:36.584153 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-86f099c1-551d-4b62-98c0-066b2e7f2139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:36.586520 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1035/2075] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:34:36 2021] DELETE /identity/v3/projects/c376d25cfd0645a1bd0d2dea2e61b14e => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:36.592310 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82133316-ad67-42cc-81d8-d197802ce78a None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:36.592604 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82133316-ad67-42cc-81d8-d197802ce78a None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:36.592879 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82133316-ad67-42cc-81d8-d197802ce78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:36.611718 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-82133316-ad67-42cc-81d8-d197802ce78a None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:36.612940 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-82133316-ad67-42cc-81d8-d197802ce78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:36.679330 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1041/2076] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:36.686835 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8580f-b511-45cd-9438-0b54e44aac87 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:36.687195 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8580f-b511-45cd-9438-0b54e44aac87 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:36.687480 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8580f-b511-45cd-9438-0b54e44aac87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:36.706944 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-5fb8580f-b511-45cd-9438-0b54e44aac87 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:36.708178 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-5fb8580f-b511-45cd-9438-0b54e44aac87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:36.717361 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1036/2077] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:34:36.727511 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82133316-ad67-42cc-81d8-d197802ce78a None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:36.737219 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82133316-ad67-42cc-81d8-d197802ce78a None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:36.742893 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f73f6-e57a-4798-b1f7-5d0bbbf4557c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:36.743553 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f73f6-e57a-4798-b1f7-5d0bbbf4557c admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:36.743845 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f73f6-e57a-4798-b1f7-5d0bbbf4557c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:36.744261 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f73f6-e57a-4798-b1f7-5d0bbbf4557c admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:36.744896 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f73f6-e57a-4798-b1f7-5d0bbbf4557c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:34:36.745201 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f73f6-e57a-4798-b1f7-5d0bbbf4557c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:36.746809 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f73f6-e57a-4798-b1f7-5d0bbbf4557c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:36.764046 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1042/2078] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:34:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:34:36.765092 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8580f-b511-45cd-9438-0b54e44aac87 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:36.775613 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8580f-b511-45cd-9438-0b54e44aac87 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:36.780268 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce5408-98a6-4d00-90a4-ec000ff6e025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:36.781545 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce5408-98a6-4d00-90a4-ec000ff6e025 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:36.781545 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce5408-98a6-4d00-90a4-ec000ff6e025 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:36.781545 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce5408-98a6-4d00-90a4-ec000ff6e025 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:36.782169 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce5408-98a6-4d00-90a4-ec000ff6e025 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:36.784256 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce5408-98a6-4d00-90a4-ec000ff6e025 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:36.886870 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1037/2079] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:34:36 2021] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:34:36.891327 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f73f6-e57a-4798-b1f7-5d0bbbf4557c admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:36.911252 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f73f6-e57a-4798-b1f7-5d0bbbf4557c admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:36.935987 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce5408-98a6-4d00-90a4-ec000ff6e025 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:36.955416 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-78ce5408-98a6-4d00-90a4-ec000ff6e025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:37.016012 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52155c7-2366-4f71-b7d8-d211b16ab61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:37.016752 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52155c7-2366-4f71-b7d8-d211b16ab61a admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:37.017036 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52155c7-2366-4f71-b7d8-d211b16ab61a admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:37.018176 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52155c7-2366-4f71-b7d8-d211b16ab61a admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:37.019139 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52155c7-2366-4f71-b7d8-d211b16ab61a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:37.022966 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52155c7-2366-4f71-b7d8-d211b16ab61a admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:37.045272 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce5408-98a6-4d00-90a4-ec000ff6e025 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:37.052452 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90e80a-0509-4b30-acde-fb24c9a4b4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:37.053949 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90e80a-0509-4b30-acde-fb24c9a4b4f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:37.055298 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90e80a-0509-4b30-acde-fb24c9a4b4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:37.055692 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90e80a-0509-4b30-acde-fb24c9a4b4f2 admin admin] PATH_INFO: `/v3/users/2add15a51a4e44f9a15bf41c52d29898` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:37.057067 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90e80a-0509-4b30-acde-fb24c9a4b4f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2add15a51a4e44f9a15bf41c52d29898)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:37.059231 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90e80a-0509-4b30-acde-fb24c9a4b4f2 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:37.127175 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1043/2080] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:34:36 2021] POST /identity/v3/users => generated 288 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:37.135990 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52155c7-2366-4f71-b7d8-d211b16ab61a admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:37.146413 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52155c7-2366-4f71-b7d8-d211b16ab61a admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:37.151162 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53fede-7c34-46d1-9e30-a5ce38d9ad8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:37.152020 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53fede-7c34-46d1-9e30-a5ce38d9ad8e admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:37.152372 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53fede-7c34-46d1-9e30-a5ce38d9ad8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:37.152713 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53fede-7c34-46d1-9e30-a5ce38d9ad8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:37.153597 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53fede-7c34-46d1-9e30-a5ce38d9ad8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:37.155229 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53fede-7c34-46d1-9e30-a5ce38d9ad8e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:37.165711 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1044/2081] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:37 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:34:37.170032 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53fede-7c34-46d1-9e30-a5ce38d9ad8e admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:37.180096 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53fede-7c34-46d1-9e30-a5ce38d9ad8e admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:37.184856 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48473b-800f-49ca-88e4-2a862ec982e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:37.185544 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48473b-800f-49ca-88e4-2a862ec982e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:37.189711 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48473b-800f-49ca-88e4-2a862ec982e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:37.189711 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48473b-800f-49ca-88e4-2a862ec982e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:37.189711 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb48473b-800f-49ca-88e4-2a862ec982e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:37.189711 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb48473b-800f-49ca-88e4-2a862ec982e9 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:37.199562 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1045/2082] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:37 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:37.203876 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48473b-800f-49ca-88e4-2a862ec982e9 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:37.213765 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48473b-800f-49ca-88e4-2a862ec982e9 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:37.218497 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edf16e-f57f-4d30-a011-503020c1c5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:37.219375 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edf16e-f57f-4d30-a011-503020c1c5b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:37.219655 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edf16e-f57f-4d30-a011-503020c1c5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:37.219930 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edf16e-f57f-4d30-a011-503020c1c5b0 admin admin] PATH_INFO: `/v3/projects/c7e49dae43774d24b2cdd1e71deb19f5/users/31a7010463364896ad37154e0dd48edf/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:37.236485 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14edf16e-f57f-4d30-a011-503020c1c5b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7e49dae43774d24b2cdd1e71deb19f5, user_id=31a7010463364896ad37154e0dd48edf, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:37.239241 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14edf16e-f57f-4d30-a011-503020c1c5b0 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:37.308075 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-cc90e80a-0509-4b30-acde-fb24c9a4b4f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2add15a51a4e44f9a15bf41c52d29898'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:37.308758 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-cc90e80a-0509-4b30-acde-fb24c9a4b4f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2add15a51a4e44f9a15bf41c52d29898'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:37.383062 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-cc90e80a-0509-4b30-acde-fb24c9a4b4f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2add15a51a4e44f9a15bf41c52d29898'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:37.383909 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-cc90e80a-0509-4b30-acde-fb24c9a4b4f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2add15a51a4e44f9a15bf41c52d29898'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:37.390101 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1046/2083] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:37 2021] PUT /identity/v3/projects/c7e49dae43774d24b2cdd1e71deb19f5/users/31a7010463364896ad37154e0dd48edf/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:37.392314 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edf16e-f57f-4d30-a011-503020c1c5b0 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:37.401129 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-14edf16e-f57f-4d30-a011-503020c1c5b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:37.410744 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-cc90e80a-0509-4b30-acde-fb24c9a4b4f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2add15a51a4e44f9a15bf41c52d29898'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:37.426812 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1038/2084] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:34:36 2021] DELETE /identity/v3/users/2add15a51a4e44f9a15bf41c52d29898 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:37.432655 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd5c6a-d12b-4cb1-8408-0e6c9f5f0720 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:37.433024 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd5c6a-d12b-4cb1-8408-0e6c9f5f0720 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:37.433429 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd5c6a-d12b-4cb1-8408-0e6c9f5f0720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:37.459866 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-8cbd5c6a-d12b-4cb1-8408-0e6c9f5f0720 None None] MFA Rules not processed for user `31a7010463364896ad37154e0dd48edf`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:37.461097 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-8cbd5c6a-d12b-4cb1-8408-0e6c9f5f0720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:37.481695 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edf16e-f57f-4d30-a011-503020c1c5b0 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:37.530091 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1039/2085] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:37 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:37.531293 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c8f14-ec73-443d-92fa-9e75abf5fc11 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:37.531586 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c8f14-ec73-443d-92fa-9e75abf5fc11 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:37.531859 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c8f14-ec73-443d-92fa-9e75abf5fc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:37.542835 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99772e6c-1a44-4c91-b652-60f1aed2791c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:37.543879 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99772e6c-1a44-4c91-b652-60f1aed2791c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:37.544162 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99772e6c-1a44-4c91-b652-60f1aed2791c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:37.544437 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99772e6c-1a44-4c91-b652-60f1aed2791c admin admin] PATH_INFO: `/v3/users/b2d109441fcc4b87bb41397e0ec4d53f` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:37.545701 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99772e6c-1a44-4c91-b652-60f1aed2791c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2d109441fcc4b87bb41397e0ec4d53f)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:37.547599 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99772e6c-1a44-4c91-b652-60f1aed2791c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:37.549625 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-8d0c8f14-ec73-443d-92fa-9e75abf5fc11 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:37.550832 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-8d0c8f14-ec73-443d-92fa-9e75abf5fc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:37.559360 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1040/2086] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:37.563403 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c8f14-ec73-443d-92fa-9e75abf5fc11 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:37.564382 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-8d0c8f14-ec73-443d-92fa-9e75abf5fc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:37.576374 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c8f14-ec73-443d-92fa-9e75abf5fc11 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:37.580917 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f439e6-6ec3-4ac6-b3ec-1afd6926f63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:37.581601 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f439e6-6ec3-4ac6-b3ec-1afd6926f63e admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:37.581888 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f439e6-6ec3-4ac6-b3ec-1afd6926f63e admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:37.582158 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f439e6-6ec3-4ac6-b3ec-1afd6926f63e admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:37.582856 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f439e6-6ec3-4ac6-b3ec-1afd6926f63e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:37.585366 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f439e6-6ec3-4ac6-b3ec-1afd6926f63e admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:37.707405 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1041/2087] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:34:37 2021] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:37.707405 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f439e6-6ec3-4ac6-b3ec-1afd6926f63e admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:37.707405 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-88f439e6-6ec3-4ac6-b3ec-1afd6926f63e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:37.736681 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-99772e6c-1a44-4c91-b652-60f1aed2791c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2d109441fcc4b87bb41397e0ec4d53f'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:37.737587 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-99772e6c-1a44-4c91-b652-60f1aed2791c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2d109441fcc4b87bb41397e0ec4d53f'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:37.746745 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-99772e6c-1a44-4c91-b652-60f1aed2791c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2d109441fcc4b87bb41397e0ec4d53f'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:37.747584 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-99772e6c-1a44-4c91-b652-60f1aed2791c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2d109441fcc4b87bb41397e0ec4d53f'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:37.765554 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-99772e6c-1a44-4c91-b652-60f1aed2791c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2d109441fcc4b87bb41397e0ec4d53f'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:37.775901 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f439e6-6ec3-4ac6-b3ec-1afd6926f63e admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:37.779588 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe879e3-d3e5-465c-af6f-0c054632a44c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:37.780237 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe879e3-d3e5-465c-af6f-0c054632a44c service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:37.780521 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe879e3-d3e5-465c-af6f-0c054632a44c service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:37.780799 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe879e3-d3e5-465c-af6f-0c054632a44c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:37.782623 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-cbe879e3-d3e5-465c-af6f-0c054632a44c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:37.843995 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe879e3-d3e5-465c-af6f-0c054632a44c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:37.849207 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe879e3-d3e5-465c-af6f-0c054632a44c service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:37.855691 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1042/2088] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:34:37.856453 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe879e3-d3e5-465c-af6f-0c054632a44c service neutron] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:37.857893 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-cbe879e3-d3e5-465c-af6f-0c054632a44c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:37.869790 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe879e3-d3e5-465c-af6f-0c054632a44c service neutron] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:37.874277 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1047/2089] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:34:37 2021] DELETE /identity/v3/users/b2d109441fcc4b87bb41397e0ec4d53f => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:37.877912 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca8cc4-ba40-4dd0-b511-a0d7240bcb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:37.881828 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91dd90-fdaa-4c35-ba2d-44f4a20fe598 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:37.881960 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca8cc4-ba40-4dd0-b511-a0d7240bcb49 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:37.881960 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca8cc4-ba40-4dd0-b511-a0d7240bcb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:37.882133 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91dd90-fdaa-4c35-ba2d-44f4a20fe598 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:37.882214 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca8cc4-ba40-4dd0-b511-a0d7240bcb49 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:37.882309 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91dd90-fdaa-4c35-ba2d-44f4a20fe598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:37.882394 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca8cc4-ba40-4dd0-b511-a0d7240bcb49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:37.882727 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca8cc4-ba40-4dd0-b511-a0d7240bcb49 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:37.898635 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-7a91dd90-fdaa-4c35-ba2d-44f4a20fe598 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:37.899833 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-7a91dd90-fdaa-4c35-ba2d-44f4a20fe598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:37.967072 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1048/2090] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:34:37.967353 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1043/2091] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:34:37 2021] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:37.967797 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91dd90-fdaa-4c35-ba2d-44f4a20fe598 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:37.970179 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca8cc4-ba40-4dd0-b511-a0d7240bcb49 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:37.971979 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-92ca8cc4-ba40-4dd0-b511-a0d7240bcb49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:37.974345 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91dd90-fdaa-4c35-ba2d-44f4a20fe598 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:37.978929 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79665dc5-6a60-4ca6-81fe-ada799ea6cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:37.979578 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79665dc5-6a60-4ca6-81fe-ada799ea6cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:37.979855 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79665dc5-6a60-4ca6-81fe-ada799ea6cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:37.980128 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79665dc5-6a60-4ca6-81fe-ada799ea6cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:37.980865 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79665dc5-6a60-4ca6-81fe-ada799ea6cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:37.982521 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79665dc5-6a60-4ca6-81fe-ada799ea6cd7 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:37.983971 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca8cc4-ba40-4dd0-b511-a0d7240bcb49 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:37.995372 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1049/2092] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:37 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:34:37.996551 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79665dc5-6a60-4ca6-81fe-ada799ea6cd7 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:38.005814 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79665dc5-6a60-4ca6-81fe-ada799ea6cd7 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:38.014149 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e80b3f-7f06-4640-a326-b7dc668e306b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:38.014814 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e80b3f-7f06-4640-a326-b7dc668e306b admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:38.015090 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e80b3f-7f06-4640-a326-b7dc668e306b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:38.015359 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e80b3f-7f06-4640-a326-b7dc668e306b admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:38.016288 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e80b3f-7f06-4640-a326-b7dc668e306b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:38.017915 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e80b3f-7f06-4640-a326-b7dc668e306b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:38.030118 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1050/2093] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:37 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:34:38.034425 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e80b3f-7f06-4640-a326-b7dc668e306b admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:38.036559 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e58218-e0fe-4be1-81eb-276ddb9d25e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:38.037454 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e58218-e0fe-4be1-81eb-276ddb9d25e6 service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:38.037894 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e58218-e0fe-4be1-81eb-276ddb9d25e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:38.038169 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e58218-e0fe-4be1-81eb-276ddb9d25e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:38.045753 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e80b3f-7f06-4640-a326-b7dc668e306b admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:38.048356 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e58218-e0fe-4be1-81eb-276ddb9d25e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:38.049805 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e58218-e0fe-4be1-81eb-276ddb9d25e6 service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:38.051188 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6caa6-d2e8-4ea1-9244-6d5c97ba8bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:38.052428 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6caa6-d2e8-4ea1-9244-6d5c97ba8bee admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:38.052963 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6caa6-d2e8-4ea1-9244-6d5c97ba8bee admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:38.053439 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6caa6-d2e8-4ea1-9244-6d5c97ba8bee admin admin] PATH_INFO: `/v3/projects/63d1266a3862465781548aa97182656a/users/049df69eaecf4ecca38e8a054305df66/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:38.066535 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1044/2094] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:34:38.089439 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6caa6-d2e8-4ea1-9244-6d5c97ba8bee admin admin] RBAC: Authorizing `identity:create_grant(project_id=63d1266a3862465781548aa97182656a, user_id=049df69eaecf4ecca38e8a054305df66, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:38.092389 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6caa6-d2e8-4ea1-9244-6d5c97ba8bee admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:38.183525 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1051/2095] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:38 2021] PUT /identity/v3/projects/63d1266a3862465781548aa97182656a/users/049df69eaecf4ecca38e8a054305df66/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:38.184981 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edbd44-fffa-48dc-9ad4-1da84cba4b46 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:38.185273 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edbd44-fffa-48dc-9ad4-1da84cba4b46 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:38.185588 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edbd44-fffa-48dc-9ad4-1da84cba4b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:38.218468 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-c1edbd44-fffa-48dc-9ad4-1da84cba4b46 None None] MFA Rules not processed for user `049df69eaecf4ecca38e8a054305df66`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:38.219961 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-c1edbd44-fffa-48dc-9ad4-1da84cba4b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:38.286596 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1045/2096] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:38 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:34:38.291169 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6caa6-d2e8-4ea1-9244-6d5c97ba8bee admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:38.360633 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6caa6-d2e8-4ea1-9244-6d5c97ba8bee admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:38.361398 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edbd44-fffa-48dc-9ad4-1da84cba4b46 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:38.362864 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-c1edbd44-fffa-48dc-9ad4-1da84cba4b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:38.366713 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0176cd-7a48-499d-ac29-1c1379335b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:38.367309 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0176cd-7a48-499d-ac29-1c1379335b58 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:38.367595 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0176cd-7a48-499d-ac29-1c1379335b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:38.367866 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0176cd-7a48-499d-ac29-1c1379335b58 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:38.368768 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0176cd-7a48-499d-ac29-1c1379335b58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:38.370744 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0176cd-7a48-499d-ac29-1c1379335b58 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:38.392803 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edbd44-fffa-48dc-9ad4-1da84cba4b46 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:38.405802 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32131e3d-eede-4e1d-914f-0055433ce51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:38.406916 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32131e3d-eede-4e1d-914f-0055433ce51d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:38.407059 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32131e3d-eede-4e1d-914f-0055433ce51d admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:38.407226 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32131e3d-eede-4e1d-914f-0055433ce51d admin admin] PATH_INFO: `/v3/projects/b1b742d7d6cd4560b95273b99d07f2aa` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:38.411029 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32131e3d-eede-4e1d-914f-0055433ce51d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1b742d7d6cd4560b95273b99d07f2aa)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:38.417538 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32131e3d-eede-4e1d-914f-0055433ce51d admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:38.462316 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1052/2097] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:34:38 2021] POST /identity/v3/projects => generated 375 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:38.467555 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0176cd-7a48-499d-ac29-1c1379335b58 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:38.552647 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-32131e3d-eede-4e1d-914f-0055433ce51d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1b742d7d6cd4560b95273b99d07f2aa', 'request_id': 'req-32131e3d-eede-4e1d-914f-0055433ce51d'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:38.559259 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-32131e3d-eede-4e1d-914f-0055433ce51d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1b742d7d6cd4560b95273b99d07f2aa', 'request_id': 'req-32131e3d-eede-4e1d-914f-0055433ce51d'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:38.567603 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-32131e3d-eede-4e1d-914f-0055433ce51d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1b742d7d6cd4560b95273b99d07f2aa', 'request_id': 'req-32131e3d-eede-4e1d-914f-0055433ce51d'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:38.569142 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0176cd-7a48-499d-ac29-1c1379335b58 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:38.639811 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-32131e3d-eede-4e1d-914f-0055433ce51d admin admin] The token cache is being invalidate because project b1b742d7d6cd4560b95273b99d07f2aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:34:38.640421 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-32131e3d-eede-4e1d-914f-0055433ce51d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:38.642315 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-32131e3d-eede-4e1d-914f-0055433ce51d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:38.643294 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1046/2098] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:34:38 2021] DELETE /identity/v3/projects/b1b742d7d6cd4560b95273b99d07f2aa => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:38.643865 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32131e3d-eede-4e1d-914f-0055433ce51d admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:38.645139 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-32131e3d-eede-4e1d-914f-0055433ce51d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:38.651061 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c6ea8-b2f9-423f-afe6-da303a0789bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:38.651779 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c6ea8-b2f9-423f-afe6-da303a0789bc admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:38.652068 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c6ea8-b2f9-423f-afe6-da303a0789bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:38.652343 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c6ea8-b2f9-423f-afe6-da303a0789bc admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:38.653046 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c6ea8-b2f9-423f-afe6-da303a0789bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:38.654988 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c6ea8-b2f9-423f-afe6-da303a0789bc admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:38.659249 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32131e3d-eede-4e1d-914f-0055433ce51d admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:38.665011 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d255589-5af5-4a11-82a6-485b5ce657af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:38.677659 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d255589-5af5-4a11-82a6-485b5ce657af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:38.677659 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d255589-5af5-4a11-82a6-485b5ce657af admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:38.677659 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d255589-5af5-4a11-82a6-485b5ce657af admin admin] PATH_INFO: `/v3/projects/f10ec19eeb9644d691133393f4700520` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:38.677659 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d255589-5af5-4a11-82a6-485b5ce657af admin admin] RBAC: Authorizing `identity:delete_project(project_id=f10ec19eeb9644d691133393f4700520)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:38.677659 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d255589-5af5-4a11-82a6-485b5ce657af admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:38.743366 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1053/2099] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:34:38 2021] POST /identity/v3/users => generated 294 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:38.744434 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c6ea8-b2f9-423f-afe6-da303a0789bc admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:38.746028 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-f69c6ea8-b2f9-423f-afe6-da303a0789bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:38.758170 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c6ea8-b2f9-423f-afe6-da303a0789bc admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:38.762947 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691400bf-65f1-421f-a441-14967e8ab391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:38.763811 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691400bf-65f1-421f-a441-14967e8ab391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:38.764134 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691400bf-65f1-421f-a441-14967e8ab391 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:38.764402 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691400bf-65f1-421f-a441-14967e8ab391 admin admin] PATH_INFO: `/v3/users/cef626cddbf3482a94c43b0322da216f` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:38.768112 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691400bf-65f1-421f-a441-14967e8ab391 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cef626cddbf3482a94c43b0322da216f)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:38.768112 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691400bf-65f1-421f-a441-14967e8ab391 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:38.778164 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4d255589-5af5-4a11-82a6-485b5ce657af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f10ec19eeb9644d691133393f4700520', 'request_id': 'req-4d255589-5af5-4a11-82a6-485b5ce657af'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:38.783516 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4d255589-5af5-4a11-82a6-485b5ce657af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f10ec19eeb9644d691133393f4700520', 'request_id': 'req-4d255589-5af5-4a11-82a6-485b5ce657af'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:38.790354 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4d255589-5af5-4a11-82a6-485b5ce657af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f10ec19eeb9644d691133393f4700520', 'request_id': 'req-4d255589-5af5-4a11-82a6-485b5ce657af'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:38.890471 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4d255589-5af5-4a11-82a6-485b5ce657af admin admin] The token cache is being invalidate because project f10ec19eeb9644d691133393f4700520 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:34:38.890772 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4d255589-5af5-4a11-82a6-485b5ce657af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:38.891417 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4d255589-5af5-4a11-82a6-485b5ce657af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:38.892959 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1047/2100] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:34:38 2021] DELETE /identity/v3/projects/f10ec19eeb9644d691133393f4700520 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:38.893751 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d255589-5af5-4a11-82a6-485b5ce657af admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:38.895411 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-4d255589-5af5-4a11-82a6-485b5ce657af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:38.991422 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d255589-5af5-4a11-82a6-485b5ce657af admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:38.997669 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67c484-34dc-460d-bff3-35c0125100bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:38.998371 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67c484-34dc-460d-bff3-35c0125100bb admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:38.998657 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67c484-34dc-460d-bff3-35c0125100bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:38.998937 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67c484-34dc-460d-bff3-35c0125100bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:38.999699 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e67c484-34dc-460d-bff3-35c0125100bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:39.001592 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e67c484-34dc-460d-bff3-35c0125100bb admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:39.016442 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1048/2101] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:38 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:39.021582 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-691400bf-65f1-421f-a441-14967e8ab391 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cef626cddbf3482a94c43b0322da216f'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:39.021582 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-691400bf-65f1-421f-a441-14967e8ab391 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cef626cddbf3482a94c43b0322da216f'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:39.021820 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67c484-34dc-460d-bff3-35c0125100bb admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:39.021820 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-3e67c484-34dc-460d-bff3-35c0125100bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:39.026459 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-691400bf-65f1-421f-a441-14967e8ab391 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cef626cddbf3482a94c43b0322da216f'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:39.027742 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-691400bf-65f1-421f-a441-14967e8ab391 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cef626cddbf3482a94c43b0322da216f'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:39.036779 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67c484-34dc-460d-bff3-35c0125100bb admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:39.047602 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-691400bf-65f1-421f-a441-14967e8ab391 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cef626cddbf3482a94c43b0322da216f'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:39.064619 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f0edd2-cc1d-44be-ba1c-b51411c3d35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:39.065563 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0edd2-cc1d-44be-ba1c-b51411c3d35b admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:39.065853 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0edd2-cc1d-44be-ba1c-b51411c3d35b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:39.066132 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0edd2-cc1d-44be-ba1c-b51411c3d35b admin admin] PATH_INFO: `/v3/projects/6cd52637ae14420fb9c8b02404e32924/users/9c63decfdc81474bb5daffc6d8cbecf3/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:39.086769 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f0edd2-cc1d-44be-ba1c-b51411c3d35b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cd52637ae14420fb9c8b02404e32924, user_id=9c63decfdc81474bb5daffc6d8cbecf3, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:39.089735 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f0edd2-cc1d-44be-ba1c-b51411c3d35b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:39.114072 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1054/2102] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:34:38 2021] DELETE /identity/v3/users/cef626cddbf3482a94c43b0322da216f => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:39.144020 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1049/2103] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:39 2021] PUT /identity/v3/projects/6cd52637ae14420fb9c8b02404e32924/users/9c63decfdc81474bb5daffc6d8cbecf3/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:39.148768 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691400bf-65f1-421f-a441-14967e8ab391 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:39.217090 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691400bf-65f1-421f-a441-14967e8ab391 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:39.275549 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011fa85-90eb-48a4-861c-e07ba3f78337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:39.276133 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011fa85-90eb-48a4-861c-e07ba3f78337 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:39.276410 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011fa85-90eb-48a4-861c-e07ba3f78337 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:39.276682 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011fa85-90eb-48a4-861c-e07ba3f78337 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:39.277438 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011fa85-90eb-48a4-861c-e07ba3f78337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:39.279142 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011fa85-90eb-48a4-861c-e07ba3f78337 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:39.289097 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1055/2104] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:39 2021] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:34:39.293214 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f0edd2-cc1d-44be-ba1c-b51411c3d35b admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:39.304000 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f0edd2-cc1d-44be-ba1c-b51411c3d35b admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:39.309145 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54c1bd-c3c5-4318-9b60-c5fc45e63017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:39.310067 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54c1bd-c3c5-4318-9b60-c5fc45e63017 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:39.310348 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54c1bd-c3c5-4318-9b60-c5fc45e63017 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:39.310626 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54c1bd-c3c5-4318-9b60-c5fc45e63017 admin admin] PATH_INFO: `/v3/projects/6cd52637ae14420fb9c8b02404e32924/users/9c63decfdc81474bb5daffc6d8cbecf3/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:39.312596 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c54c1bd-c3c5-4318-9b60-c5fc45e63017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cd52637ae14420fb9c8b02404e32924, user_id=9c63decfdc81474bb5daffc6d8cbecf3, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:39.315216 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c54c1bd-c3c5-4318-9b60-c5fc45e63017 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:39.327475 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1050/2105] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:39 2021] PUT /identity/v3/projects/6cd52637ae14420fb9c8b02404e32924/users/9c63decfdc81474bb5daffc6d8cbecf3/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:39.337516 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bc2e9-e818-423d-9319-31a90590131f None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:39.337886 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bc2e9-e818-423d-9319-31a90590131f None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:39.338250 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bc2e9-e818-423d-9319-31a90590131f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:39.378805 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-035bc2e9-e818-423d-9319-31a90590131f None None] MFA Rules not processed for user `9c63decfdc81474bb5daffc6d8cbecf3`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:39.380032 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-035bc2e9-e818-423d-9319-31a90590131f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:39.457115 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1056/2106] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:39 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:39.468538 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54c1bd-c3c5-4318-9b60-c5fc45e63017 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:39.470264 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-2c54c1bd-c3c5-4318-9b60-c5fc45e63017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:39.529299 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54c1bd-c3c5-4318-9b60-c5fc45e63017 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:39.533168 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f8112-5c4d-401e-bac3-d151c7610195 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:39.533841 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f8112-5c4d-401e-bac3-d151c7610195 service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:39.534123 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f8112-5c4d-401e-bac3-d151c7610195 service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:39.534397 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f8112-5c4d-401e-bac3-d151c7610195 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:39.536393 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-768f8112-5c4d-401e-bac3-d151c7610195 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:39.601318 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bc2e9-e818-423d-9319-31a90590131f None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:39.602205 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f8112-5c4d-401e-bac3-d151c7610195 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:39.602765 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-035bc2e9-e818-423d-9319-31a90590131f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:39.603777 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f8112-5c4d-401e-bac3-d151c7610195 service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:39.617486 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1051/2107] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:39 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:34:39.678018 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bc2e9-e818-423d-9319-31a90590131f None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:39.683058 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64072e9c-119e-41a7-accb-8dbb0b45fbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:39.683949 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64072e9c-119e-41a7-accb-8dbb0b45fbd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:39.684234 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64072e9c-119e-41a7-accb-8dbb0b45fbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:39.685070 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64072e9c-119e-41a7-accb-8dbb0b45fbd7 admin admin] PATH_INFO: `/v3/projects/1fa92d08844c446897deca64d27bca7e` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:39.686345 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64072e9c-119e-41a7-accb-8dbb0b45fbd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fa92d08844c446897deca64d27bca7e)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:39.688254 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64072e9c-119e-41a7-accb-8dbb0b45fbd7 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:39.793808 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-64072e9c-119e-41a7-accb-8dbb0b45fbd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fa92d08844c446897deca64d27bca7e', 'request_id': 'req-64072e9c-119e-41a7-accb-8dbb0b45fbd7'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:39.799928 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-64072e9c-119e-41a7-accb-8dbb0b45fbd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fa92d08844c446897deca64d27bca7e', 'request_id': 'req-64072e9c-119e-41a7-accb-8dbb0b45fbd7'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:39.805508 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-64072e9c-119e-41a7-accb-8dbb0b45fbd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fa92d08844c446897deca64d27bca7e', 'request_id': 'req-64072e9c-119e-41a7-accb-8dbb0b45fbd7'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:39.896282 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-64072e9c-119e-41a7-accb-8dbb0b45fbd7 admin admin] The token cache is being invalidate because project 1fa92d08844c446897deca64d27bca7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:34:39.896570 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-64072e9c-119e-41a7-accb-8dbb0b45fbd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:39.897754 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-64072e9c-119e-41a7-accb-8dbb0b45fbd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:39.899330 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1057/2108] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:34:39 2021] DELETE /identity/v3/projects/1fa92d08844c446897deca64d27bca7e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:39.905069 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90886cb1-14d4-4ffb-a9b2-5389028528ed None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:39.905387 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90886cb1-14d4-4ffb-a9b2-5389028528ed None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:39.905694 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90886cb1-14d4-4ffb-a9b2-5389028528ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:39.923633 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-90886cb1-14d4-4ffb-a9b2-5389028528ed None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:39.924906 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-90886cb1-14d4-4ffb-a9b2-5389028528ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:39.982727 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1052/2109] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:39.990855 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022f381-9f18-485d-82ea-8126a7dfb4a5 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:39.991447 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022f381-9f18-485d-82ea-8126a7dfb4a5 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:39.991562 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022f381-9f18-485d-82ea-8126a7dfb4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:40.010432 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-4022f381-9f18-485d-82ea-8126a7dfb4a5 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:40.011734 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-4022f381-9f18-485d-82ea-8126a7dfb4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:40.020128 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1058/2110] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:40.025234 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90886cb1-14d4-4ffb-a9b2-5389028528ed None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:40.034499 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90886cb1-14d4-4ffb-a9b2-5389028528ed None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:40.043785 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d844a2b-4c7f-40a6-8a57-6bf33be9c3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:40.043785 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d844a2b-4c7f-40a6-8a57-6bf33be9c3bc admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:40.043785 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d844a2b-4c7f-40a6-8a57-6bf33be9c3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:40.043785 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d844a2b-4c7f-40a6-8a57-6bf33be9c3bc admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:40.044309 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d844a2b-4c7f-40a6-8a57-6bf33be9c3bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:34:40.044309 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d844a2b-4c7f-40a6-8a57-6bf33be9c3bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:40.044309 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d844a2b-4c7f-40a6-8a57-6bf33be9c3bc admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:40.055750 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1053/2111] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:34:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:34:40.059992 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022f381-9f18-485d-82ea-8126a7dfb4a5 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:40.069105 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022f381-9f18-485d-82ea-8126a7dfb4a5 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:40.073849 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb2a03-6282-4bdb-be5a-2e0d9e34e64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:40.074488 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb2a03-6282-4bdb-be5a-2e0d9e34e64d admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:40.074775 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb2a03-6282-4bdb-be5a-2e0d9e34e64d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:40.075048 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb2a03-6282-4bdb-be5a-2e0d9e34e64d admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:40.076028 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb2a03-6282-4bdb-be5a-2e0d9e34e64d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:40.077936 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb2a03-6282-4bdb-be5a-2e0d9e34e64d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:40.167700 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1059/2112] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:34:40 2021] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:40.171661 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d844a2b-4c7f-40a6-8a57-6bf33be9c3bc admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:40.182297 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d844a2b-4c7f-40a6-8a57-6bf33be9c3bc admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:40.249836 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4163943-86c2-4b54-a38b-4c969c8c0706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:40.250608 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4163943-86c2-4b54-a38b-4c969c8c0706 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:40.251027 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4163943-86c2-4b54-a38b-4c969c8c0706 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:40.251334 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4163943-86c2-4b54-a38b-4c969c8c0706 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:40.252056 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4163943-86c2-4b54-a38b-4c969c8c0706 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:40.255285 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4163943-86c2-4b54-a38b-4c969c8c0706 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:40.364981 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1054/2113] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:34:40 2021] POST /identity/v3/users => generated 283 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:40.367069 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb2a03-6282-4bdb-be5a-2e0d9e34e64d admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:40.379231 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb2a03-6282-4bdb-be5a-2e0d9e34e64d admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:40.384667 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef0465-41c8-4250-8d08-6b27734dcbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:40.385516 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef0465-41c8-4250-8d08-6b27734dcbf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:40.385943 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef0465-41c8-4250-8d08-6b27734dcbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:40.386384 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef0465-41c8-4250-8d08-6b27734dcbf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:40.387243 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef0465-41c8-4250-8d08-6b27734dcbf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:40.389013 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef0465-41c8-4250-8d08-6b27734dcbf3 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:40.400400 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1060/2114] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:40 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:40.404510 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4163943-86c2-4b54-a38b-4c969c8c0706 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:40.414590 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4163943-86c2-4b54-a38b-4c969c8c0706 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:40.419337 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f110e39-5127-45fd-9833-e36551b14e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:40.419989 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f110e39-5127-45fd-9833-e36551b14e73 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:40.420279 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f110e39-5127-45fd-9833-e36551b14e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:40.420557 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f110e39-5127-45fd-9833-e36551b14e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:40.421326 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f110e39-5127-45fd-9833-e36551b14e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:40.422926 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f110e39-5127-45fd-9833-e36551b14e73 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:40.432865 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1055/2115] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:40 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:40.436901 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef0465-41c8-4250-8d08-6b27734dcbf3 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:40.447501 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef0465-41c8-4250-8d08-6b27734dcbf3 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:40.452579 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d141af-4e38-4d6e-b80f-c3ab9457371d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:40.453504 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d141af-4e38-4d6e-b80f-c3ab9457371d admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:40.453797 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d141af-4e38-4d6e-b80f-c3ab9457371d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:40.454064 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d141af-4e38-4d6e-b80f-c3ab9457371d admin admin] PATH_INFO: `/v3/projects/8a7d843406eb463d8a6371f625915599/users/b3f75ef954f84064bdbadfa41c70e256/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:40.470191 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d141af-4e38-4d6e-b80f-c3ab9457371d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a7d843406eb463d8a6371f625915599, user_id=b3f75ef954f84064bdbadfa41c70e256, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:40.472787 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d141af-4e38-4d6e-b80f-c3ab9457371d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:40.555177 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1061/2116] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:40 2021] PUT /identity/v3/projects/8a7d843406eb463d8a6371f625915599/users/b3f75ef954f84064bdbadfa41c70e256/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:40.565352 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b72c8-15f7-4e7c-b084-0b58c5224c1c None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:40.565681 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b72c8-15f7-4e7c-b084-0b58c5224c1c None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:40.565987 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b72c8-15f7-4e7c-b084-0b58c5224c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:40.592366 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-7e1b72c8-15f7-4e7c-b084-0b58c5224c1c None None] MFA Rules not processed for user `b3f75ef954f84064bdbadfa41c70e256`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:40.593507 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-7e1b72c8-15f7-4e7c-b084-0b58c5224c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:40.656769 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1056/2117] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:40 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:40.661359 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d141af-4e38-4d6e-b80f-c3ab9457371d admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:40.724255 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d141af-4e38-4d6e-b80f-c3ab9457371d admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:40.729193 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a0cab-593b-4c0b-9ef3-ab9be10b7e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:40.729903 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a0cab-593b-4c0b-9ef3-ab9be10b7e94 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:40.730183 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a0cab-593b-4c0b-9ef3-ab9be10b7e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:40.730455 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a0cab-593b-4c0b-9ef3-ab9be10b7e94 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:40.731163 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a0cab-593b-4c0b-9ef3-ab9be10b7e94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:40.733017 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a0cab-593b-4c0b-9ef3-ab9be10b7e94 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:40.812502 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1062/2118] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:34:40 2021] POST /identity/v3/projects => generated 367 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:40.816632 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b72c8-15f7-4e7c-b084-0b58c5224c1c None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:40.828854 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b72c8-15f7-4e7c-b084-0b58c5224c1c None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:40.883897 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f089f-5a7d-4c17-8c3e-0581c86745dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:40.884475 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f089f-5a7d-4c17-8c3e-0581c86745dc admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:40.884756 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f089f-5a7d-4c17-8c3e-0581c86745dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:40.885032 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f089f-5a7d-4c17-8c3e-0581c86745dc admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:40.885752 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f089f-5a7d-4c17-8c3e-0581c86745dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:40.887633 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f089f-5a7d-4c17-8c3e-0581c86745dc admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:40.942315 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1057/2119] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:34:40 2021] POST /identity/v3/users => generated 290 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:34:40.946417 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a0cab-593b-4c0b-9ef3-ab9be10b7e94 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:40.956748 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a0cab-593b-4c0b-9ef3-ab9be10b7e94 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:40.961440 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e9b52-a6a7-4ef5-b9f1-c5f7aae0daaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:40.962106 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e9b52-a6a7-4ef5-b9f1-c5f7aae0daaf admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:40.962379 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e9b52-a6a7-4ef5-b9f1-c5f7aae0daaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:40.962640 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e9b52-a6a7-4ef5-b9f1-c5f7aae0daaf admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:40.963371 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e9b52-a6a7-4ef5-b9f1-c5f7aae0daaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:40.964992 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e9b52-a6a7-4ef5-b9f1-c5f7aae0daaf admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:40.976030 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1063/2120] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:40 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:40.979839 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f089f-5a7d-4c17-8c3e-0581c86745dc admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:40.989512 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f089f-5a7d-4c17-8c3e-0581c86745dc admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:40.994702 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c125d6-f63f-4c0a-ba22-640d41322796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:40.995600 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c125d6-f63f-4c0a-ba22-640d41322796 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:40.995880 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c125d6-f63f-4c0a-ba22-640d41322796 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:40.996153 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c125d6-f63f-4c0a-ba22-640d41322796 admin admin] PATH_INFO: `/v3/projects/bbf21f5b29024f809c0b01d2912b2a93/users/e3e41489a9454ad5bf3d64b7801c25e4/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:41.010170 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c125d6-f63f-4c0a-ba22-640d41322796 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbf21f5b29024f809c0b01d2912b2a93, user_id=e3e41489a9454ad5bf3d64b7801c25e4, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:41.012801 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c125d6-f63f-4c0a-ba22-640d41322796 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:41.080074 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1058/2121] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:40 2021] PUT /identity/v3/projects/bbf21f5b29024f809c0b01d2912b2a93/users/e3e41489a9454ad5bf3d64b7801c25e4/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:41.084036 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e9b52-a6a7-4ef5-b9f1-c5f7aae0daaf admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:41.093728 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e9b52-a6a7-4ef5-b9f1-c5f7aae0daaf admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:41.148681 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277c9bd-5905-455d-8fcc-1710a53c06d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:41.149262 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277c9bd-5905-455d-8fcc-1710a53c06d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:41.149579 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277c9bd-5905-455d-8fcc-1710a53c06d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:41.149854 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277c9bd-5905-455d-8fcc-1710a53c06d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:41.150587 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277c9bd-5905-455d-8fcc-1710a53c06d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:41.152157 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277c9bd-5905-455d-8fcc-1710a53c06d3 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:41.161521 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1064/2122] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:41 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:41.166298 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c125d6-f63f-4c0a-ba22-640d41322796 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:41.176380 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c125d6-f63f-4c0a-ba22-640d41322796 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:41.181538 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185eb146-78f4-4d96-84ee-de083b788d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:41.182413 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eb146-78f4-4d96-84ee-de083b788d49 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:41.182688 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eb146-78f4-4d96-84ee-de083b788d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:41.182959 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eb146-78f4-4d96-84ee-de083b788d49 admin admin] PATH_INFO: `/v3/projects/bbf21f5b29024f809c0b01d2912b2a93/users/e3e41489a9454ad5bf3d64b7801c25e4/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:41.184911 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185eb146-78f4-4d96-84ee-de083b788d49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbf21f5b29024f809c0b01d2912b2a93, user_id=e3e41489a9454ad5bf3d64b7801c25e4, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:41.187486 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185eb146-78f4-4d96-84ee-de083b788d49 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:41.197300 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1059/2123] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:41 2021] PUT /identity/v3/projects/bbf21f5b29024f809c0b01d2912b2a93/users/e3e41489a9454ad5bf3d64b7801c25e4/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:41.208403 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239e3b9-8a17-46a4-8c05-c10b573dc5e0 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:41.208693 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239e3b9-8a17-46a4-8c05-c10b573dc5e0 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:41.208972 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239e3b9-8a17-46a4-8c05-c10b573dc5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:41.234707 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-0239e3b9-8a17-46a4-8c05-c10b573dc5e0 None None] MFA Rules not processed for user `e3e41489a9454ad5bf3d64b7801c25e4`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:41.235894 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-0239e3b9-8a17-46a4-8c05-c10b573dc5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:41.300089 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1065/2124] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:41 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:41.310767 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185eb146-78f4-4d96-84ee-de083b788d49 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:41.312524 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-185eb146-78f4-4d96-84ee-de083b788d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:41.367647 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185eb146-78f4-4d96-84ee-de083b788d49 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:41.371216 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7715aa-0a20-4830-adb0-c541e0a94afd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:41.371841 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7715aa-0a20-4830-adb0-c541e0a94afd service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:41.372120 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7715aa-0a20-4830-adb0-c541e0a94afd service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:41.372393 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7715aa-0a20-4830-adb0-c541e0a94afd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:41.381272 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7715aa-0a20-4830-adb0-c541e0a94afd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:41.382706 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7715aa-0a20-4830-adb0-c541e0a94afd service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:41.391700 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1060/2125] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:41 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:34:41.574759 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239e3b9-8a17-46a4-8c05-c10b573dc5e0 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:41.584224 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239e3b9-8a17-46a4-8c05-c10b573dc5e0 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:41.588289 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c841a2-177e-415d-9077-b75cee929a54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:41.588919 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c841a2-177e-415d-9077-b75cee929a54 service cinder] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:41.589205 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c841a2-177e-415d-9077-b75cee929a54 service cinder] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:41.589515 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c841a2-177e-415d-9077-b75cee929a54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:41.643291 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c841a2-177e-415d-9077-b75cee929a54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:41.644725 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c841a2-177e-415d-9077-b75cee929a54 service cinder] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:41.654170 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1066/2126] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:41 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:34:44.139427 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7715aa-0a20-4830-adb0-c541e0a94afd service cinder] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:44.148167 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7715aa-0a20-4830-adb0-c541e0a94afd service cinder] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:44.152559 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd554d1-21da-4ff5-bd5d-314f9e263dce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:44.153214 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd554d1-21da-4ff5-bd5d-314f9e263dce service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:44.153741 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd554d1-21da-4ff5-bd5d-314f9e263dce service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:44.154152 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd554d1-21da-4ff5-bd5d-314f9e263dce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:44.155954 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-6fd554d1-21da-4ff5-bd5d-314f9e263dce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:44.224829 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd554d1-21da-4ff5-bd5d-314f9e263dce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:44.226356 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd554d1-21da-4ff5-bd5d-314f9e263dce service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:44.247392 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1061/2127] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:44 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:34:46.168578 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c841a2-177e-415d-9077-b75cee929a54 service cinder] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:46.170149 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-94c841a2-177e-415d-9077-b75cee929a54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:46.181282 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c841a2-177e-415d-9077-b75cee929a54 service cinder] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:46.188531 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f226e5-9ced-4380-a410-d5d558802fa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:46.190608 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f226e5-9ced-4380-a410-d5d558802fa8 service cinder] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:46.190608 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f226e5-9ced-4380-a410-d5d558802fa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:46.190608 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f226e5-9ced-4380-a410-d5d558802fa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:46.191839 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-46f226e5-9ced-4380-a410-d5d558802fa8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:46.261190 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f226e5-9ced-4380-a410-d5d558802fa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:46.262659 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f226e5-9ced-4380-a410-d5d558802fa8 service cinder] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:46.272439 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1067/2128] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:46 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:34:47.154687 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd554d1-21da-4ff5-bd5d-314f9e263dce service cinder] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:47.156137 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-6fd554d1-21da-4ff5-bd5d-314f9e263dce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:47.224002 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd554d1-21da-4ff5-bd5d-314f9e263dce service cinder] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:47.233798 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c554af-bc47-40b0-a653-7738219887ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:47.234935 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c554af-bc47-40b0-a653-7738219887ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:47.235433 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c554af-bc47-40b0-a653-7738219887ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:47.235710 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c554af-bc47-40b0-a653-7738219887ef admin admin] PATH_INFO: `/v3/users/f6aac46ee94f40b2bec57ab6105fb94a` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:47.237843 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c554af-bc47-40b0-a653-7738219887ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6aac46ee94f40b2bec57ab6105fb94a)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:47.240015 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c554af-bc47-40b0-a653-7738219887ef admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:47.439015 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-95c554af-bc47-40b0-a653-7738219887ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6aac46ee94f40b2bec57ab6105fb94a'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:47.439871 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-95c554af-bc47-40b0-a653-7738219887ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6aac46ee94f40b2bec57ab6105fb94a'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:47.554092 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-95c554af-bc47-40b0-a653-7738219887ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6aac46ee94f40b2bec57ab6105fb94a'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:47.554840 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-95c554af-bc47-40b0-a653-7738219887ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6aac46ee94f40b2bec57ab6105fb94a'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:47.566658 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-95c554af-bc47-40b0-a653-7738219887ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6aac46ee94f40b2bec57ab6105fb94a'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:47.578576 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1062/2129] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:34:47 2021] DELETE /identity/v3/users/f6aac46ee94f40b2bec57ab6105fb94a => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:47.583218 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e61169-d0df-4680-8865-eaa8a921ba2c None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:47.583682 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e61169-d0df-4680-8865-eaa8a921ba2c None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:47.583805 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e61169-d0df-4680-8865-eaa8a921ba2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:47.600785 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-31e61169-d0df-4680-8865-eaa8a921ba2c None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:47.602077 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-31e61169-d0df-4680-8865-eaa8a921ba2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:47.663286 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1068/2130] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:47.673383 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c554af-bc47-40b0-a653-7738219887ef admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:47.674797 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-95c554af-bc47-40b0-a653-7738219887ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:47.732968 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c554af-bc47-40b0-a653-7738219887ef admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:47.737327 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b2302-de03-44f1-ad53-aba4976c76f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:47.738063 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b2302-de03-44f1-ad53-aba4976c76f9 service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:47.738351 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b2302-de03-44f1-ad53-aba4976c76f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:47.738626 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b2302-de03-44f1-ad53-aba4976c76f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:47.754172 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b2302-de03-44f1-ad53-aba4976c76f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:47.755476 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b2302-de03-44f1-ad53-aba4976c76f9 service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:47.767566 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1063/2131] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:34:48.260795 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e61169-d0df-4680-8865-eaa8a921ba2c None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:48.263256 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-31e61169-d0df-4680-8865-eaa8a921ba2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:48.293128 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e61169-d0df-4680-8865-eaa8a921ba2c None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:48.297389 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404f600-4552-47d8-9711-ac9f6821ec0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:48.298298 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404f600-4552-47d8-9711-ac9f6821ec0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:48.298758 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404f600-4552-47d8-9711-ac9f6821ec0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:48.303351 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404f600-4552-47d8-9711-ac9f6821ec0e admin admin] PATH_INFO: `/v3/projects/2226f93483d94e5b9fb564e4e5fa9306` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:48.303351 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404f600-4552-47d8-9711-ac9f6821ec0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2226f93483d94e5b9fb564e4e5fa9306)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:48.303351 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404f600-4552-47d8-9711-ac9f6821ec0e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:48.447202 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-5404f600-4552-47d8-9711-ac9f6821ec0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2226f93483d94e5b9fb564e4e5fa9306', 'request_id': 'req-5404f600-4552-47d8-9711-ac9f6821ec0e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:48.453626 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-5404f600-4552-47d8-9711-ac9f6821ec0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2226f93483d94e5b9fb564e4e5fa9306', 'request_id': 'req-5404f600-4552-47d8-9711-ac9f6821ec0e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:48.459168 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-5404f600-4552-47d8-9711-ac9f6821ec0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2226f93483d94e5b9fb564e4e5fa9306', 'request_id': 'req-5404f600-4552-47d8-9711-ac9f6821ec0e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:48.577227 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-5404f600-4552-47d8-9711-ac9f6821ec0e admin admin] The token cache is being invalidate because project 2226f93483d94e5b9fb564e4e5fa9306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:34:48.577561 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-5404f600-4552-47d8-9711-ac9f6821ec0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:48.578188 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-5404f600-4552-47d8-9711-ac9f6821ec0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:48.579757 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1069/2132] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:34:48 2021] DELETE /identity/v3/projects/2226f93483d94e5b9fb564e4e5fa9306 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:48.586651 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6adeec-bcb6-44fd-adb3-2e693af64367 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:48.587129 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6adeec-bcb6-44fd-adb3-2e693af64367 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:48.587278 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6adeec-bcb6-44fd-adb3-2e693af64367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:48.605075 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-6f6adeec-bcb6-44fd-adb3-2e693af64367 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:48.606370 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-6f6adeec-bcb6-44fd-adb3-2e693af64367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:48.664640 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1064/2133] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:48.672326 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cf285-7830-4941-98d1-f28a3f6f704c None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:48.672861 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cf285-7830-4941-98d1-f28a3f6f704c None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:48.677287 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cf285-7830-4941-98d1-f28a3f6f704c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:48.690955 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-090cf285-7830-4941-98d1-f28a3f6f704c None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:48.692151 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-090cf285-7830-4941-98d1-f28a3f6f704c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:48.701281 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1070/2134] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:48.705024 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6adeec-bcb6-44fd-adb3-2e693af64367 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:48.715274 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6adeec-bcb6-44fd-adb3-2e693af64367 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:48.720141 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa311bd-7b70-4aac-8f24-13b895df58c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:48.720811 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa311bd-7b70-4aac-8f24-13b895df58c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:48.721092 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa311bd-7b70-4aac-8f24-13b895df58c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:48.721367 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa311bd-7b70-4aac-8f24-13b895df58c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:48.722138 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa311bd-7b70-4aac-8f24-13b895df58c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:34:48.722445 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa311bd-7b70-4aac-8f24-13b895df58c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:48.724039 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa311bd-7b70-4aac-8f24-13b895df58c8 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:48.737490 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1065/2135] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:34:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:34:48.742655 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090cf285-7830-4941-98d1-f28a3f6f704c None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:48.753395 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090cf285-7830-4941-98d1-f28a3f6f704c None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:48.758823 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd9491-73f6-4915-86ed-1018552b38e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:48.759478 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd9491-73f6-4915-86ed-1018552b38e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:48.759759 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd9491-73f6-4915-86ed-1018552b38e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:48.760031 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd9491-73f6-4915-86ed-1018552b38e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:48.760751 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd9491-73f6-4915-86ed-1018552b38e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:48.762687 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd9491-73f6-4915-86ed-1018552b38e2 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:48.887510 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1071/2136] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:34:48 2021] POST /identity/v3/projects => generated 361 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:34:48.888692 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa311bd-7b70-4aac-8f24-13b895df58c8 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:48.899171 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa311bd-7b70-4aac-8f24-13b895df58c8 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:48.960893 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127af7ee-3929-49c0-97ac-3d759c94c26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:48.960893 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127af7ee-3929-49c0-97ac-3d759c94c26e admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:48.960893 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127af7ee-3929-49c0-97ac-3d759c94c26e admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:48.960893 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127af7ee-3929-49c0-97ac-3d759c94c26e admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:48.961940 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127af7ee-3929-49c0-97ac-3d759c94c26e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:48.961940 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127af7ee-3929-49c0-97ac-3d759c94c26e admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:49.081226 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1066/2137] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:34:48 2021] POST /identity/v3/users => generated 281 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:49.084887 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd9491-73f6-4915-86ed-1018552b38e2 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:49.096829 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd9491-73f6-4915-86ed-1018552b38e2 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:49.104604 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488bccaf-6006-46cd-856d-9301fb664d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:49.105681 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bccaf-6006-46cd-856d-9301fb664d14 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:49.105971 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bccaf-6006-46cd-856d-9301fb664d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:49.106262 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bccaf-6006-46cd-856d-9301fb664d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:49.107092 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488bccaf-6006-46cd-856d-9301fb664d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:49.109043 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488bccaf-6006-46cd-856d-9301fb664d14 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:49.122386 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1072/2138] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:49 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:34:49.125927 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127af7ee-3929-49c0-97ac-3d759c94c26e admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:49.138210 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127af7ee-3929-49c0-97ac-3d759c94c26e admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:49.139833 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488bccaf-6006-46cd-856d-9301fb664d14 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:49.144370 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ec0ef-034f-4f10-afc7-a05de7bce1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:49.145157 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ec0ef-034f-4f10-afc7-a05de7bce1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:49.145779 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ec0ef-034f-4f10-afc7-a05de7bce1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:49.145908 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ec0ef-034f-4f10-afc7-a05de7bce1a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:49.146934 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-488bccaf-6006-46cd-856d-9301fb664d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:49.147255 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7ec0ef-034f-4f10-afc7-a05de7bce1a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:49.149150 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7ec0ef-034f-4f10-afc7-a05de7bce1a0 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:49.163687 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1067/2139] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:49 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:49.165133 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ec0ef-034f-4f10-afc7-a05de7bce1a0 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:49.171317 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488bccaf-6006-46cd-856d-9301fb664d14 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:49.176302 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb0856-2a9d-4710-99d6-78627711fae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:49.178590 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb0856-2a9d-4710-99d6-78627711fae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:49.178590 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb0856-2a9d-4710-99d6-78627711fae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:49.178590 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb0856-2a9d-4710-99d6-78627711fae2 admin admin] PATH_INFO: `/v3/users/b3f75ef954f84064bdbadfa41c70e256` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:49.179704 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb0856-2a9d-4710-99d6-78627711fae2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3f75ef954f84064bdbadfa41c70e256)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:49.181892 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb0856-2a9d-4710-99d6-78627711fae2 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:49.185554 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ec0ef-034f-4f10-afc7-a05de7bce1a0 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:49.198952 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73996a-6596-4e61-bae2-8335c4c88a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:49.199956 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73996a-6596-4e61-bae2-8335c4c88a0b admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:49.200235 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73996a-6596-4e61-bae2-8335c4c88a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:49.200513 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73996a-6596-4e61-bae2-8335c4c88a0b admin admin] PATH_INFO: `/v3/projects/65117d1561be4d2b8f13c0e585cef28e/users/05b3a10d643742f7a69b273fd0f683cd/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:49.222698 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73996a-6596-4e61-bae2-8335c4c88a0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=65117d1561be4d2b8f13c0e585cef28e, user_id=05b3a10d643742f7a69b273fd0f683cd, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:49.225329 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73996a-6596-4e61-bae2-8335c4c88a0b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:49.302881 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1068/2140] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:49 2021] PUT /identity/v3/projects/65117d1561be4d2b8f13c0e585cef28e/users/05b3a10d643742f7a69b273fd0f683cd/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:49.312850 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef61c76-80e3-4198-aa7f-328e90a807d4 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:49.313143 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef61c76-80e3-4198-aa7f-328e90a807d4 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:49.313431 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef61c76-80e3-4198-aa7f-328e90a807d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:49.343987 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-8ef61c76-80e3-4198-aa7f-328e90a807d4 None None] MFA Rules not processed for user `05b3a10d643742f7a69b273fd0f683cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:49.346196 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-8ef61c76-80e3-4198-aa7f-328e90a807d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:49.406951 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-a0eb0856-2a9d-4710-99d6-78627711fae2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3f75ef954f84064bdbadfa41c70e256'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:49.407875 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-a0eb0856-2a9d-4710-99d6-78627711fae2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3f75ef954f84064bdbadfa41c70e256'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:49.415871 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-a0eb0856-2a9d-4710-99d6-78627711fae2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3f75ef954f84064bdbadfa41c70e256'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:49.416635 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-a0eb0856-2a9d-4710-99d6-78627711fae2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3f75ef954f84064bdbadfa41c70e256'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:49.426076 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1069/2141] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:49 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:34:49.429904 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-a0eb0856-2a9d-4710-99d6-78627711fae2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3f75ef954f84064bdbadfa41c70e256'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:49.461580 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef61c76-80e3-4198-aa7f-328e90a807d4 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:49.463216 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-8ef61c76-80e3-4198-aa7f-328e90a807d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:49.510357 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1073/2142] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:34:49 2021] DELETE /identity/v3/users/b3f75ef954f84064bdbadfa41c70e256 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:49.515098 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcdaad-3b16-4c93-ba5f-97a80ac395e5 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:49.515383 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcdaad-3b16-4c93-ba5f-97a80ac395e5 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:49.515658 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcdaad-3b16-4c93-ba5f-97a80ac395e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:49.534438 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-4ddcdaad-3b16-4c93-ba5f-97a80ac395e5 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:49.535632 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-4ddcdaad-3b16-4c93-ba5f-97a80ac395e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:49.655976 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef61c76-80e3-4198-aa7f-328e90a807d4 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:49.707374 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b84d7d-d7ee-4f85-976a-7346a6110305 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:49.708037 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b84d7d-d7ee-4f85-976a-7346a6110305 service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:49.708313 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b84d7d-d7ee-4f85-976a-7346a6110305 service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:49.708574 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b84d7d-d7ee-4f85-976a-7346a6110305 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:49.744611 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1074/2143] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:49.755016 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcdaad-3b16-4c93-ba5f-97a80ac395e5 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:49.756390 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-4ddcdaad-3b16-4c93-ba5f-97a80ac395e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:49.770338 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b84d7d-d7ee-4f85-976a-7346a6110305 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:49.771830 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b84d7d-d7ee-4f85-976a-7346a6110305 service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:49.781014 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1070/2144] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:49 2021] GET /identity/v3/auth/tokens => generated 3228 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:34:49.795140 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b84d7d-d7ee-4f85-976a-7346a6110305 service cinder] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:49.796546 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-86b84d7d-d7ee-4f85-976a-7346a6110305 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:49.815896 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b84d7d-d7ee-4f85-976a-7346a6110305 service cinder] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:49.822537 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51ef83-3520-41ab-8596-0ce09f8dda10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:49.824239 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51ef83-3520-41ab-8596-0ce09f8dda10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:49.824239 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51ef83-3520-41ab-8596-0ce09f8dda10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:49.824239 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51ef83-3520-41ab-8596-0ce09f8dda10 admin admin] PATH_INFO: `/v3/users/05b3a10d643742f7a69b273fd0f683cd` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:49.825580 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51ef83-3520-41ab-8596-0ce09f8dda10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05b3a10d643742f7a69b273fd0f683cd)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:49.827785 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51ef83-3520-41ab-8596-0ce09f8dda10 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:49.834965 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcdaad-3b16-4c93-ba5f-97a80ac395e5 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:49.841519 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b40a87-bc47-4252-8a30-b07ff17cd747 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:49.842177 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b40a87-bc47-4252-8a30-b07ff17cd747 service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:49.843519 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b40a87-bc47-4252-8a30-b07ff17cd747 service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:49.843519 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b40a87-bc47-4252-8a30-b07ff17cd747 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:49.855775 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b40a87-bc47-4252-8a30-b07ff17cd747 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:49.857364 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b40a87-bc47-4252-8a30-b07ff17cd747 service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:49.867336 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1075/2145] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:34:49.872173 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b40a87-bc47-4252-8a30-b07ff17cd747 service neutron] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:49.872173 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-a1b40a87-bc47-4252-8a30-b07ff17cd747 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:49.884771 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b40a87-bc47-4252-8a30-b07ff17cd747 service neutron] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:49.889858 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0359e-a176-4813-b8b1-8b7092157679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:49.891063 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0359e-a176-4813-b8b1-8b7092157679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:49.891549 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0359e-a176-4813-b8b1-8b7092157679 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:49.892183 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0359e-a176-4813-b8b1-8b7092157679 admin admin] PATH_INFO: `/v3/users/b034e29cb93348b38688f6f02c328cdb` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:49.894198 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0359e-a176-4813-b8b1-8b7092157679 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b034e29cb93348b38688f6f02c328cdb)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:49.903602 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0359e-a176-4813-b8b1-8b7092157679 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:49.974334 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-ae51ef83-3520-41ab-8596-0ce09f8dda10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05b3a10d643742f7a69b273fd0f683cd'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:49.975003 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-ae51ef83-3520-41ab-8596-0ce09f8dda10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05b3a10d643742f7a69b273fd0f683cd'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:50.091694 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-ae51ef83-3520-41ab-8596-0ce09f8dda10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05b3a10d643742f7a69b273fd0f683cd'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:50.092943 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-ae51ef83-3520-41ab-8596-0ce09f8dda10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05b3a10d643742f7a69b273fd0f683cd'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:50.107702 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-ae51ef83-3520-41ab-8596-0ce09f8dda10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05b3a10d643742f7a69b273fd0f683cd'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:50.111602 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-6cf0359e-a176-4813-b8b1-8b7092157679 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b034e29cb93348b38688f6f02c328cdb'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:50.112342 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-6cf0359e-a176-4813-b8b1-8b7092157679 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b034e29cb93348b38688f6f02c328cdb'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:50.121347 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1071/2146] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:34:49 2021] DELETE /identity/v3/users/05b3a10d643742f7a69b273fd0f683cd => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:50.121561 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-6cf0359e-a176-4813-b8b1-8b7092157679 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b034e29cb93348b38688f6f02c328cdb'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:50.122205 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-6cf0359e-a176-4813-b8b1-8b7092157679 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b034e29cb93348b38688f6f02c328cdb'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:50.125511 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06917e-0b96-4aa9-91f6-fffcb278ced4 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:50.132854 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06917e-0b96-4aa9-91f6-fffcb278ced4 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:50.132854 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06917e-0b96-4aa9-91f6-fffcb278ced4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:50.135887 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-6cf0359e-a176-4813-b8b1-8b7092157679 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b034e29cb93348b38688f6f02c328cdb'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:50.145942 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-5d06917e-0b96-4aa9-91f6-fffcb278ced4 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:50.147209 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-5d06917e-0b96-4aa9-91f6-fffcb278ced4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:50.225754 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1072/2147] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:34:50.227275 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1076/2148] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:34:49 2021] DELETE /identity/v3/users/b034e29cb93348b38688f6f02c328cdb => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:50.247186 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06917e-0b96-4aa9-91f6-fffcb278ced4 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:50.252814 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-5d06917e-0b96-4aa9-91f6-fffcb278ced4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:50.330365 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06917e-0b96-4aa9-91f6-fffcb278ced4 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:50.378996 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0359e-a176-4813-b8b1-8b7092157679 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:50.381500 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-6cf0359e-a176-4813-b8b1-8b7092157679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:50.434460 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0819cef-1d37-402b-8b35-22f15382dd61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:50.436373 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0819cef-1d37-402b-8b35-22f15382dd61 service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:50.436787 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0819cef-1d37-402b-8b35-22f15382dd61 service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:50.437185 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0819cef-1d37-402b-8b35-22f15382dd61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:50.502351 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0359e-a176-4813-b8b1-8b7092157679 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:50.507600 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2851db-3300-45f6-9fd3-b4aa9a898602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:50.509032 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2851db-3300-45f6-9fd3-b4aa9a898602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:50.509694 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2851db-3300-45f6-9fd3-b4aa9a898602 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:50.509979 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2851db-3300-45f6-9fd3-b4aa9a898602 admin admin] PATH_INFO: `/v3/projects/8a7d843406eb463d8a6371f625915599` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:50.511318 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2851db-3300-45f6-9fd3-b4aa9a898602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a7d843406eb463d8a6371f625915599)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:50.514685 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2851db-3300-45f6-9fd3-b4aa9a898602 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:50.522785 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0819cef-1d37-402b-8b35-22f15382dd61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:50.524399 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0819cef-1d37-402b-8b35-22f15382dd61 service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:50.534443 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1073/2149] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:34:50.605126 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0819cef-1d37-402b-8b35-22f15382dd61 service neutron] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:50.606714 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-d0819cef-1d37-402b-8b35-22f15382dd61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:50.638017 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0819cef-1d37-402b-8b35-22f15382dd61 service neutron] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:50.645284 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c44955-8d83-4514-9618-5274031febbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:50.646178 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c44955-8d83-4514-9618-5274031febbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:50.646487 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c44955-8d83-4514-9618-5274031febbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:50.649274 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c44955-8d83-4514-9618-5274031febbf admin admin] PATH_INFO: `/v3/projects/69ab6d68b3f1442f9785568cd27eb367` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:50.649274 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c44955-8d83-4514-9618-5274031febbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=69ab6d68b3f1442f9785568cd27eb367)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:50.650523 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c44955-8d83-4514-9618-5274031febbf admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:50.686323 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-fb2851db-3300-45f6-9fd3-b4aa9a898602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a7d843406eb463d8a6371f625915599', 'request_id': 'req-fb2851db-3300-45f6-9fd3-b4aa9a898602'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:50.692634 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-fb2851db-3300-45f6-9fd3-b4aa9a898602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a7d843406eb463d8a6371f625915599', 'request_id': 'req-fb2851db-3300-45f6-9fd3-b4aa9a898602'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:50.698739 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-fb2851db-3300-45f6-9fd3-b4aa9a898602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a7d843406eb463d8a6371f625915599', 'request_id': 'req-fb2851db-3300-45f6-9fd3-b4aa9a898602'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:50.778242 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-78c44955-8d83-4514-9618-5274031febbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69ab6d68b3f1442f9785568cd27eb367', 'request_id': 'req-78c44955-8d83-4514-9618-5274031febbf'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:50.784225 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-78c44955-8d83-4514-9618-5274031febbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69ab6d68b3f1442f9785568cd27eb367', 'request_id': 'req-78c44955-8d83-4514-9618-5274031febbf'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:50.790899 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-78c44955-8d83-4514-9618-5274031febbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69ab6d68b3f1442f9785568cd27eb367', 'request_id': 'req-78c44955-8d83-4514-9618-5274031febbf'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:50.824034 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-fb2851db-3300-45f6-9fd3-b4aa9a898602 admin admin] The token cache is being invalidate because project 8a7d843406eb463d8a6371f625915599 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:34:50.824502 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-fb2851db-3300-45f6-9fd3-b4aa9a898602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:50.824967 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-fb2851db-3300-45f6-9fd3-b4aa9a898602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:50.827457 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1077/2150] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:34:50 2021] DELETE /identity/v3/projects/8a7d843406eb463d8a6371f625915599 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:50.831673 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2851db-3300-45f6-9fd3-b4aa9a898602 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:50.833636 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-fb2851db-3300-45f6-9fd3-b4aa9a898602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:50.904198 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-78c44955-8d83-4514-9618-5274031febbf admin admin] The token cache is being invalidate because project 69ab6d68b3f1442f9785568cd27eb367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:34:50.904536 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-78c44955-8d83-4514-9618-5274031febbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:50.905166 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-78c44955-8d83-4514-9618-5274031febbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:50.907211 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1074/2151] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:34:50 2021] DELETE /identity/v3/projects/69ab6d68b3f1442f9785568cd27eb367 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:50.913978 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd4ec0-52b7-421d-b85b-72672bc9ffda None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:50.919532 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2851db-3300-45f6-9fd3-b4aa9a898602 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:50.919727 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd4ec0-52b7-421d-b85b-72672bc9ffda None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:50.920072 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd4ec0-52b7-421d-b85b-72672bc9ffda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:50.943381 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-09fd4ec0-52b7-421d-b85b-72672bc9ffda None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:50.948083 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-09fd4ec0-52b7-421d-b85b-72672bc9ffda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:50.985719 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc4e86-a1a4-485c-a05b-0171dfa4fa8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:50.986864 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc4e86-a1a4-485c-a05b-0171dfa4fa8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:50.987069 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc4e86-a1a4-485c-a05b-0171dfa4fa8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:50.987297 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc4e86-a1a4-485c-a05b-0171dfa4fa8f admin admin] PATH_INFO: `/v3/users/e3e41489a9454ad5bf3d64b7801c25e4` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:50.989869 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc4e86-a1a4-485c-a05b-0171dfa4fa8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3e41489a9454ad5bf3d64b7801c25e4)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:50.991756 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc4e86-a1a4-485c-a05b-0171dfa4fa8f admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:51.016261 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1075/2152] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:51.050014 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd4ec0-52b7-421d-b85b-72672bc9ffda None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:51.051746 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-09fd4ec0-52b7-421d-b85b-72672bc9ffda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:51.067810 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd4ec0-52b7-421d-b85b-72672bc9ffda None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:51.073980 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ff3b5-cffe-479c-8378-83e849c0b512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:51.075884 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ff3b5-cffe-479c-8378-83e849c0b512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:51.076686 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ff3b5-cffe-479c-8378-83e849c0b512 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:51.076686 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ff3b5-cffe-479c-8378-83e849c0b512 admin admin] PATH_INFO: `/v3/projects/65117d1561be4d2b8f13c0e585cef28e` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:51.077834 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ff3b5-cffe-479c-8378-83e849c0b512 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65117d1561be4d2b8f13c0e585cef28e)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:51.080085 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ff3b5-cffe-479c-8378-83e849c0b512 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:51.146211 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-e6cc4e86-a1a4-485c-a05b-0171dfa4fa8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3e41489a9454ad5bf3d64b7801c25e4'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:51.146882 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-e6cc4e86-a1a4-485c-a05b-0171dfa4fa8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3e41489a9454ad5bf3d64b7801c25e4'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:51.154406 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-e6cc4e86-a1a4-485c-a05b-0171dfa4fa8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3e41489a9454ad5bf3d64b7801c25e4'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:51.155081 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-e6cc4e86-a1a4-485c-a05b-0171dfa4fa8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3e41489a9454ad5bf3d64b7801c25e4'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:51.166318 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-930ff3b5-cffe-479c-8378-83e849c0b512 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65117d1561be4d2b8f13c0e585cef28e', 'request_id': 'req-930ff3b5-cffe-479c-8378-83e849c0b512'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:51.167263 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-e6cc4e86-a1a4-485c-a05b-0171dfa4fa8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3e41489a9454ad5bf3d64b7801c25e4'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:51.171679 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-930ff3b5-cffe-479c-8378-83e849c0b512 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65117d1561be4d2b8f13c0e585cef28e', 'request_id': 'req-930ff3b5-cffe-479c-8378-83e849c0b512'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:51.177653 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-930ff3b5-cffe-479c-8378-83e849c0b512 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65117d1561be4d2b8f13c0e585cef28e', 'request_id': 'req-930ff3b5-cffe-479c-8378-83e849c0b512'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:51.239883 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1078/2153] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:34:50 2021] DELETE /identity/v3/users/e3e41489a9454ad5bf3d64b7801c25e4 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:51.241221 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c6ad9-10c9-4644-aa17-5798cf7284e4 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:51.241548 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c6ad9-10c9-4644-aa17-5798cf7284e4 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:51.241883 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c6ad9-10c9-4644-aa17-5798cf7284e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:51.262899 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-3e0c6ad9-10c9-4644-aa17-5798cf7284e4 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:51.264034 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-3e0c6ad9-10c9-4644-aa17-5798cf7284e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:51.309717 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-930ff3b5-cffe-479c-8378-83e849c0b512 admin admin] The token cache is being invalidate because project 65117d1561be4d2b8f13c0e585cef28e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:34:51.310008 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-930ff3b5-cffe-479c-8378-83e849c0b512 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:51.310944 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-930ff3b5-cffe-479c-8378-83e849c0b512 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:51.317054 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1076/2154] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:34:51 2021] DELETE /identity/v3/projects/65117d1561be4d2b8f13c0e585cef28e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:51.317054 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ff3b5-cffe-479c-8378-83e849c0b512 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:51.317054 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-930ff3b5-cffe-479c-8378-83e849c0b512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:51.333450 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1079/2155] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:51.334785 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612359ce-e292-4887-8e96-c7904bfe00f5 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:51.335072 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612359ce-e292-4887-8e96-c7904bfe00f5 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:51.335347 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612359ce-e292-4887-8e96-c7904bfe00f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:51.354357 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-612359ce-e292-4887-8e96-c7904bfe00f5 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:51.355630 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-612359ce-e292-4887-8e96-c7904bfe00f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:51.363866 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1080/2156] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:51.371724 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612359ce-e292-4887-8e96-c7904bfe00f5 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:51.374545 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612359ce-e292-4887-8e96-c7904bfe00f5 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:51.379164 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65b886-ad98-410f-8df8-667d4a9e75e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:51.379820 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65b886-ad98-410f-8df8-667d4a9e75e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:51.380097 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65b886-ad98-410f-8df8-667d4a9e75e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:51.380373 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65b886-ad98-410f-8df8-667d4a9e75e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:51.381106 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65b886-ad98-410f-8df8-667d4a9e75e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:34:51.381434 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65b886-ad98-410f-8df8-667d4a9e75e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:51.383591 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65b886-ad98-410f-8df8-667d4a9e75e5 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:51.385303 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ff3b5-cffe-479c-8378-83e849c0b512 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:51.390106 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82c104-502e-467f-9d2d-b3dd9b4aa541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:51.390968 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82c104-502e-467f-9d2d-b3dd9b4aa541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:51.391253 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82c104-502e-467f-9d2d-b3dd9b4aa541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:51.391524 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82c104-502e-467f-9d2d-b3dd9b4aa541 admin admin] PATH_INFO: `/v3/users/31a7010463364896ad37154e0dd48edf` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:51.392749 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb82c104-502e-467f-9d2d-b3dd9b4aa541 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31a7010463364896ad37154e0dd48edf)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:51.394746 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb82c104-502e-467f-9d2d-b3dd9b4aa541 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:51.395021 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1081/2157] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:34:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:34:51.396258 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26ff94-e7d8-495d-9596-ae34785ff073 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:51.396532 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26ff94-e7d8-495d-9596-ae34785ff073 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:51.396814 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26ff94-e7d8-495d-9596-ae34785ff073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:51.417352 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-3a26ff94-e7d8-495d-9596-ae34785ff073 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:51.418618 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-3a26ff94-e7d8-495d-9596-ae34785ff073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:51.426755 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1082/2158] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:51.427362 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26ff94-e7d8-495d-9596-ae34785ff073 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:51.436901 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26ff94-e7d8-495d-9596-ae34785ff073 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:51.442215 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13447c8d-e056-438d-b74b-b732168dedd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:51.442861 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13447c8d-e056-438d-b74b-b732168dedd0 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:51.443141 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13447c8d-e056-438d-b74b-b732168dedd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:51.443416 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13447c8d-e056-438d-b74b-b732168dedd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:51.444179 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13447c8d-e056-438d-b74b-b732168dedd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:51.450679 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13447c8d-e056-438d-b74b-b732168dedd0 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:51.567458 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1083/2159] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:34:51 2021] POST /identity/v3/projects => generated 365 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:51.568795 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13447c8d-e056-438d-b74b-b732168dedd0 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:51.622238 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-eb82c104-502e-467f-9d2d-b3dd9b4aa541 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31a7010463364896ad37154e0dd48edf'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:51.622962 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-eb82c104-502e-467f-9d2d-b3dd9b4aa541 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31a7010463364896ad37154e0dd48edf'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:51.641243 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13447c8d-e056-438d-b74b-b732168dedd0 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:51.646042 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9b73d-95b5-4537-adc4-f0beb5f64cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:51.646697 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9b73d-95b5-4537-adc4-f0beb5f64cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:51.646976 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9b73d-95b5-4537-adc4-f0beb5f64cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:51.647246 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9b73d-95b5-4537-adc4-f0beb5f64cb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:51.647980 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9b73d-95b5-4537-adc4-f0beb5f64cb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:34:51.648286 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9b73d-95b5-4537-adc4-f0beb5f64cb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:51.650134 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9b73d-95b5-4537-adc4-f0beb5f64cb9 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:51.661600 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1084/2160] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:34:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:34:51.662241 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9b73d-95b5-4537-adc4-f0beb5f64cb9 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:51.672071 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9b73d-95b5-4537-adc4-f0beb5f64cb9 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:51.676966 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db80d96-c886-4a55-8126-e2af999fc2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:51.677612 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db80d96-c886-4a55-8126-e2af999fc2e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:51.677893 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db80d96-c886-4a55-8126-e2af999fc2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:51.678166 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db80d96-c886-4a55-8126-e2af999fc2e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:51.678845 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db80d96-c886-4a55-8126-e2af999fc2e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:51.680752 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db80d96-c886-4a55-8126-e2af999fc2e2 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:51.726070 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-eb82c104-502e-467f-9d2d-b3dd9b4aa541 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31a7010463364896ad37154e0dd48edf'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:51.726815 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-eb82c104-502e-467f-9d2d-b3dd9b4aa541 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31a7010463364896ad37154e0dd48edf'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:51.739826 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-eb82c104-502e-467f-9d2d-b3dd9b4aa541 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31a7010463364896ad37154e0dd48edf'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:51.752877 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1077/2161] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:34:51 2021] DELETE /identity/v3/users/31a7010463364896ad37154e0dd48edf => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:51.753685 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82c104-502e-467f-9d2d-b3dd9b4aa541 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:51.755035 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-eb82c104-502e-467f-9d2d-b3dd9b4aa541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:51.783068 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1085/2162] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:34:51 2021] POST /identity/v3/users => generated 283 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:51.784233 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db80d96-c886-4a55-8126-e2af999fc2e2 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:51.786040 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-8db80d96-c886-4a55-8126-e2af999fc2e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:51.798098 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db80d96-c886-4a55-8126-e2af999fc2e2 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:51.820181 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82c104-502e-467f-9d2d-b3dd9b4aa541 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:51.825807 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec41707-ba8e-4067-b0d4-3e3a6559c4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:51.826708 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec41707-ba8e-4067-b0d4-3e3a6559c4c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:51.827118 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec41707-ba8e-4067-b0d4-3e3a6559c4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:51.827398 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec41707-ba8e-4067-b0d4-3e3a6559c4c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:51.828103 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec41707-ba8e-4067-b0d4-3e3a6559c4c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:51.830012 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec41707-ba8e-4067-b0d4-3e3a6559c4c4 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:51.854477 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab2400-667b-4903-a38b-a34ac4172aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:51.855335 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab2400-667b-4903-a38b-a34ac4172aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:51.855612 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab2400-667b-4903-a38b-a34ac4172aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:51.864505 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab2400-667b-4903-a38b-a34ac4172aa5 admin admin] PATH_INFO: `/v3/projects/bbf21f5b29024f809c0b01d2912b2a93` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:51.864505 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab2400-667b-4903-a38b-a34ac4172aa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbf21f5b29024f809c0b01d2912b2a93)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:51.864505 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab2400-667b-4903-a38b-a34ac4172aa5 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:51.967945 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1078/2163] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:34:51 2021] POST /identity/v3/projects => generated 373 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:51.969231 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf5ecc-ff95-4169-bde1-b2f7712f1b9d None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:51.969588 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf5ecc-ff95-4169-bde1-b2f7712f1b9d None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:51.969872 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf5ecc-ff95-4169-bde1-b2f7712f1b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:51.988256 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-b1cf5ecc-ff95-4169-bde1-b2f7712f1b9d None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:51.989562 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-b1cf5ecc-ff95-4169-bde1-b2f7712f1b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:52.000650 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-b7ab2400-667b-4903-a38b-a34ac4172aa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbf21f5b29024f809c0b01d2912b2a93', 'request_id': 'req-b7ab2400-667b-4903-a38b-a34ac4172aa5'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:52.006663 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-b7ab2400-667b-4903-a38b-a34ac4172aa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbf21f5b29024f809c0b01d2912b2a93', 'request_id': 'req-b7ab2400-667b-4903-a38b-a34ac4172aa5'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:52.012356 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-b7ab2400-667b-4903-a38b-a34ac4172aa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbf21f5b29024f809c0b01d2912b2a93', 'request_id': 'req-b7ab2400-667b-4903-a38b-a34ac4172aa5'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:52.047762 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1079/2164] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:52.048600 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf5ecc-ff95-4169-bde1-b2f7712f1b9d None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:52.049888 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-b1cf5ecc-ff95-4169-bde1-b2f7712f1b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:52.061261 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf5ecc-ff95-4169-bde1-b2f7712f1b9d None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:52.065871 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f672f-05d8-4178-91ee-f70aae944888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:52.066539 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f672f-05d8-4178-91ee-f70aae944888 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:52.066823 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f672f-05d8-4178-91ee-f70aae944888 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:52.067098 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f672f-05d8-4178-91ee-f70aae944888 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:52.067856 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f672f-05d8-4178-91ee-f70aae944888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:52.069417 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f672f-05d8-4178-91ee-f70aae944888 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:52.079543 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1080/2165] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:52 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:52.080289 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-b7ab2400-667b-4903-a38b-a34ac4172aa5 admin admin] The token cache is being invalidate because project bbf21f5b29024f809c0b01d2912b2a93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:34:52.080434 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f672f-05d8-4178-91ee-f70aae944888 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:52.080618 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-b7ab2400-667b-4903-a38b-a34ac4172aa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:52.082909 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-b7ab2400-667b-4903-a38b-a34ac4172aa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:52.084438 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1086/2166] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:34:51 2021] DELETE /identity/v3/projects/bbf21f5b29024f809c0b01d2912b2a93 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:52.085193 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab2400-667b-4903-a38b-a34ac4172aa5 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:52.087285 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-b7ab2400-667b-4903-a38b-a34ac4172aa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:52.092400 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f672f-05d8-4178-91ee-f70aae944888 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:52.097760 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da67e4d-a94b-470d-aa1b-f55d9cfbb760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:52.098319 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da67e4d-a94b-470d-aa1b-f55d9cfbb760 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:52.098595 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da67e4d-a94b-470d-aa1b-f55d9cfbb760 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:52.098870 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da67e4d-a94b-470d-aa1b-f55d9cfbb760 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:52.099627 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da67e4d-a94b-470d-aa1b-f55d9cfbb760 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:52.102446 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da67e4d-a94b-470d-aa1b-f55d9cfbb760 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:52.154354 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab2400-667b-4903-a38b-a34ac4172aa5 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:52.158131 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7274e1b-de4f-4df7-a190-49140253ee32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:52.158775 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7274e1b-de4f-4df7-a190-49140253ee32 service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:52.159050 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7274e1b-de4f-4df7-a190-49140253ee32 service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:52.159325 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7274e1b-de4f-4df7-a190-49140253ee32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:52.161133 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-a7274e1b-de4f-4df7-a190-49140253ee32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:52.173830 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7274e1b-de4f-4df7-a190-49140253ee32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:52.175259 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7274e1b-de4f-4df7-a190-49140253ee32 service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:52.179355 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1081/2167] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:34:52 2021] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:52.180293 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da67e4d-a94b-470d-aa1b-f55d9cfbb760 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:52.183796 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-4da67e4d-a94b-470d-aa1b-f55d9cfbb760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:52.185849 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1087/2168] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:34:52.187572 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f1fa0-d729-4083-9da6-b491b1981568 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:52.187572 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f1fa0-d729-4083-9da6-b491b1981568 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:52.187572 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f1fa0-d729-4083-9da6-b491b1981568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:52.209125 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-f34f1fa0-d729-4083-9da6-b491b1981568 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:52.210847 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-f34f1fa0-d729-4083-9da6-b491b1981568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:52.221816 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da67e4d-a94b-470d-aa1b-f55d9cfbb760 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:52.222561 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1088/2169] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:52.223222 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f1fa0-d729-4083-9da6-b491b1981568 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:52.229795 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-f34f1fa0-d729-4083-9da6-b491b1981568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:52.233515 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ef8cf-3aed-43ca-8344-a5e03d5bc00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:52.234473 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ef8cf-3aed-43ca-8344-a5e03d5bc00d admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:52.235453 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ef8cf-3aed-43ca-8344-a5e03d5bc00d admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:52.235938 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ef8cf-3aed-43ca-8344-a5e03d5bc00d admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:52.237007 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ef8cf-3aed-43ca-8344-a5e03d5bc00d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:52.244084 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ef8cf-3aed-43ca-8344-a5e03d5bc00d admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:52.244204 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f1fa0-d729-4083-9da6-b491b1981568 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:52.254585 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98792e66-315d-4718-a13b-496f1d1b2b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:52.255301 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98792e66-315d-4718-a13b-496f1d1b2b1f admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:52.255528 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98792e66-315d-4718-a13b-496f1d1b2b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:52.255799 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98792e66-315d-4718-a13b-496f1d1b2b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:52.256573 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98792e66-315d-4718-a13b-496f1d1b2b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:52.258728 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98792e66-315d-4718-a13b-496f1d1b2b1f admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:52.265558 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1082/2170] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:52 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:52.265558 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61d1fd-2997-46c7-b53d-489b2a1255d8 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:52.265558 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61d1fd-2997-46c7-b53d-489b2a1255d8 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:52.265558 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61d1fd-2997-46c7-b53d-489b2a1255d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:52.271029 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1089/2171] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:52 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:52.271845 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98792e66-315d-4718-a13b-496f1d1b2b1f admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:52.283109 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98792e66-315d-4718-a13b-496f1d1b2b1f admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:52.288213 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1dc64-3a41-4afb-93a6-bc143676a82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:52.288654 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-0b61d1fd-2997-46c7-b53d-489b2a1255d8 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:52.289105 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1dc64-3a41-4afb-93a6-bc143676a82e admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:52.290021 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1dc64-3a41-4afb-93a6-bc143676a82e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:52.290135 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1dc64-3a41-4afb-93a6-bc143676a82e admin admin] PATH_INFO: `/v3/projects/d88cb76f80dc40eab09248e90b44d38d/users/0b94a91bd86644e8af60a7e50c29ab5b/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:52.290361 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-0b61d1fd-2997-46c7-b53d-489b2a1255d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:52.298600 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1083/2172] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:52.300543 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61d1fd-2997-46c7-b53d-489b2a1255d8 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:52.307444 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1dc64-3a41-4afb-93a6-bc143676a82e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d88cb76f80dc40eab09248e90b44d38d, user_id=0b94a91bd86644e8af60a7e50c29ab5b, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:52.310972 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1dc64-3a41-4afb-93a6-bc143676a82e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:52.311871 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61d1fd-2997-46c7-b53d-489b2a1255d8 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:52.317201 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177756c6-451b-4cd7-abfe-320ceab125ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:52.318019 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177756c6-451b-4cd7-abfe-320ceab125ca admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:52.318286 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177756c6-451b-4cd7-abfe-320ceab125ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:52.318563 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177756c6-451b-4cd7-abfe-320ceab125ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:52.319301 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177756c6-451b-4cd7-abfe-320ceab125ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:52.321459 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177756c6-451b-4cd7-abfe-320ceab125ca admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:52.332058 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1084/2173] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:52 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:52.332793 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177756c6-451b-4cd7-abfe-320ceab125ca admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:52.344102 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177756c6-451b-4cd7-abfe-320ceab125ca admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:52.348931 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d1b1e-af5f-4061-8558-838d528dd713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:52.349633 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d1b1e-af5f-4061-8558-838d528dd713 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:52.349917 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d1b1e-af5f-4061-8558-838d528dd713 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:52.350315 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d1b1e-af5f-4061-8558-838d528dd713 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:52.350938 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d1b1e-af5f-4061-8558-838d528dd713 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:34:52.351247 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d1b1e-af5f-4061-8558-838d528dd713 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:52.352999 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d1b1e-af5f-4061-8558-838d528dd713 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:52.365927 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1085/2174] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:34:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:34:52.366895 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d1b1e-af5f-4061-8558-838d528dd713 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:52.377329 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d1b1e-af5f-4061-8558-838d528dd713 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:52.382411 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5e7ae-194a-4550-8d65-102df0570af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:52.383956 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5e7ae-194a-4550-8d65-102df0570af6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:52.384230 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5e7ae-194a-4550-8d65-102df0570af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:52.384505 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5e7ae-194a-4550-8d65-102df0570af6 admin admin] PATH_INFO: `/v3/projects/8d7c3ef13ab246688276dd494e86352e/users/32540de16ba64c448905bb2b96ca183f/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:52.391565 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1090/2175] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:52 2021] PUT /identity/v3/projects/d88cb76f80dc40eab09248e90b44d38d/users/0b94a91bd86644e8af60a7e50c29ab5b/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:52.392378 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1dc64-3a41-4afb-93a6-bc143676a82e admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:52.402416 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5e7ae-194a-4550-8d65-102df0570af6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d7c3ef13ab246688276dd494e86352e, user_id=32540de16ba64c448905bb2b96ca183f, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:52.405228 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5e7ae-194a-4550-8d65-102df0570af6 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:52.458021 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1dc64-3a41-4afb-93a6-bc143676a82e admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:52.463865 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36fd8d-2dbe-4d3e-b613-b4d90c4d879f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:52.464522 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36fd8d-2dbe-4d3e-b613-b4d90c4d879f admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:52.464828 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36fd8d-2dbe-4d3e-b613-b4d90c4d879f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:52.465103 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36fd8d-2dbe-4d3e-b613-b4d90c4d879f admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:52.465845 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36fd8d-2dbe-4d3e-b613-b4d90c4d879f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:52.467725 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36fd8d-2dbe-4d3e-b613-b4d90c4d879f admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:52.484435 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1086/2176] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:52 2021] PUT /identity/v3/projects/8d7c3ef13ab246688276dd494e86352e/users/32540de16ba64c448905bb2b96ca183f/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:52.494091 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57d1bd-25c6-4f17-b79d-7e2af4142e08 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:52.494388 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57d1bd-25c6-4f17-b79d-7e2af4142e08 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:52.494666 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57d1bd-25c6-4f17-b79d-7e2af4142e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:52.527221 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-bb57d1bd-25c6-4f17-b79d-7e2af4142e08 None None] MFA Rules not processed for user `0b94a91bd86644e8af60a7e50c29ab5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:52.528798 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-bb57d1bd-25c6-4f17-b79d-7e2af4142e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:52.562868 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1091/2177] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:34:52 2021] POST /identity/v3/projects => generated 381 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:52.564428 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d7e6f-1f41-4fef-a83d-7925f2d2db12 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:52.564711 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d7e6f-1f41-4fef-a83d-7925f2d2db12 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:52.565004 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d7e6f-1f41-4fef-a83d-7925f2d2db12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:52.593521 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-527d7e6f-1f41-4fef-a83d-7925f2d2db12 None None] MFA Rules not processed for user `32540de16ba64c448905bb2b96ca183f`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:52.594826 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-527d7e6f-1f41-4fef-a83d-7925f2d2db12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:52.603677 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1087/2178] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:52 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:52.604572 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57d1bd-25c6-4f17-b79d-7e2af4142e08 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:52.671033 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1092/2179] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:52 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:52.681621 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57d1bd-25c6-4f17-b79d-7e2af4142e08 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:52.687940 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d7e6f-1f41-4fef-a83d-7925f2d2db12 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:52.692053 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-527d7e6f-1f41-4fef-a83d-7925f2d2db12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:52.740655 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3aee92-fed3-4fa9-91ae-048fc4d701d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:52.740655 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3aee92-fed3-4fa9-91ae-048fc4d701d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:52.740655 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3aee92-fed3-4fa9-91ae-048fc4d701d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:52.740655 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3aee92-fed3-4fa9-91ae-048fc4d701d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:52.741180 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3aee92-fed3-4fa9-91ae-048fc4d701d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:52.743213 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3aee92-fed3-4fa9-91ae-048fc4d701d3 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:52.768848 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d7e6f-1f41-4fef-a83d-7925f2d2db12 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:52.773875 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bc35c-c489-460c-80af-c17164943a88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:52.779308 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bc35c-c489-460c-80af-c17164943a88 service cinder] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:52.779308 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bc35c-c489-460c-80af-c17164943a88 service cinder] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:52.779308 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bc35c-c489-460c-80af-c17164943a88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:52.822483 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1088/2180] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:34:52 2021] POST /identity/v3/users => generated 291 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:52.822483 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3aee92-fed3-4fa9-91ae-048fc4d701d3 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:52.826776 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-2d3aee92-fed3-4fa9-91ae-048fc4d701d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:52.842095 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3aee92-fed3-4fa9-91ae-048fc4d701d3 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:52.847619 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148cefc-c75b-4357-9bc5-928ed39ebb9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:52.848279 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148cefc-c75b-4357-9bc5-928ed39ebb9b service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:52.848557 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148cefc-c75b-4357-9bc5-928ed39ebb9b service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:52.848830 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148cefc-c75b-4357-9bc5-928ed39ebb9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:52.852472 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bc35c-c489-460c-80af-c17164943a88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:52.858283 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bc35c-c489-460c-80af-c17164943a88 service cinder] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:52.860795 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148cefc-c75b-4357-9bc5-928ed39ebb9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:52.862476 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148cefc-c75b-4357-9bc5-928ed39ebb9b service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:52.865052 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1093/2181] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:52 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:34:52.865823 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bc35c-c489-460c-80af-c17164943a88 service cinder] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:52.867215 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-2a8bc35c-c489-460c-80af-c17164943a88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:52.874689 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1089/2182] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:52 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:34:52.875534 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148cefc-c75b-4357-9bc5-928ed39ebb9b service cinder] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:52.884416 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bc35c-c489-460c-80af-c17164943a88 service cinder] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:52.889776 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148cefc-c75b-4357-9bc5-928ed39ebb9b service cinder] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:52.890149 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3bde8-66eb-4516-ad71-6fff6d41bea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:52.891535 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3bde8-66eb-4516-ad71-6fff6d41bea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:52.891888 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3bde8-66eb-4516-ad71-6fff6d41bea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:52.892358 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3bde8-66eb-4516-ad71-6fff6d41bea8 admin admin] PATH_INFO: `/v3/projects/c7e49dae43774d24b2cdd1e71deb19f5` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:52.893696 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3bde8-66eb-4516-ad71-6fff6d41bea8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7e49dae43774d24b2cdd1e71deb19f5)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:52.895937 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3bde8-66eb-4516-ad71-6fff6d41bea8 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:52.896223 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ac85b-2567-4493-b5bd-398e19f2b49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:52.896883 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ac85b-2567-4493-b5bd-398e19f2b49f admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:52.897217 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ac85b-2567-4493-b5bd-398e19f2b49f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:52.897597 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ac85b-2567-4493-b5bd-398e19f2b49f admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:52.898340 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ac85b-2567-4493-b5bd-398e19f2b49f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:52.901808 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ac85b-2567-4493-b5bd-398e19f2b49f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:52.924049 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1090/2183] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:52 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:52.931318 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ac85b-2567-4493-b5bd-398e19f2b49f admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:52.941782 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ac85b-2567-4493-b5bd-398e19f2b49f admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:52.948833 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fc44d-ca34-416b-9e52-c7106629311b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:52.949366 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fc44d-ca34-416b-9e52-c7106629311b admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:52.949681 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fc44d-ca34-416b-9e52-c7106629311b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:52.949951 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fc44d-ca34-416b-9e52-c7106629311b admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:52.950738 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85fc44d-ca34-416b-9e52-c7106629311b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:52.953701 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85fc44d-ca34-416b-9e52-c7106629311b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:52.966665 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1091/2184] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:52 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:52.971005 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fc44d-ca34-416b-9e52-c7106629311b admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:52.983658 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fc44d-ca34-416b-9e52-c7106629311b admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:52.989011 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaaf6ce-be99-4dff-826f-f095bfaac2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:52.993968 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaf6ce-be99-4dff-826f-f095bfaac2de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:52.993968 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaf6ce-be99-4dff-826f-f095bfaac2de admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:52.993968 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaf6ce-be99-4dff-826f-f095bfaac2de admin admin] PATH_INFO: `/v3/users/32540de16ba64c448905bb2b96ca183f` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:52.993968 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaaf6ce-be99-4dff-826f-f095bfaac2de admin admin] RBAC: Authorizing `identity:delete_user(user_id=32540de16ba64c448905bb2b96ca183f)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:52.993968 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaaf6ce-be99-4dff-826f-f095bfaac2de admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:53.031877 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-41e3bde8-66eb-4516-ad71-6fff6d41bea8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7e49dae43774d24b2cdd1e71deb19f5', 'request_id': 'req-41e3bde8-66eb-4516-ad71-6fff6d41bea8'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:53.039099 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-41e3bde8-66eb-4516-ad71-6fff6d41bea8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7e49dae43774d24b2cdd1e71deb19f5', 'request_id': 'req-41e3bde8-66eb-4516-ad71-6fff6d41bea8'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:53.045444 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-41e3bde8-66eb-4516-ad71-6fff6d41bea8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7e49dae43774d24b2cdd1e71deb19f5', 'request_id': 'req-41e3bde8-66eb-4516-ad71-6fff6d41bea8'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:53.125360 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-41e3bde8-66eb-4516-ad71-6fff6d41bea8 admin admin] The token cache is being invalidate because project c7e49dae43774d24b2cdd1e71deb19f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:34:53.125697 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-41e3bde8-66eb-4516-ad71-6fff6d41bea8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:53.126587 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-41e3bde8-66eb-4516-ad71-6fff6d41bea8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:53.128259 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1094/2185] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:34:52 2021] DELETE /identity/v3/projects/c7e49dae43774d24b2cdd1e71deb19f5 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:53.128999 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3bde8-66eb-4516-ad71-6fff6d41bea8 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:53.130897 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-41e3bde8-66eb-4516-ad71-6fff6d41bea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:53.193829 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-daaaf6ce-be99-4dff-826f-f095bfaac2de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32540de16ba64c448905bb2b96ca183f'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:53.194901 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-daaaf6ce-be99-4dff-826f-f095bfaac2de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32540de16ba64c448905bb2b96ca183f'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:53.199366 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3bde8-66eb-4516-ad71-6fff6d41bea8 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:53.207619 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e541bb2-fc1b-43c5-95ed-654968e659b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:53.212632 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e541bb2-fc1b-43c5-95ed-654968e659b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:53.212632 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e541bb2-fc1b-43c5-95ed-654968e659b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:53.212632 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e541bb2-fc1b-43c5-95ed-654968e659b0 admin admin] PATH_INFO: `/v3/projects/a5d817817e0943fcbb18809eefa13704/users/1384889385cd4a929936e9899e4940a9/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:53.244803 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e541bb2-fc1b-43c5-95ed-654968e659b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5d817817e0943fcbb18809eefa13704, user_id=1384889385cd4a929936e9899e4940a9, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:53.247810 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e541bb2-fc1b-43c5-95ed-654968e659b0 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:53.280261 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-daaaf6ce-be99-4dff-826f-f095bfaac2de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32540de16ba64c448905bb2b96ca183f'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:53.280949 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-daaaf6ce-be99-4dff-826f-f095bfaac2de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32540de16ba64c448905bb2b96ca183f'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:53.295293 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-daaaf6ce-be99-4dff-826f-f095bfaac2de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32540de16ba64c448905bb2b96ca183f'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:53.307902 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1092/2186] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:34:52 2021] DELETE /identity/v3/users/32540de16ba64c448905bb2b96ca183f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:53.308904 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaaf6ce-be99-4dff-826f-f095bfaac2de admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:53.310289 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-daaaf6ce-be99-4dff-826f-f095bfaac2de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:53.323990 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1095/2187] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:53 2021] PUT /identity/v3/projects/a5d817817e0943fcbb18809eefa13704/users/1384889385cd4a929936e9899e4940a9/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:53.325490 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98ace9-739a-4a1a-8a54-6d1cdcc696bc None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:53.325778 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98ace9-739a-4a1a-8a54-6d1cdcc696bc None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:53.337937 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98ace9-739a-4a1a-8a54-6d1cdcc696bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:53.347719 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-3e98ace9-739a-4a1a-8a54-6d1cdcc696bc None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:53.349268 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-3e98ace9-739a-4a1a-8a54-6d1cdcc696bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:53.402267 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaaf6ce-be99-4dff-826f-f095bfaac2de admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:53.413651 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1096/2188] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:53.415885 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bea564-c338-41e1-8205-3ce51bf2ae8d None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:53.416486 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bea564-c338-41e1-8205-3ce51bf2ae8d None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:53.416763 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bea564-c338-41e1-8205-3ce51bf2ae8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:53.445684 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-51bea564-c338-41e1-8205-3ce51bf2ae8d None None] MFA Rules not processed for user `1384889385cd4a929936e9899e4940a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:53.447072 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-51bea564-c338-41e1-8205-3ce51bf2ae8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:53.468128 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc933f-fa27-422b-8ed6-ffdd5871b40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:53.473172 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc933f-fa27-422b-8ed6-ffdd5871b40c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:53.473172 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc933f-fa27-422b-8ed6-ffdd5871b40c admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:53.473172 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc933f-fa27-422b-8ed6-ffdd5871b40c admin admin] PATH_INFO: `/v3/users/049df69eaecf4ecca38e8a054305df66` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:53.473172 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc933f-fa27-422b-8ed6-ffdd5871b40c admin admin] RBAC: Authorizing `identity:delete_user(user_id=049df69eaecf4ecca38e8a054305df66)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:53.473172 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc933f-fa27-422b-8ed6-ffdd5871b40c admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:53.515980 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1097/2189] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:53 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:53.516585 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bea564-c338-41e1-8205-3ce51bf2ae8d None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:53.518197 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-51bea564-c338-41e1-8205-3ce51bf2ae8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:53.590375 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bea564-c338-41e1-8205-3ce51bf2ae8d None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:53.594794 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b9e33-bd23-4384-95b1-afd1606e7e41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:53.595464 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b9e33-bd23-4384-95b1-afd1606e7e41 service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:53.595722 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b9e33-bd23-4384-95b1-afd1606e7e41 service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:53.595996 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b9e33-bd23-4384-95b1-afd1606e7e41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:53.606635 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640b9e33-bd23-4384-95b1-afd1606e7e41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:53.608065 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640b9e33-bd23-4384-95b1-afd1606e7e41 service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:53.619045 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1098/2190] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:34:53.619867 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b9e33-bd23-4384-95b1-afd1606e7e41 service neutron] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:53.621294 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-640b9e33-bd23-4384-95b1-afd1606e7e41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:53.635306 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b9e33-bd23-4384-95b1-afd1606e7e41 service neutron] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:53.642017 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fa263-83f1-4151-a5fb-8ff84c83b9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:53.642707 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fa263-83f1-4151-a5fb-8ff84c83b9a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:53.642966 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fa263-83f1-4151-a5fb-8ff84c83b9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:53.643462 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fa263-83f1-4151-a5fb-8ff84c83b9a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:53.644339 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098fa263-83f1-4151-a5fb-8ff84c83b9a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:53.647021 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098fa263-83f1-4151-a5fb-8ff84c83b9a6 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:53.687482 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4ccc933f-fa27-422b-8ed6-ffdd5871b40c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '049df69eaecf4ecca38e8a054305df66'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:53.688426 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4ccc933f-fa27-422b-8ed6-ffdd5871b40c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '049df69eaecf4ecca38e8a054305df66'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:53.764568 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1099/2191] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:34:53 2021] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:53.765604 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fa263-83f1-4151-a5fb-8ff84c83b9a6 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:53.795181 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4ccc933f-fa27-422b-8ed6-ffdd5871b40c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '049df69eaecf4ecca38e8a054305df66'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:53.795181 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4ccc933f-fa27-422b-8ed6-ffdd5871b40c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '049df69eaecf4ecca38e8a054305df66'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:53.817060 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4ccc933f-fa27-422b-8ed6-ffdd5871b40c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '049df69eaecf4ecca38e8a054305df66'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:53.834690 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1093/2192] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:34:53 2021] DELETE /identity/v3/users/049df69eaecf4ecca38e8a054305df66 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:53.850602 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fa263-83f1-4151-a5fb-8ff84c83b9a6 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:53.913707 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3e345-191d-45ae-b892-765cdd8c1a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:53.915393 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3e345-191d-45ae-b892-765cdd8c1a9d admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:53.915393 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3e345-191d-45ae-b892-765cdd8c1a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:53.915835 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3e345-191d-45ae-b892-765cdd8c1a9d admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:53.916613 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3e345-191d-45ae-b892-765cdd8c1a9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:53.918607 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3e345-191d-45ae-b892-765cdd8c1a9d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:53.948064 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc933f-fa27-422b-8ed6-ffdd5871b40c admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:53.949933 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-4ccc933f-fa27-422b-8ed6-ffdd5871b40c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:53.972391 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc933f-fa27-422b-8ed6-ffdd5871b40c admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:53.979511 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecd8b7-69a9-435d-8a12-aea19b7f982d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:53.980542 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecd8b7-69a9-435d-8a12-aea19b7f982d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:53.980823 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecd8b7-69a9-435d-8a12-aea19b7f982d admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:53.981096 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecd8b7-69a9-435d-8a12-aea19b7f982d admin admin] PATH_INFO: `/v3/users/c0882b11fb2f468395c2157f4eb2451b` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:53.982714 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ecd8b7-69a9-435d-8a12-aea19b7f982d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0882b11fb2f468395c2157f4eb2451b)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:53.984761 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ecd8b7-69a9-435d-8a12-aea19b7f982d admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:54.018806 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1100/2193] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:34:53 2021] POST /identity/v3/users => generated 296 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:54.022927 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3e345-191d-45ae-b892-765cdd8c1a9d admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:54.026315 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-29b3e345-191d-45ae-b892-765cdd8c1a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:54.041712 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3e345-191d-45ae-b892-765cdd8c1a9d admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:54.047666 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c687f65-b7ef-45a0-bd25-7dbc08e0974c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:54.050733 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c687f65-b7ef-45a0-bd25-7dbc08e0974c admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:54.050733 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c687f65-b7ef-45a0-bd25-7dbc08e0974c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:54.050733 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c687f65-b7ef-45a0-bd25-7dbc08e0974c admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:54.050733 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c687f65-b7ef-45a0-bd25-7dbc08e0974c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:54.052351 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c687f65-b7ef-45a0-bd25-7dbc08e0974c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:54.064712 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1101/2194] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:54 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:54.069064 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c687f65-b7ef-45a0-bd25-7dbc08e0974c admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:54.080761 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c687f65-b7ef-45a0-bd25-7dbc08e0974c admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:54.085683 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1444edf-6993-4bbc-91b1-7c5cfcb2c809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:54.086684 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1444edf-6993-4bbc-91b1-7c5cfcb2c809 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:54.086953 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1444edf-6993-4bbc-91b1-7c5cfcb2c809 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:54.087376 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1444edf-6993-4bbc-91b1-7c5cfcb2c809 admin admin] PATH_INFO: `/v3/projects/e7541e4fe56d4df78e88963e79a690e3/users/e66e9994637646039998f70a10f923eb/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:54.103288 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1444edf-6993-4bbc-91b1-7c5cfcb2c809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7541e4fe56d4df78e88963e79a690e3, user_id=e66e9994637646039998f70a10f923eb, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:54.106039 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1444edf-6993-4bbc-91b1-7c5cfcb2c809 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:54.226837 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1102/2195] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:54 2021] PUT /identity/v3/projects/e7541e4fe56d4df78e88963e79a690e3/users/e66e9994637646039998f70a10f923eb/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:54.226837 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1444edf-6993-4bbc-91b1-7c5cfcb2c809 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:54.228758 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-f1444edf-6993-4bbc-91b1-7c5cfcb2c809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:54.233152 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-90ecd8b7-69a9-435d-8a12-aea19b7f982d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0882b11fb2f468395c2157f4eb2451b'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:54.233939 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-90ecd8b7-69a9-435d-8a12-aea19b7f982d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0882b11fb2f468395c2157f4eb2451b'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:54.293203 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1444edf-6993-4bbc-91b1-7c5cfcb2c809 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:54.297879 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291628f-f47d-4931-949f-8498405bf1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:54.298740 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291628f-f47d-4931-949f-8498405bf1b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:54.299025 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291628f-f47d-4931-949f-8498405bf1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:54.299324 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291628f-f47d-4931-949f-8498405bf1b3 admin admin] PATH_INFO: `/v3/projects/8d7c3ef13ab246688276dd494e86352e` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:54.300539 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d291628f-f47d-4931-949f-8498405bf1b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d7c3ef13ab246688276dd494e86352e)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:54.302533 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d291628f-f47d-4931-949f-8498405bf1b3 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:54.319818 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-90ecd8b7-69a9-435d-8a12-aea19b7f982d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0882b11fb2f468395c2157f4eb2451b'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:54.320602 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-90ecd8b7-69a9-435d-8a12-aea19b7f982d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0882b11fb2f468395c2157f4eb2451b'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:54.335512 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-90ecd8b7-69a9-435d-8a12-aea19b7f982d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0882b11fb2f468395c2157f4eb2451b'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:54.349694 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1094/2196] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:34:53 2021] DELETE /identity/v3/users/c0882b11fb2f468395c2157f4eb2451b => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:54.350538 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecd8b7-69a9-435d-8a12-aea19b7f982d admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:54.353437 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-90ecd8b7-69a9-435d-8a12-aea19b7f982d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:54.442459 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecd8b7-69a9-435d-8a12-aea19b7f982d admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:54.460203 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-d291628f-f47d-4931-949f-8498405bf1b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d7c3ef13ab246688276dd494e86352e', 'request_id': 'req-d291628f-f47d-4931-949f-8498405bf1b3'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:54.470816 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-d291628f-f47d-4931-949f-8498405bf1b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d7c3ef13ab246688276dd494e86352e', 'request_id': 'req-d291628f-f47d-4931-949f-8498405bf1b3'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:54.479997 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-d291628f-f47d-4931-949f-8498405bf1b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d7c3ef13ab246688276dd494e86352e', 'request_id': 'req-d291628f-f47d-4931-949f-8498405bf1b3'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:54.506300 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387a2b7-3f9a-43f3-a22e-eec010271242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:54.506974 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387a2b7-3f9a-43f3-a22e-eec010271242 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:54.507282 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387a2b7-3f9a-43f3-a22e-eec010271242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:54.507617 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387a2b7-3f9a-43f3-a22e-eec010271242 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:54.508596 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387a2b7-3f9a-43f3-a22e-eec010271242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:54.510966 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387a2b7-3f9a-43f3-a22e-eec010271242 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:54.520900 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1095/2197] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:54 2021] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:54.526389 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387a2b7-3f9a-43f3-a22e-eec010271242 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:54.537654 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387a2b7-3f9a-43f3-a22e-eec010271242 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:54.544502 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c72d2-1204-4db2-862b-3bc00d1c22f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:54.545314 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c72d2-1204-4db2-862b-3bc00d1c22f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:54.545634 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c72d2-1204-4db2-862b-3bc00d1c22f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:54.545910 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c72d2-1204-4db2-862b-3bc00d1c22f5 admin admin] PATH_INFO: `/v3/projects/e7541e4fe56d4df78e88963e79a690e3/users/e66e9994637646039998f70a10f923eb/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:54.548102 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c72d2-1204-4db2-862b-3bc00d1c22f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7541e4fe56d4df78e88963e79a690e3, user_id=e66e9994637646039998f70a10f923eb, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:54.550915 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c72d2-1204-4db2-862b-3bc00d1c22f5 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:54.561973 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-d291628f-f47d-4931-949f-8498405bf1b3 admin admin] The token cache is being invalidate because project 8d7c3ef13ab246688276dd494e86352e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:34:54.562261 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-d291628f-f47d-4931-949f-8498405bf1b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:54.562913 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-d291628f-f47d-4931-949f-8498405bf1b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:54.565062 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1103/2198] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:34:54 2021] DELETE /identity/v3/projects/8d7c3ef13ab246688276dd494e86352e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:54.570392 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94aa0e8-b102-4dfb-a1e4-5d193598fd83 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:54.571427 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94aa0e8-b102-4dfb-a1e4-5d193598fd83 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:54.572175 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94aa0e8-b102-4dfb-a1e4-5d193598fd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:54.578919 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1096/2199] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:54 2021] PUT /identity/v3/projects/e7541e4fe56d4df78e88963e79a690e3/users/e66e9994637646039998f70a10f923eb/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:54.588979 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef051fc-c23d-4658-bea1-bbc615162802 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:54.589297 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef051fc-c23d-4658-bea1-bbc615162802 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:54.590294 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef051fc-c23d-4658-bea1-bbc615162802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:54.605126 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-d94aa0e8-b102-4dfb-a1e4-5d193598fd83 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:54.606420 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-d94aa0e8-b102-4dfb-a1e4-5d193598fd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:54.621656 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-3ef051fc-c23d-4658-bea1-bbc615162802 None None] MFA Rules not processed for user `e66e9994637646039998f70a10f923eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:54.622854 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-3ef051fc-c23d-4658-bea1-bbc615162802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:54.686792 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1104/2200] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:54.689709 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94aa0e8-b102-4dfb-a1e4-5d193598fd83 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:54.691417 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-d94aa0e8-b102-4dfb-a1e4-5d193598fd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:54.707370 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94aa0e8-b102-4dfb-a1e4-5d193598fd83 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:54.713237 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b0034-19e5-4a33-8451-4766a0e7f012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:54.714345 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b0034-19e5-4a33-8451-4766a0e7f012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:54.714694 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b0034-19e5-4a33-8451-4766a0e7f012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:54.715039 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b0034-19e5-4a33-8451-4766a0e7f012 admin admin] PATH_INFO: `/v3/projects/63d1266a3862465781548aa97182656a` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:54.716367 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61b0034-19e5-4a33-8451-4766a0e7f012 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63d1266a3862465781548aa97182656a)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:54.718385 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61b0034-19e5-4a33-8451-4766a0e7f012 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:54.728912 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1097/2201] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:54 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:34:54.729904 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef051fc-c23d-4658-bea1-bbc615162802 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:54.731323 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-3ef051fc-c23d-4658-bea1-bbc615162802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:54.746850 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef051fc-c23d-4658-bea1-bbc615162802 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:54.753064 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fe057-8104-45a0-bc87-64b5e1c1516d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:54.753946 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fe057-8104-45a0-bc87-64b5e1c1516d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:54.754227 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fe057-8104-45a0-bc87-64b5e1c1516d admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:54.754503 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fe057-8104-45a0-bc87-64b5e1c1516d admin admin] PATH_INFO: `/v3/projects/11b44d27020442f1a83627c7c46cce22` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:54.755726 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fe057-8104-45a0-bc87-64b5e1c1516d admin admin] RBAC: Authorizing `identity:delete_project(project_id=11b44d27020442f1a83627c7c46cce22)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:54.757688 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1fe057-8104-45a0-bc87-64b5e1c1516d admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:54.828828 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-d61b0034-19e5-4a33-8451-4766a0e7f012 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63d1266a3862465781548aa97182656a', 'request_id': 'req-d61b0034-19e5-4a33-8451-4766a0e7f012'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:54.834938 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-d61b0034-19e5-4a33-8451-4766a0e7f012 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63d1266a3862465781548aa97182656a', 'request_id': 'req-d61b0034-19e5-4a33-8451-4766a0e7f012'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:54.841386 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-d61b0034-19e5-4a33-8451-4766a0e7f012 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63d1266a3862465781548aa97182656a', 'request_id': 'req-d61b0034-19e5-4a33-8451-4766a0e7f012'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:54.859167 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-bd1fe057-8104-45a0-bc87-64b5e1c1516d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11b44d27020442f1a83627c7c46cce22', 'request_id': 'req-bd1fe057-8104-45a0-bc87-64b5e1c1516d'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:54.864298 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-bd1fe057-8104-45a0-bc87-64b5e1c1516d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11b44d27020442f1a83627c7c46cce22', 'request_id': 'req-bd1fe057-8104-45a0-bc87-64b5e1c1516d'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:54.870283 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-bd1fe057-8104-45a0-bc87-64b5e1c1516d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11b44d27020442f1a83627c7c46cce22', 'request_id': 'req-bd1fe057-8104-45a0-bc87-64b5e1c1516d'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:54.930958 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-d61b0034-19e5-4a33-8451-4766a0e7f012 admin admin] The token cache is being invalidate because project 63d1266a3862465781548aa97182656a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:34:54.931465 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-d61b0034-19e5-4a33-8451-4766a0e7f012 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:54.931919 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-d61b0034-19e5-4a33-8451-4766a0e7f012 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:54.933485 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1105/2202] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:34:54 2021] DELETE /identity/v3/projects/63d1266a3862465781548aa97182656a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:54.934839 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea7e95-13c3-47b1-b256-5d9af8696da2 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:54.935131 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea7e95-13c3-47b1-b256-5d9af8696da2 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:54.935410 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea7e95-13c3-47b1-b256-5d9af8696da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:54.953286 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-dbea7e95-13c3-47b1-b256-5d9af8696da2 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:54.954502 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-dbea7e95-13c3-47b1-b256-5d9af8696da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:55.013210 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1106/2203] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:55.014086 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea7e95-13c3-47b1-b256-5d9af8696da2 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:55.015327 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-dbea7e95-13c3-47b1-b256-5d9af8696da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:55.024985 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-bd1fe057-8104-45a0-bc87-64b5e1c1516d admin admin] The token cache is being invalidate because project 11b44d27020442f1a83627c7c46cce22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:34:55.025290 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-bd1fe057-8104-45a0-bc87-64b5e1c1516d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:55.027589 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-bd1fe057-8104-45a0-bc87-64b5e1c1516d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:55.028071 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1098/2204] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:34:54 2021] DELETE /identity/v3/projects/11b44d27020442f1a83627c7c46cce22 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:55.029116 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fe057-8104-45a0-bc87-64b5e1c1516d admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:55.030682 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-bd1fe057-8104-45a0-bc87-64b5e1c1516d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:55.044600 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fe057-8104-45a0-bc87-64b5e1c1516d admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:55.049529 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db04c98-5106-4052-aaac-354e50de428b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:55.050646 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db04c98-5106-4052-aaac-354e50de428b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:55.050923 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db04c98-5106-4052-aaac-354e50de428b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:55.051354 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db04c98-5106-4052-aaac-354e50de428b admin admin] PATH_INFO: `/v3/users/9c63decfdc81474bb5daffc6d8cbecf3` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:55.052761 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db04c98-5106-4052-aaac-354e50de428b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c63decfdc81474bb5daffc6d8cbecf3)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:55.055779 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db04c98-5106-4052-aaac-354e50de428b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:55.080224 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea7e95-13c3-47b1-b256-5d9af8696da2 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:55.086519 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e776edb-bc60-438d-989a-0f6489cea9f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:55.087331 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e776edb-bc60-438d-989a-0f6489cea9f3 service cinder] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:55.087615 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e776edb-bc60-438d-989a-0f6489cea9f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:55.090691 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e776edb-bc60-438d-989a-0f6489cea9f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:55.090691 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-7e776edb-bc60-438d-989a-0f6489cea9f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:55.152211 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e776edb-bc60-438d-989a-0f6489cea9f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:55.153734 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e776edb-bc60-438d-989a-0f6489cea9f3 service cinder] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:55.162993 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1107/2205] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:55 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:34:55.163766 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e776edb-bc60-438d-989a-0f6489cea9f3 service cinder] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:55.166216 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-7e776edb-bc60-438d-989a-0f6489cea9f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:55.181613 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e776edb-bc60-438d-989a-0f6489cea9f3 service cinder] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:55.186546 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be013d-345c-4c9a-a40d-d8a735352d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:55.187242 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be013d-345c-4c9a-a40d-d8a735352d6f admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:55.187516 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be013d-345c-4c9a-a40d-d8a735352d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:55.187781 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be013d-345c-4c9a-a40d-d8a735352d6f admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:55.188502 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be013d-345c-4c9a-a40d-d8a735352d6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:34:55.188802 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be013d-345c-4c9a-a40d-d8a735352d6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:55.190381 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be013d-345c-4c9a-a40d-d8a735352d6f admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:55.202146 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1108/2206] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:34:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:34:55.203062 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be013d-345c-4c9a-a40d-d8a735352d6f admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:55.204811 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-e5be013d-345c-4c9a-a40d-d8a735352d6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:55.217440 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be013d-345c-4c9a-a40d-d8a735352d6f admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:55.222035 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cacb1-2192-40ea-86eb-578454ceb961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:55.222862 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cacb1-2192-40ea-86eb-578454ceb961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:55.226500 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cacb1-2192-40ea-86eb-578454ceb961 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:55.226500 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cacb1-2192-40ea-86eb-578454ceb961 admin admin] PATH_INFO: `/v3/users/267a98c2f23a4af3b13fbbada52d7ac0` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:55.226500 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6cacb1-2192-40ea-86eb-578454ceb961 admin admin] RBAC: Authorizing `identity:delete_user(user_id=267a98c2f23a4af3b13fbbada52d7ac0)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:55.226500 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6cacb1-2192-40ea-86eb-578454ceb961 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:55.283856 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-6db04c98-5106-4052-aaac-354e50de428b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c63decfdc81474bb5daffc6d8cbecf3'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:55.284628 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-6db04c98-5106-4052-aaac-354e50de428b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c63decfdc81474bb5daffc6d8cbecf3'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:55.355978 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-6db04c98-5106-4052-aaac-354e50de428b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c63decfdc81474bb5daffc6d8cbecf3'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:55.356209 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-6db04c98-5106-4052-aaac-354e50de428b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c63decfdc81474bb5daffc6d8cbecf3'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:55.372745 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-6db04c98-5106-4052-aaac-354e50de428b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c63decfdc81474bb5daffc6d8cbecf3'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:55.395973 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1099/2207] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:34:55 2021] DELETE /identity/v3/users/9c63decfdc81474bb5daffc6d8cbecf3 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:55.401282 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db04c98-5106-4052-aaac-354e50de428b admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:55.401282 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-6db04c98-5106-4052-aaac-354e50de428b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:55.488801 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-3f6cacb1-2192-40ea-86eb-578454ceb961 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '267a98c2f23a4af3b13fbbada52d7ac0'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:55.491191 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-3f6cacb1-2192-40ea-86eb-578454ceb961 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '267a98c2f23a4af3b13fbbada52d7ac0'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:55.511971 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db04c98-5106-4052-aaac-354e50de428b admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:55.524404 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-3f6cacb1-2192-40ea-86eb-578454ceb961 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '267a98c2f23a4af3b13fbbada52d7ac0'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:55.528985 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-3f6cacb1-2192-40ea-86eb-578454ceb961 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '267a98c2f23a4af3b13fbbada52d7ac0'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:55.532103 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42bea4-fe8c-41c5-a88d-d14cd4c541af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:55.533617 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42bea4-fe8c-41c5-a88d-d14cd4c541af admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:55.534148 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42bea4-fe8c-41c5-a88d-d14cd4c541af admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:55.534659 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d42bea4-fe8c-41c5-a88d-d14cd4c541af admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:55.536350 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d42bea4-fe8c-41c5-a88d-d14cd4c541af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:55.539463 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d42bea4-fe8c-41c5-a88d-d14cd4c541af admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:55.559356 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-3f6cacb1-2192-40ea-86eb-578454ceb961 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '267a98c2f23a4af3b13fbbada52d7ac0'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:55.651951 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1100/2208] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:34:55 2021] POST /identity/v3/projects => generated 375 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:55.656142 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42bea4-fe8c-41c5-a88d-d14cd4c541af admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:55.658103 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-9d42bea4-fe8c-41c5-a88d-d14cd4c541af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:55.673663 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1109/2209] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:34:55 2021] DELETE /identity/v3/users/267a98c2f23a4af3b13fbbada52d7ac0 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:55.742931 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d42bea4-fe8c-41c5-a88d-d14cd4c541af admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:55.808249 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d983670-f391-43e0-8086-ccf5802244ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:55.811101 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cacb1-2192-40ea-86eb-578454ceb961 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:55.811725 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d983670-f391-43e0-8086-ccf5802244ca admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:55.811725 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d983670-f391-43e0-8086-ccf5802244ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:55.811725 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d983670-f391-43e0-8086-ccf5802244ca admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:55.812028 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d983670-f391-43e0-8086-ccf5802244ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:55.812902 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-3f6cacb1-2192-40ea-86eb-578454ceb961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:55.814361 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d983670-f391-43e0-8086-ccf5802244ca admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:55.828478 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cacb1-2192-40ea-86eb-578454ceb961 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:55.834611 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ef8a9-90a7-427b-b983-870edca97af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:55.839647 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ef8a9-90a7-427b-b983-870edca97af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:55.839647 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ef8a9-90a7-427b-b983-870edca97af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:55.839647 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ef8a9-90a7-427b-b983-870edca97af7 admin admin] PATH_INFO: `/v3/users/1384889385cd4a929936e9899e4940a9` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:55.839647 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0ef8a9-90a7-427b-b983-870edca97af7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1384889385cd4a929936e9899e4940a9)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:55.840189 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0ef8a9-90a7-427b-b983-870edca97af7 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:55.896618 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1101/2210] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:34:55 2021] POST /identity/v3/users => generated 288 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:34:55.898311 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d983670-f391-43e0-8086-ccf5802244ca admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:55.909182 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d983670-f391-43e0-8086-ccf5802244ca admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:55.913893 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3064ac-6ed8-483b-a8e5-6ef383e72ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:55.914968 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3064ac-6ed8-483b-a8e5-6ef383e72ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:55.915252 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3064ac-6ed8-483b-a8e5-6ef383e72ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:55.915544 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3064ac-6ed8-483b-a8e5-6ef383e72ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:55.916276 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3064ac-6ed8-483b-a8e5-6ef383e72ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:55.917859 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3064ac-6ed8-483b-a8e5-6ef383e72ef5 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:55.927688 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1102/2211] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:55 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:34:55.931562 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3064ac-6ed8-483b-a8e5-6ef383e72ef5 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:55.940858 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3064ac-6ed8-483b-a8e5-6ef383e72ef5 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:55.946918 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc84118-a7fd-4939-9176-913bcf586312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:55.947754 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc84118-a7fd-4939-9176-913bcf586312 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:55.948084 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc84118-a7fd-4939-9176-913bcf586312 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:55.948366 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc84118-a7fd-4939-9176-913bcf586312 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:55.949092 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc84118-a7fd-4939-9176-913bcf586312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:55.953074 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc84118-a7fd-4939-9176-913bcf586312 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:55.960884 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1103/2212] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:55 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:34:55.965549 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc84118-a7fd-4939-9176-913bcf586312 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:55.974823 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc84118-a7fd-4939-9176-913bcf586312 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:55.979485 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e61c9-0899-4fc9-9e43-0db5e3a67b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:55.980334 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e61c9-0899-4fc9-9e43-0db5e3a67b45 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:55.980615 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e61c9-0899-4fc9-9e43-0db5e3a67b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:55.980888 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e61c9-0899-4fc9-9e43-0db5e3a67b45 admin admin] PATH_INFO: `/v3/projects/40b590d43a4a4aaebf06487cd89b84ba/users/b316cce3d0ec4a9cae48c43b189fcfac/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:55.995239 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e61c9-0899-4fc9-9e43-0db5e3a67b45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40b590d43a4a4aaebf06487cd89b84ba, user_id=b316cce3d0ec4a9cae48c43b189fcfac, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:55.997889 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e61c9-0899-4fc9-9e43-0db5e3a67b45 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:56.079602 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-4c0ef8a9-90a7-427b-b983-870edca97af7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1384889385cd4a929936e9899e4940a9'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:56.080259 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-4c0ef8a9-90a7-427b-b983-870edca97af7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1384889385cd4a929936e9899e4940a9'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:56.087912 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-4c0ef8a9-90a7-427b-b983-870edca97af7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1384889385cd4a929936e9899e4940a9'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:56.088622 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-4c0ef8a9-90a7-427b-b983-870edca97af7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1384889385cd4a929936e9899e4940a9'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:56.099808 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-4c0ef8a9-90a7-427b-b983-870edca97af7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1384889385cd4a929936e9899e4940a9'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:56.125988 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1104/2213] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:55 2021] PUT /identity/v3/projects/40b590d43a4a4aaebf06487cd89b84ba/users/b316cce3d0ec4a9cae48c43b189fcfac/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:56.126942 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e61c9-0899-4fc9-9e43-0db5e3a67b45 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:56.128512 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-ff1e61c9-0899-4fc9-9e43-0db5e3a67b45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:56.177066 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1110/2214] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:34:55 2021] DELETE /identity/v3/users/1384889385cd4a929936e9899e4940a9 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:56.180981 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ef8a9-90a7-427b-b983-870edca97af7 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:56.182382 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-4c0ef8a9-90a7-427b-b983-870edca97af7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:56.191576 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e61c9-0899-4fc9-9e43-0db5e3a67b45 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:56.246008 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738c643-90dd-4b78-b9e7-aa2d95dc2534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:56.246621 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ef8a9-90a7-427b-b983-870edca97af7 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:56.246921 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738c643-90dd-4b78-b9e7-aa2d95dc2534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:56.247201 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738c643-90dd-4b78-b9e7-aa2d95dc2534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:56.247592 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738c643-90dd-4b78-b9e7-aa2d95dc2534 admin admin] PATH_INFO: `/v3/projects/0f471fb0d1ee46ceac1bf2ea7ca3ab29` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:56.248814 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738c643-90dd-4b78-b9e7-aa2d95dc2534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f471fb0d1ee46ceac1bf2ea7ca3ab29)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:56.250726 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738c643-90dd-4b78-b9e7-aa2d95dc2534 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:56.251389 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7eca61-d439-451b-9cec-81ce6d2a518d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:56.252236 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7eca61-d439-451b-9cec-81ce6d2a518d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:56.252511 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7eca61-d439-451b-9cec-81ce6d2a518d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:56.252782 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7eca61-d439-451b-9cec-81ce6d2a518d admin admin] PATH_INFO: `/v3/projects/6cd52637ae14420fb9c8b02404e32924` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:56.253985 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7eca61-d439-451b-9cec-81ce6d2a518d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cd52637ae14420fb9c8b02404e32924)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:56.255829 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7eca61-d439-451b-9cec-81ce6d2a518d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:56.355495 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-7738c643-90dd-4b78-b9e7-aa2d95dc2534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f471fb0d1ee46ceac1bf2ea7ca3ab29', 'request_id': 'req-7738c643-90dd-4b78-b9e7-aa2d95dc2534'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:56.360884 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-7738c643-90dd-4b78-b9e7-aa2d95dc2534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f471fb0d1ee46ceac1bf2ea7ca3ab29', 'request_id': 'req-7738c643-90dd-4b78-b9e7-aa2d95dc2534'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:56.367238 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-7738c643-90dd-4b78-b9e7-aa2d95dc2534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f471fb0d1ee46ceac1bf2ea7ca3ab29', 'request_id': 'req-7738c643-90dd-4b78-b9e7-aa2d95dc2534'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:56.383584 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-1f7eca61-d439-451b-9cec-81ce6d2a518d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cd52637ae14420fb9c8b02404e32924', 'request_id': 'req-1f7eca61-d439-451b-9cec-81ce6d2a518d'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:56.389574 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-1f7eca61-d439-451b-9cec-81ce6d2a518d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cd52637ae14420fb9c8b02404e32924', 'request_id': 'req-1f7eca61-d439-451b-9cec-81ce6d2a518d'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:56.394829 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-1f7eca61-d439-451b-9cec-81ce6d2a518d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cd52637ae14420fb9c8b02404e32924', 'request_id': 'req-1f7eca61-d439-451b-9cec-81ce6d2a518d'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:56.474531 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-7738c643-90dd-4b78-b9e7-aa2d95dc2534 admin admin] The token cache is being invalidate because project 0f471fb0d1ee46ceac1bf2ea7ca3ab29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:34:56.474829 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-7738c643-90dd-4b78-b9e7-aa2d95dc2534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:56.475463 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-7738c643-90dd-4b78-b9e7-aa2d95dc2534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:56.478038 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1105/2215] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:34:56 2021] DELETE /identity/v3/projects/0f471fb0d1ee46ceac1bf2ea7ca3ab29 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:56.479203 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1a578-a43e-45bc-b369-2c8d6b4d16cb None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:56.479504 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1a578-a43e-45bc-b369-2c8d6b4d16cb None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:56.479775 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1a578-a43e-45bc-b369-2c8d6b4d16cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:56.507374 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-c1c1a578-a43e-45bc-b369-2c8d6b4d16cb None None] MFA Rules not processed for user `b316cce3d0ec4a9cae48c43b189fcfac`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:56.509221 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-c1c1a578-a43e-45bc-b369-2c8d6b4d16cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:56.559991 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-1f7eca61-d439-451b-9cec-81ce6d2a518d admin admin] The token cache is being invalidate because project 6cd52637ae14420fb9c8b02404e32924 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:34:56.560336 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-1f7eca61-d439-451b-9cec-81ce6d2a518d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:56.560935 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-1f7eca61-d439-451b-9cec-81ce6d2a518d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:56.562495 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1111/2216] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:34:56 2021] DELETE /identity/v3/projects/6cd52637ae14420fb9c8b02404e32924 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:56.563700 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab38077-228e-4003-a4cf-cfe7218d39a3 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:56.564123 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab38077-228e-4003-a4cf-cfe7218d39a3 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:56.564454 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab38077-228e-4003-a4cf-cfe7218d39a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:56.572402 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1106/2217] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:56 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:56.573969 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdb516-ac07-4573-bc77-38af65be8558 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:56.574421 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdb516-ac07-4573-bc77-38af65be8558 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:56.574941 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdb516-ac07-4573-bc77-38af65be8558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:56.583418 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-fab38077-228e-4003-a4cf-cfe7218d39a3 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:56.584730 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-fab38077-228e-4003-a4cf-cfe7218d39a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:56.593853 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-bfbdb516-ac07-4573-bc77-38af65be8558 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:56.595076 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-bfbdb516-ac07-4573-bc77-38af65be8558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:56.645116 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1112/2218] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:56.646487 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7926223-ef83-49ed-9c83-3ddbea693224 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:56.646737 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7926223-ef83-49ed-9c83-3ddbea693224 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:56.647016 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7926223-ef83-49ed-9c83-3ddbea693224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:56.665646 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1107/2219] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:56.666520 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdb516-ac07-4573-bc77-38af65be8558 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:56.667951 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-bfbdb516-ac07-4573-bc77-38af65be8558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:56.672844 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-f7926223-ef83-49ed-9c83-3ddbea693224 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:56.674267 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-f7926223-ef83-49ed-9c83-3ddbea693224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:56.689628 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1113/2220] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:56.690602 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7926223-ef83-49ed-9c83-3ddbea693224 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:56.698508 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-f7926223-ef83-49ed-9c83-3ddbea693224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:56.729165 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdb516-ac07-4573-bc77-38af65be8558 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:56.733785 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e434993-67a4-452c-9383-d63f50ebbdbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:56.734664 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e434993-67a4-452c-9383-d63f50ebbdbc service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:56.735019 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e434993-67a4-452c-9383-d63f50ebbdbc service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:56.735372 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e434993-67a4-452c-9383-d63f50ebbdbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:56.737271 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-1e434993-67a4-452c-9383-d63f50ebbdbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:56.749763 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e434993-67a4-452c-9383-d63f50ebbdbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:56.752707 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e434993-67a4-452c-9383-d63f50ebbdbc service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:56.765206 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1108/2221] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:56 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:34:56.765842 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd112c-ca1a-4fd7-8058-85c106ec908a None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:56.766552 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd112c-ca1a-4fd7-8058-85c106ec908a None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:56.766552 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd112c-ca1a-4fd7-8058-85c106ec908a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:56.791159 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7926223-ef83-49ed-9c83-3ddbea693224 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:56.795028 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-21cd112c-ca1a-4fd7-8058-85c106ec908a None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:56.797170 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-21cd112c-ca1a-4fd7-8058-85c106ec908a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:56.800247 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cddd9-2392-45f3-95ac-3837e707fa1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:56.801127 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cddd9-2392-45f3-95ac-3837e707fa1c service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:56.801800 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cddd9-2392-45f3-95ac-3837e707fa1c service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:56.802255 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cddd9-2392-45f3-95ac-3837e707fa1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:56.815122 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1109/2222] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:56.817318 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6cddd9-2392-45f3-95ac-3837e707fa1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:56.818817 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6cddd9-2392-45f3-95ac-3837e707fa1c service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:56.819714 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6c524-2df4-4ada-9e22-7d4e28076d30 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:56.820006 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6c524-2df4-4ada-9e22-7d4e28076d30 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:56.820287 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6c524-2df4-4ada-9e22-7d4e28076d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:56.830436 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1114/2223] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:34:56.831332 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cddd9-2392-45f3-95ac-3837e707fa1c service neutron] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:56.841431 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-68c6c524-2df4-4ada-9e22-7d4e28076d30 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:56.842579 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cddd9-2392-45f3-95ac-3837e707fa1c service neutron] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:56.842943 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-68c6c524-2df4-4ada-9e22-7d4e28076d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:56.847991 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4240cd-3038-4c6e-90b2-dce881f1e8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:56.848674 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4240cd-3038-4c6e-90b2-dce881f1e8f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:56.848956 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4240cd-3038-4c6e-90b2-dce881f1e8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:56.849297 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4240cd-3038-4c6e-90b2-dce881f1e8f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:56.850086 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4240cd-3038-4c6e-90b2-dce881f1e8f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:34:56.850398 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4240cd-3038-4c6e-90b2-dce881f1e8f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:56.852198 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4240cd-3038-4c6e-90b2-dce881f1e8f5 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:56.853111 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1110/2224] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:56.858557 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6c524-2df4-4ada-9e22-7d4e28076d30 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:56.868869 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1115/2225] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:34:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:34:56.873675 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4240cd-3038-4c6e-90b2-dce881f1e8f5 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:56.876158 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6c524-2df4-4ada-9e22-7d4e28076d30 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:56.882080 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eeb396-172f-436c-8dd0-eebb947f9ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:56.882861 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eeb396-172f-436c-8dd0-eebb947f9ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:56.883537 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eeb396-172f-436c-8dd0-eebb947f9ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:56.883893 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eeb396-172f-436c-8dd0-eebb947f9ee4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:56.885031 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eeb396-172f-436c-8dd0-eebb947f9ee4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:34:56.887288 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4240cd-3038-4c6e-90b2-dce881f1e8f5 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:56.893873 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eeb396-172f-436c-8dd0-eebb947f9ee4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:56.894239 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81901761-31d1-433e-8e35-3f83a75dcebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:56.894965 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81901761-31d1-433e-8e35-3f83a75dcebd admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:56.897808 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81901761-31d1-433e-8e35-3f83a75dcebd admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:56.897808 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81901761-31d1-433e-8e35-3f83a75dcebd admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:56.897808 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81901761-31d1-433e-8e35-3f83a75dcebd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:56.898062 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eeb396-172f-436c-8dd0-eebb947f9ee4 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:56.898482 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81901761-31d1-433e-8e35-3f83a75dcebd admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:56.918636 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1111/2226] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:34:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:34:56.919855 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eeb396-172f-436c-8dd0-eebb947f9ee4 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:56.932516 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eeb396-172f-436c-8dd0-eebb947f9ee4 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:56.945396 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d4285-7f79-46f0-a4b0-234243dcb520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:56.947067 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d4285-7f79-46f0-a4b0-234243dcb520 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:56.947067 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d4285-7f79-46f0-a4b0-234243dcb520 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:56.947067 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d4285-7f79-46f0-a4b0-234243dcb520 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:56.947911 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d4285-7f79-46f0-a4b0-234243dcb520 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:56.950025 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d4285-7f79-46f0-a4b0-234243dcb520 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:57.042875 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1116/2227] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:34:56 2021] POST /identity/v3/projects => generated 375 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:57.043972 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81901761-31d1-433e-8e35-3f83a75dcebd admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:57.069287 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1112/2228] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:34:56 2021] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:57.075155 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d4285-7f79-46f0-a4b0-234243dcb520 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:57.160017 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81901761-31d1-433e-8e35-3f83a75dcebd admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:57.175635 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d4285-7f79-46f0-a4b0-234243dcb520 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:57.182165 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4395b-e17c-4721-bc09-40317de90407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:57.182890 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4395b-e17c-4721-bc09-40317de90407 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:57.183173 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4395b-e17c-4721-bc09-40317de90407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:57.183445 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4395b-e17c-4721-bc09-40317de90407 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:57.184148 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4395b-e17c-4721-bc09-40317de90407 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:57.186138 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4395b-e17c-4721-bc09-40317de90407 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:57.230763 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11a977-23dd-4acc-8a82-2b1722fc9cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:57.231435 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11a977-23dd-4acc-8a82-2b1722fc9cbf admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:57.231720 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11a977-23dd-4acc-8a82-2b1722fc9cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:57.232024 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11a977-23dd-4acc-8a82-2b1722fc9cbf admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:57.232743 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd11a977-23dd-4acc-8a82-2b1722fc9cbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:57.234663 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd11a977-23dd-4acc-8a82-2b1722fc9cbf admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:57.314794 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1113/2229] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:34:57 2021] POST /identity/v3/users => generated 292 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:57.318905 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4395b-e17c-4721-bc09-40317de90407 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:57.329345 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4395b-e17c-4721-bc09-40317de90407 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:57.334054 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e0653-c5f1-45e0-8462-63a6d8205c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:57.334689 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e0653-c5f1-45e0-8462-63a6d8205c11 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:57.334971 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e0653-c5f1-45e0-8462-63a6d8205c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:57.335247 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e0653-c5f1-45e0-8462-63a6d8205c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:57.336049 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e0653-c5f1-45e0-8462-63a6d8205c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:57.337799 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e0653-c5f1-45e0-8462-63a6d8205c11 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:57.347546 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1114/2230] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:57 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:34:57.351202 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e0653-c5f1-45e0-8462-63a6d8205c11 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:57.360829 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e0653-c5f1-45e0-8462-63a6d8205c11 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:57.365453 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc14045-6972-4e32-bf9a-a48a64d83560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:57.366000 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc14045-6972-4e32-bf9a-a48a64d83560 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:57.366276 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc14045-6972-4e32-bf9a-a48a64d83560 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:57.366545 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc14045-6972-4e32-bf9a-a48a64d83560 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:57.367245 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc14045-6972-4e32-bf9a-a48a64d83560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:57.369390 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc14045-6972-4e32-bf9a-a48a64d83560 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:57.379578 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1115/2231] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:57 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:34:57.383814 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc14045-6972-4e32-bf9a-a48a64d83560 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:57.391038 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1117/2232] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:34:57 2021] POST /identity/v3/users => generated 288 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:34:57.392001 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11a977-23dd-4acc-8a82-2b1722fc9cbf admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:57.393889 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-cd11a977-23dd-4acc-8a82-2b1722fc9cbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:57.396395 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc14045-6972-4e32-bf9a-a48a64d83560 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:57.402353 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed2bd8-1c6f-4549-8ace-7c7d00078b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:57.403252 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed2bd8-1c6f-4549-8ace-7c7d00078b63 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:57.403528 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed2bd8-1c6f-4549-8ace-7c7d00078b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:57.403824 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed2bd8-1c6f-4549-8ace-7c7d00078b63 admin admin] PATH_INFO: `/v3/projects/3defe0f00d114d658520b90a888c2b27/users/7abf7fb6358141ac9e63cb0713087e7f/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:57.418924 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11a977-23dd-4acc-8a82-2b1722fc9cbf admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:57.426722 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41e5db-b5ca-4b9b-94fb-427a1c7e1c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:57.427719 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41e5db-b5ca-4b9b-94fb-427a1c7e1c8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:57.428085 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41e5db-b5ca-4b9b-94fb-427a1c7e1c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:57.428349 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41e5db-b5ca-4b9b-94fb-427a1c7e1c8b admin admin] PATH_INFO: `/v3/projects/a5d817817e0943fcbb18809eefa13704` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:57.431145 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41e5db-b5ca-4b9b-94fb-427a1c7e1c8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5d817817e0943fcbb18809eefa13704)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:57.432406 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41e5db-b5ca-4b9b-94fb-427a1c7e1c8b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:57.433180 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed2bd8-1c6f-4549-8ace-7c7d00078b63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3defe0f00d114d658520b90a888c2b27, user_id=7abf7fb6358141ac9e63cb0713087e7f, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:57.435787 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed2bd8-1c6f-4549-8ace-7c7d00078b63 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:57.509054 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1116/2233] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:57 2021] PUT /identity/v3/projects/3defe0f00d114d658520b90a888c2b27/users/7abf7fb6358141ac9e63cb0713087e7f/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:57.509907 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed2bd8-1c6f-4549-8ace-7c7d00078b63 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:57.567581 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed2bd8-1c6f-4549-8ace-7c7d00078b63 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:57.572254 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d69a9-1372-44fd-a3ac-8226543fbe58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:57.572909 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d69a9-1372-44fd-a3ac-8226543fbe58 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:57.573187 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d69a9-1372-44fd-a3ac-8226543fbe58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:57.573484 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d69a9-1372-44fd-a3ac-8226543fbe58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:57.574220 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d69a9-1372-44fd-a3ac-8226543fbe58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:57.575765 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d69a9-1372-44fd-a3ac-8226543fbe58 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:57.585689 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1117/2234] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:57 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:57.585689 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c026997-5f0a-4a88-a227-b52f8e22094e None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:57.585689 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c026997-5f0a-4a88-a227-b52f8e22094e None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:57.587539 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c026997-5f0a-4a88-a227-b52f8e22094e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:57.591928 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-bc41e5db-b5ca-4b9b-94fb-427a1c7e1c8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5d817817e0943fcbb18809eefa13704', 'request_id': 'req-bc41e5db-b5ca-4b9b-94fb-427a1c7e1c8b'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:57.598690 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-bc41e5db-b5ca-4b9b-94fb-427a1c7e1c8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5d817817e0943fcbb18809eefa13704', 'request_id': 'req-bc41e5db-b5ca-4b9b-94fb-427a1c7e1c8b'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:57.606045 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-bc41e5db-b5ca-4b9b-94fb-427a1c7e1c8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5d817817e0943fcbb18809eefa13704', 'request_id': 'req-bc41e5db-b5ca-4b9b-94fb-427a1c7e1c8b'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:57.621924 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-2c026997-5f0a-4a88-a227-b52f8e22094e None None] MFA Rules not processed for user `7abf7fb6358141ac9e63cb0713087e7f`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:57.621924 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-2c026997-5f0a-4a88-a227-b52f8e22094e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:57.680560 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1118/2235] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:57 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:57.681399 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c026997-5f0a-4a88-a227-b52f8e22094e None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:57.706010 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-bc41e5db-b5ca-4b9b-94fb-427a1c7e1c8b admin admin] The token cache is being invalidate because project a5d817817e0943fcbb18809eefa13704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:34:57.706628 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-bc41e5db-b5ca-4b9b-94fb-427a1c7e1c8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:57.707739 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-bc41e5db-b5ca-4b9b-94fb-427a1c7e1c8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:57.710835 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1118/2236] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:34:57 2021] DELETE /identity/v3/projects/a5d817817e0943fcbb18809eefa13704 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:57.713092 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41e5db-b5ca-4b9b-94fb-427a1c7e1c8b admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:57.715623 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-bc41e5db-b5ca-4b9b-94fb-427a1c7e1c8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:57.768377 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c026997-5f0a-4a88-a227-b52f8e22094e None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:57.773432 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea631e4-b38d-46d9-816d-5b3ea85dc2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:57.775041 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea631e4-b38d-46d9-816d-5b3ea85dc2ac admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:57.775818 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea631e4-b38d-46d9-816d-5b3ea85dc2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:57.776181 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea631e4-b38d-46d9-816d-5b3ea85dc2ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:57.777169 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea631e4-b38d-46d9-816d-5b3ea85dc2ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:57.779122 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea631e4-b38d-46d9-816d-5b3ea85dc2ac admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:57.791174 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1119/2237] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:57 2021] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:57.792039 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea631e4-b38d-46d9-816d-5b3ea85dc2ac admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:57.794016 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-1ea631e4-b38d-46d9-816d-5b3ea85dc2ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:57.807400 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41e5db-b5ca-4b9b-94fb-427a1c7e1c8b admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:57.807583 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea631e4-b38d-46d9-816d-5b3ea85dc2ac admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:57.812344 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc19ba5-0a3c-4e52-9209-7e10ae3a56f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:57.812777 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b2613-cd02-41e8-aac2-7384ed035f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:57.813021 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc19ba5-0a3c-4e52-9209-7e10ae3a56f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:57.813300 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc19ba5-0a3c-4e52-9209-7e10ae3a56f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:57.813630 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc19ba5-0a3c-4e52-9209-7e10ae3a56f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:57.813742 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b2613-cd02-41e8-aac2-7384ed035f3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:57.813982 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b2613-cd02-41e8-aac2-7384ed035f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:57.814324 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b2613-cd02-41e8-aac2-7384ed035f3c admin admin] PATH_INFO: `/v3/users/e66e9994637646039998f70a10f923eb` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:57.814437 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc19ba5-0a3c-4e52-9209-7e10ae3a56f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:57.815483 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b2613-cd02-41e8-aac2-7384ed035f3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e66e9994637646039998f70a10f923eb)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:57.816200 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc19ba5-0a3c-4e52-9209-7e10ae3a56f3 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:57.817394 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b2613-cd02-41e8-aac2-7384ed035f3c admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:57.904350 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1119/2238] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:34:57 2021] POST /identity/v3/projects => generated 383 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:57.905282 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc19ba5-0a3c-4e52-9209-7e10ae3a56f3 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:57.906839 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-5dc19ba5-0a3c-4e52-9209-7e10ae3a56f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:57.972031 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc19ba5-0a3c-4e52-9209-7e10ae3a56f3 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:57.976671 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8158a-c3c9-4a25-962b-39078843f8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:57.978172 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8158a-c3c9-4a25-962b-39078843f8bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:57.978454 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8158a-c3c9-4a25-962b-39078843f8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:57.978751 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8158a-c3c9-4a25-962b-39078843f8bb admin admin] PATH_INFO: `/v3/projects/0c047bad97094523a07eed09ac4a7175/users/febe872cfbc34bfe97cc5982e4f2200e/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:57.994461 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8158a-c3c9-4a25-962b-39078843f8bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c047bad97094523a07eed09ac4a7175, user_id=febe872cfbc34bfe97cc5982e4f2200e, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:57.997150 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8158a-c3c9-4a25-962b-39078843f8bb admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:58.041989 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-412b2613-cd02-41e8-aac2-7384ed035f3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e66e9994637646039998f70a10f923eb'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:58.042642 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-412b2613-cd02-41e8-aac2-7384ed035f3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e66e9994637646039998f70a10f923eb'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:58.105977 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1120/2239] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:57 2021] PUT /identity/v3/projects/0c047bad97094523a07eed09ac4a7175/users/febe872cfbc34bfe97cc5982e4f2200e/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:58.106815 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8158a-c3c9-4a25-962b-39078843f8bb admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:58.138426 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-412b2613-cd02-41e8-aac2-7384ed035f3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e66e9994637646039998f70a10f923eb'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:58.139216 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-412b2613-cd02-41e8-aac2-7384ed035f3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e66e9994637646039998f70a10f923eb'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:58.156655 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-412b2613-cd02-41e8-aac2-7384ed035f3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e66e9994637646039998f70a10f923eb'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:58.173801 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1120/2240] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:34:57 2021] DELETE /identity/v3/users/e66e9994637646039998f70a10f923eb => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:58.175214 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45508e2-ff19-46f2-b675-04e227afe20e None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:58.175553 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45508e2-ff19-46f2-b675-04e227afe20e None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:58.184109 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45508e2-ff19-46f2-b675-04e227afe20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:58.208286 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8158a-c3c9-4a25-962b-39078843f8bb admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:58.210230 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-d45508e2-ff19-46f2-b675-04e227afe20e None None] MFA Rules not processed for user `febe872cfbc34bfe97cc5982e4f2200e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:58.224225 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-d45508e2-ff19-46f2-b675-04e227afe20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:58.279618 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ca0248-a89a-47ce-bf91-1abd96a4417d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:58.280522 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca0248-a89a-47ce-bf91-1abd96a4417d admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:58.280976 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca0248-a89a-47ce-bf91-1abd96a4417d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:58.281272 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca0248-a89a-47ce-bf91-1abd96a4417d admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:58.284746 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ca0248-a89a-47ce-bf91-1abd96a4417d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:58.284972 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ca0248-a89a-47ce-bf91-1abd96a4417d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:58.328456 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1121/2241] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:58 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:58.338064 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45508e2-ff19-46f2-b675-04e227afe20e None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:58.340370 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-d45508e2-ff19-46f2-b675-04e227afe20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:58.409706 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45508e2-ff19-46f2-b675-04e227afe20e None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:58.413929 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ca981-6028-4c31-9cd1-13b8c382db61 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '544443ed44ef41bcaa86af52926bfd14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:58.415310 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ca981-6028-4c31-9cd1-13b8c382db61 service glance] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:58.415722 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ca981-6028-4c31-9cd1-13b8c382db61 service glance] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:58.416198 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ca981-6028-4c31-9cd1-13b8c382db61 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:58.425684 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ca981-6028-4c31-9cd1-13b8c382db61 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:58.433780 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ca981-6028-4c31-9cd1-13b8c382db61 service glance] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:58.440569 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1122/2242] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:58 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:34:58.458529 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1121/2243] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:34:58 2021] POST /identity/v3/users => generated 292 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:58.464533 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ca981-6028-4c31-9cd1-13b8c382db61 service glance] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:58.465502 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-4d3ca981-6028-4c31-9cd1-13b8c382db61 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:58.482659 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ca981-6028-4c31-9cd1-13b8c382db61 service glance] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:58.488562 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5b09d-f22a-4e88-8208-c00e4c174eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:58.489247 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5b09d-f22a-4e88-8208-c00e4c174eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:58.489658 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5b09d-f22a-4e88-8208-c00e4c174eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:58.489941 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5b09d-f22a-4e88-8208-c00e4c174eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:58.490736 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5b09d-f22a-4e88-8208-c00e4c174eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:58.493025 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5b09d-f22a-4e88-8208-c00e4c174eb6 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:58.509326 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1123/2244] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:58 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:58.510737 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ca0248-a89a-47ce-bf91-1abd96a4417d admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:58.525185 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ca0248-a89a-47ce-bf91-1abd96a4417d admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:58.531554 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fa4df-069c-4a11-ae04-e2453967ffd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:58.532465 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fa4df-069c-4a11-ae04-e2453967ffd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:58.532728 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fa4df-069c-4a11-ae04-e2453967ffd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:58.533074 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fa4df-069c-4a11-ae04-e2453967ffd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:58.533937 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3fa4df-069c-4a11-ae04-e2453967ffd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:58.535598 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3fa4df-069c-4a11-ae04-e2453967ffd4 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:58.549448 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1122/2245] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:58 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:58.552136 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5b09d-f22a-4e88-8208-c00e4c174eb6 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:58.563074 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5b09d-f22a-4e88-8208-c00e4c174eb6 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:58.568303 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fd2c6-c283-47c1-b321-b9e2ac0b1308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:58.569358 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fd2c6-c283-47c1-b321-b9e2ac0b1308 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:58.569703 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fd2c6-c283-47c1-b321-b9e2ac0b1308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:58.569984 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fd2c6-c283-47c1-b321-b9e2ac0b1308 admin admin] PATH_INFO: `/v3/projects/28227a7aed324ef4ae79d1186a550112/users/2241a85270454f1ba12de8e8d5a0f398/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:58.588426 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98fd2c6-c283-47c1-b321-b9e2ac0b1308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28227a7aed324ef4ae79d1186a550112, user_id=2241a85270454f1ba12de8e8d5a0f398, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:58.591162 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98fd2c6-c283-47c1-b321-b9e2ac0b1308 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:58.675370 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1124/2246] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:58 2021] PUT /identity/v3/projects/28227a7aed324ef4ae79d1186a550112/users/2241a85270454f1ba12de8e8d5a0f398/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:58.685435 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9a5e9-55ed-4249-b4b8-37a5ef876a7d None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:58.685768 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9a5e9-55ed-4249-b4b8-37a5ef876a7d None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:58.686049 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9a5e9-55ed-4249-b4b8-37a5ef876a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:58.717964 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-e7e9a5e9-55ed-4249-b4b8-37a5ef876a7d None None] MFA Rules not processed for user `2241a85270454f1ba12de8e8d5a0f398`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:58.717964 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-e7e9a5e9-55ed-4249-b4b8-37a5ef876a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:58.769065 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fd2c6-c283-47c1-b321-b9e2ac0b1308 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:58.771076 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-b98fd2c6-c283-47c1-b321-b9e2ac0b1308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:58.822309 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1123/2247] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:58 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:58.823947 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9a5e9-55ed-4249-b4b8-37a5ef876a7d None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:58.857537 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fd2c6-c283-47c1-b321-b9e2ac0b1308 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:58.862492 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab954c7-f742-4420-8f37-579dc0cf553a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:58.863357 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab954c7-f742-4420-8f37-579dc0cf553a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:58.863678 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab954c7-f742-4420-8f37-579dc0cf553a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:58.863919 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab954c7-f742-4420-8f37-579dc0cf553a admin admin] PATH_INFO: `/v3/projects/e7541e4fe56d4df78e88963e79a690e3` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:58.865142 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab954c7-f742-4420-8f37-579dc0cf553a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7541e4fe56d4df78e88963e79a690e3)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:58.867092 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab954c7-f742-4420-8f37-579dc0cf553a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:58.895490 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9a5e9-55ed-4249-b4b8-37a5ef876a7d None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:58.900645 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729495ad-6107-4595-91e6-04f92160ad18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:58.901292 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729495ad-6107-4595-91e6-04f92160ad18 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:58.905583 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729495ad-6107-4595-91e6-04f92160ad18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:58.905583 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729495ad-6107-4595-91e6-04f92160ad18 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:58.905583 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729495ad-6107-4595-91e6-04f92160ad18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:58.905583 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729495ad-6107-4595-91e6-04f92160ad18 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:58.979269 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-fab954c7-f742-4420-8f37-579dc0cf553a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7541e4fe56d4df78e88963e79a690e3', 'request_id': 'req-fab954c7-f742-4420-8f37-579dc0cf553a'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:58.984664 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-fab954c7-f742-4420-8f37-579dc0cf553a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7541e4fe56d4df78e88963e79a690e3', 'request_id': 'req-fab954c7-f742-4420-8f37-579dc0cf553a'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:58.990815 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-fab954c7-f742-4420-8f37-579dc0cf553a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7541e4fe56d4df78e88963e79a690e3', 'request_id': 'req-fab954c7-f742-4420-8f37-579dc0cf553a'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:59.013962 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1124/2248] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:34:58 2021] POST /identity/v3/projects => generated 385 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:34:59.017813 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729495ad-6107-4595-91e6-04f92160ad18 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:59.091260 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-fab954c7-f742-4420-8f37-579dc0cf553a admin admin] The token cache is being invalidate because project e7541e4fe56d4df78e88963e79a690e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:34:59.091260 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-fab954c7-f742-4420-8f37-579dc0cf553a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:59.091875 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-fab954c7-f742-4420-8f37-579dc0cf553a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:34:59.093486 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1125/2249] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:34:58 2021] DELETE /identity/v3/projects/e7541e4fe56d4df78e88963e79a690e3 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:59.099235 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f5c7f-ac59-47d8-a4e1-cdc5c843af7d None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:59.099623 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f5c7f-ac59-47d8-a4e1-cdc5c843af7d None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:59.099995 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f5c7f-ac59-47d8-a4e1-cdc5c843af7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:59.113935 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729495ad-6107-4595-91e6-04f92160ad18 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:59.121666 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c47c60-1681-4461-b46d-af6516978f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:59.122343 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c47c60-1681-4461-b46d-af6516978f66 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:59.122650 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c47c60-1681-4461-b46d-af6516978f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:59.122922 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c47c60-1681-4461-b46d-af6516978f66 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:59.123632 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c47c60-1681-4461-b46d-af6516978f66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:59.125591 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c47c60-1681-4461-b46d-af6516978f66 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:59.131297 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-f17f5c7f-ac59-47d8-a4e1-cdc5c843af7d None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:59.132682 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-f17f5c7f-ac59-47d8-a4e1-cdc5c843af7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:59.142179 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1126/2250] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:59.151904 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7ad6e-eb82-478e-9f9c-ca640ebde9bd None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:59.159623 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7ad6e-eb82-478e-9f9c-ca640ebde9bd None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:59.159932 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7ad6e-eb82-478e-9f9c-ca640ebde9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:59.178915 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-03c7ad6e-eb82-478e-9f9c-ca640ebde9bd None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:59.180458 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-03c7ad6e-eb82-478e-9f9c-ca640ebde9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:59.188800 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1127/2251] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:34:59.192932 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7ad6e-eb82-478e-9f9c-ca640ebde9bd None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:59.203616 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7ad6e-eb82-478e-9f9c-ca640ebde9bd None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:59.208617 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac30963-7ce5-4502-9236-e957a71598d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:59.209169 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac30963-7ce5-4502-9236-e957a71598d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:59.209594 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac30963-7ce5-4502-9236-e957a71598d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:59.210187 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac30963-7ce5-4502-9236-e957a71598d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:59.211967 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac30963-7ce5-4502-9236-e957a71598d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:34:59.212384 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac30963-7ce5-4502-9236-e957a71598d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:59.214093 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac30963-7ce5-4502-9236-e957a71598d8 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:59.229687 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1125/2252] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:34:59 2021] POST /identity/v3/users => generated 299 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:34:59.231590 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1128/2253] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:34:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:34:59.235593 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c47c60-1681-4461-b46d-af6516978f66 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:59.235951 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac30963-7ce5-4502-9236-e957a71598d8 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:59.237301 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-58c47c60-1681-4461-b46d-af6516978f66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:59.247000 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac30963-7ce5-4502-9236-e957a71598d8 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:59.255053 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c47c60-1681-4461-b46d-af6516978f66 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:59.260180 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ddb2d5-2ead-4291-b02a-663ae7c831f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:59.260842 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddb2d5-2ead-4291-b02a-663ae7c831f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:59.261130 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddb2d5-2ead-4291-b02a-663ae7c831f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:59.262081 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddb2d5-2ead-4291-b02a-663ae7c831f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:59.262228 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a80543-e24f-4ac9-ad25-987d3af23519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:59.262228 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a80543-e24f-4ac9-ad25-987d3af23519 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:59.263423 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ddb2d5-2ead-4291-b02a-663ae7c831f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:59.263515 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a80543-e24f-4ac9-ad25-987d3af23519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:59.263515 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a80543-e24f-4ac9-ad25-987d3af23519 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:59.263983 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a80543-e24f-4ac9-ad25-987d3af23519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:59.265070 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ddb2d5-2ead-4291-b02a-663ae7c831f6 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:59.265811 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a80543-e24f-4ac9-ad25-987d3af23519 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:59.278200 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1126/2254] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:59 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:59.282008 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a80543-e24f-4ac9-ad25-987d3af23519 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:59.292178 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a80543-e24f-4ac9-ad25-987d3af23519 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:59.297099 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca230971-5e14-4396-b34e-c6919694fa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:59.298051 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca230971-5e14-4396-b34e-c6919694fa30 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:59.298337 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca230971-5e14-4396-b34e-c6919694fa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:59.298612 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca230971-5e14-4396-b34e-c6919694fa30 admin admin] PATH_INFO: `/v3/projects/15726b0ea4064a2fbc497b7f3518ea76/users/ab51c8f9394d41b0871ea2eb901398b3/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:59.313916 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca230971-5e14-4396-b34e-c6919694fa30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15726b0ea4064a2fbc497b7f3518ea76, user_id=ab51c8f9394d41b0871ea2eb901398b3, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:59.316677 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca230971-5e14-4396-b34e-c6919694fa30 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:59.401324 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1127/2255] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:59 2021] PUT /identity/v3/projects/15726b0ea4064a2fbc497b7f3518ea76/users/ab51c8f9394d41b0871ea2eb901398b3/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:59.408328 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1129/2256] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:34:59 2021] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:34:59.410524 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca230971-5e14-4396-b34e-c6919694fa30 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:59.412148 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ddb2d5-2ead-4291-b02a-663ae7c831f6 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:59.509188 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ddb2d5-2ead-4291-b02a-663ae7c831f6 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:59.514234 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64078f-2680-40ae-8b10-5a5dd5178979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:59.515052 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64078f-2680-40ae-8b10-5a5dd5178979 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:59.517545 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64078f-2680-40ae-8b10-5a5dd5178979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:59.517545 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64078f-2680-40ae-8b10-5a5dd5178979 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:59.517545 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb64078f-2680-40ae-8b10-5a5dd5178979 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:59.517898 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca230971-5e14-4396-b34e-c6919694fa30 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:59.518431 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb64078f-2680-40ae-8b10-5a5dd5178979 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:59.523418 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7c390-1eaf-4170-a7dc-0a56849463e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:59.524886 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7c390-1eaf-4170-a7dc-0a56849463e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:59.525228 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7c390-1eaf-4170-a7dc-0a56849463e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:59.525602 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7c390-1eaf-4170-a7dc-0a56849463e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:59.526596 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b7c390-1eaf-4170-a7dc-0a56849463e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:59.528599 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b7c390-1eaf-4170-a7dc-0a56849463e3 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:59.540603 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1128/2257] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:59 2021] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:59.544680 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7c390-1eaf-4170-a7dc-0a56849463e3 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:59.554591 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7c390-1eaf-4170-a7dc-0a56849463e3 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:59.560598 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a70847-b8ae-45b9-9acb-0875636c1029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:59.561516 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a70847-b8ae-45b9-9acb-0875636c1029 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:59.562101 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a70847-b8ae-45b9-9acb-0875636c1029 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:59.562101 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a70847-b8ae-45b9-9acb-0875636c1029 admin admin] PATH_INFO: `/v3/projects/15726b0ea4064a2fbc497b7f3518ea76/users/ab51c8f9394d41b0871ea2eb901398b3/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:59.564062 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a70847-b8ae-45b9-9acb-0875636c1029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15726b0ea4064a2fbc497b7f3518ea76, user_id=ab51c8f9394d41b0871ea2eb901398b3, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:59.566722 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a70847-b8ae-45b9-9acb-0875636c1029 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:59.583840 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1129/2258] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:59 2021] PUT /identity/v3/projects/15726b0ea4064a2fbc497b7f3518ea76/users/ab51c8f9394d41b0871ea2eb901398b3/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:34:59.595970 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe66b7-3148-4b30-bc03-eaa71df54506 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:59.596261 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe66b7-3148-4b30-bc03-eaa71df54506 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:59.596538 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe66b7-3148-4b30-bc03-eaa71df54506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:59.623518 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-6cbe66b7-3148-4b30-bc03-eaa71df54506 None None] MFA Rules not processed for user `ab51c8f9394d41b0871ea2eb901398b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:59.624719 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-6cbe66b7-3148-4b30-bc03-eaa71df54506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:59.629151 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1130/2259] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:34:59 2021] POST /identity/v3/users => generated 287 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:34:59.633035 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64078f-2680-40ae-8b10-5a5dd5178979 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:59.643638 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64078f-2680-40ae-8b10-5a5dd5178979 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:59.702842 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1130/2260] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:59 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:34:59.706386 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4059827-2065-492e-a2d1-6937e18e4074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:59.707058 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4059827-2065-492e-a2d1-6937e18e4074 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:59.707343 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4059827-2065-492e-a2d1-6937e18e4074 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:59.707618 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4059827-2065-492e-a2d1-6937e18e4074 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:59.708359 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4059827-2065-492e-a2d1-6937e18e4074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:59.709956 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4059827-2065-492e-a2d1-6937e18e4074 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:59.720760 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1131/2261] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:59 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:34:59.724622 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe66b7-3148-4b30-bc03-eaa71df54506 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:59.734874 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe66b7-3148-4b30-bc03-eaa71df54506 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:59.739730 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea409ea5-2254-4a2c-b915-2e093383651c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:59.740381 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea409ea5-2254-4a2c-b915-2e093383651c admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:59.740656 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea409ea5-2254-4a2c-b915-2e093383651c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:59.740924 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea409ea5-2254-4a2c-b915-2e093383651c admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:59.741877 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea409ea5-2254-4a2c-b915-2e093383651c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:59.743903 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea409ea5-2254-4a2c-b915-2e093383651c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:59.751951 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4059827-2065-492e-a2d1-6937e18e4074 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:59.753766 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-f4059827-2065-492e-a2d1-6937e18e4074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:59.754186 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1131/2262] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:34:59 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:34:59.758687 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea409ea5-2254-4a2c-b915-2e093383651c admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:34:59.769872 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea409ea5-2254-4a2c-b915-2e093383651c admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:59.775464 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd4c2c-60a8-48eb-884b-b7b9875877b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:59.776359 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd4c2c-60a8-48eb-884b-b7b9875877b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:59.776649 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd4c2c-60a8-48eb-884b-b7b9875877b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:59.776922 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd4c2c-60a8-48eb-884b-b7b9875877b6 admin admin] PATH_INFO: `/v3/projects/2b1ac19abf834056a4a2b515a3cdc916/users/d6e9f02ef541473c9588d0788896a7c0/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:59.792449 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fd4c2c-60a8-48eb-884b-b7b9875877b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b1ac19abf834056a4a2b515a3cdc916, user_id=d6e9f02ef541473c9588d0788896a7c0, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:59.795097 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fd4c2c-60a8-48eb-884b-b7b9875877b6 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:59.814374 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4059827-2065-492e-a2d1-6937e18e4074 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:34:59.818092 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316ab6c-ae09-4992-a2e8-b228cc5de8d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:34:59.818733 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316ab6c-ae09-4992-a2e8-b228cc5de8d6 service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:59.819019 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316ab6c-ae09-4992-a2e8-b228cc5de8d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:59.819295 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316ab6c-ae09-4992-a2e8-b228cc5de8d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:59.821854 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-f316ab6c-ae09-4992-a2e8-b228cc5de8d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:34:59.898417 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1132/2263] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:34:59 2021] PUT /identity/v3/projects/2b1ac19abf834056a4a2b515a3cdc916/users/d6e9f02ef541473c9588d0788896a7c0/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:34:59.901307 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c8249-46fd-4e7b-ae5e-be87ed615281 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:34:59.904940 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c8249-46fd-4e7b-ae5e-be87ed615281 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:34:59.905420 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c8249-46fd-4e7b-ae5e-be87ed615281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:34:59.906595 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316ab6c-ae09-4992-a2e8-b228cc5de8d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:34:59.908326 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316ab6c-ae09-4992-a2e8-b228cc5de8d6 service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:34:59.921765 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1132/2264] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:34:59 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:34:59.969762 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-024c8249-46fd-4e7b-ae5e-be87ed615281 None None] MFA Rules not processed for user `d6e9f02ef541473c9588d0788896a7c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:34:59.976100 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-024c8249-46fd-4e7b-ae5e-be87ed615281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:00.057344 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1133/2265] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:34:59 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:35:00.068143 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316ab6c-ae09-4992-a2e8-b228cc5de8d6 service cinder] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:00.073879 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-f316ab6c-ae09-4992-a2e8-b228cc5de8d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:00.083418 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316ab6c-ae09-4992-a2e8-b228cc5de8d6 service cinder] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:00.132612 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8bab8f-dcfe-450a-aa1a-1907079d96f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:00.133917 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8bab8f-dcfe-450a-aa1a-1907079d96f9 service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:00.134184 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8bab8f-dcfe-450a-aa1a-1907079d96f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:00.134464 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8bab8f-dcfe-450a-aa1a-1907079d96f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:00.145037 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8bab8f-dcfe-450a-aa1a-1907079d96f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:00.146897 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8bab8f-dcfe-450a-aa1a-1907079d96f9 service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:00.157163 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1133/2266] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:35:00 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:35:00.177972 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c8249-46fd-4e7b-ae5e-be87ed615281 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:00.256455 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c8249-46fd-4e7b-ae5e-be87ed615281 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:00.262321 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88420d25-0e03-45aa-bb00-0e1962afdf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:00.263175 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88420d25-0e03-45aa-bb00-0e1962afdf31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:00.263456 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88420d25-0e03-45aa-bb00-0e1962afdf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:00.263725 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88420d25-0e03-45aa-bb00-0e1962afdf31 admin admin] PATH_INFO: `/v3/users/d6e9f02ef541473c9588d0788896a7c0` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:00.264964 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88420d25-0e03-45aa-bb00-0e1962afdf31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6e9f02ef541473c9588d0788896a7c0)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:00.266901 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88420d25-0e03-45aa-bb00-0e1962afdf31 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:00.403602 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-88420d25-0e03-45aa-bb00-0e1962afdf31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6e9f02ef541473c9588d0788896a7c0'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:00.404348 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-88420d25-0e03-45aa-bb00-0e1962afdf31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6e9f02ef541473c9588d0788896a7c0'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:00.412161 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-88420d25-0e03-45aa-bb00-0e1962afdf31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6e9f02ef541473c9588d0788896a7c0'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:00.413117 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-88420d25-0e03-45aa-bb00-0e1962afdf31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6e9f02ef541473c9588d0788896a7c0'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:00.461590 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-88420d25-0e03-45aa-bb00-0e1962afdf31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6e9f02ef541473c9588d0788896a7c0'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:00.548557 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1134/2267] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:35:00 2021] DELETE /identity/v3/users/d6e9f02ef541473c9588d0788896a7c0 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:35:00.558021 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc06ea1-e47f-4e16-8442-007b525303a0 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:00.558314 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc06ea1-e47f-4e16-8442-007b525303a0 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:00.558590 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc06ea1-e47f-4e16-8442-007b525303a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:00.577761 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-4dc06ea1-e47f-4e16-8442-007b525303a0 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:35:00.577761 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-4dc06ea1-e47f-4e16-8442-007b525303a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:00.642328 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1134/2268] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:35:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:35:00.653384 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88420d25-0e03-45aa-bb00-0e1962afdf31 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:00.655056 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-88420d25-0e03-45aa-bb00-0e1962afdf31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:00.728983 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88420d25-0e03-45aa-bb00-0e1962afdf31 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:00.731915 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e05f0-cd29-4885-baa9-c12020be73f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:00.732625 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e05f0-cd29-4885-baa9-c12020be73f2 service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:00.733360 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e05f0-cd29-4885-baa9-c12020be73f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:00.733360 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e05f0-cd29-4885-baa9-c12020be73f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:00.744934 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e05f0-cd29-4885-baa9-c12020be73f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:00.746904 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e05f0-cd29-4885-baa9-c12020be73f2 service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:00.756675 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1135/2269] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:35:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:35:01.334063 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc06ea1-e47f-4e16-8442-007b525303a0 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:01.335575 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-4dc06ea1-e47f-4e16-8442-007b525303a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:01.359813 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc06ea1-e47f-4e16-8442-007b525303a0 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:01.365269 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d9e1a-187a-4392-bf65-df2045e85670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:01.365770 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d9e1a-187a-4392-bf65-df2045e85670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:01.366407 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d9e1a-187a-4392-bf65-df2045e85670 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:01.366687 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d9e1a-187a-4392-bf65-df2045e85670 admin admin] PATH_INFO: `/v3/projects/2b1ac19abf834056a4a2b515a3cdc916` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:01.368710 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d9e1a-187a-4392-bf65-df2045e85670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b1ac19abf834056a4a2b515a3cdc916)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:01.370707 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d9e1a-187a-4392-bf65-df2045e85670 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:01.500678 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-499d9e1a-187a-4392-bf65-df2045e85670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b1ac19abf834056a4a2b515a3cdc916', 'request_id': 'req-499d9e1a-187a-4392-bf65-df2045e85670'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:01.506186 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-499d9e1a-187a-4392-bf65-df2045e85670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b1ac19abf834056a4a2b515a3cdc916', 'request_id': 'req-499d9e1a-187a-4392-bf65-df2045e85670'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:01.517003 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-499d9e1a-187a-4392-bf65-df2045e85670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b1ac19abf834056a4a2b515a3cdc916', 'request_id': 'req-499d9e1a-187a-4392-bf65-df2045e85670'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:01.663814 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-499d9e1a-187a-4392-bf65-df2045e85670 admin admin] The token cache is being invalidate because project 2b1ac19abf834056a4a2b515a3cdc916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:35:01.666371 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-499d9e1a-187a-4392-bf65-df2045e85670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:01.666371 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-499d9e1a-187a-4392-bf65-df2045e85670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:01.667130 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1135/2270] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:35:01 2021] DELETE /identity/v3/projects/2b1ac19abf834056a4a2b515a3cdc916 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:35:01.673927 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514eb13f-b343-47af-af87-c6cabab936ff None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:01.674480 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514eb13f-b343-47af-af87-c6cabab936ff None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:01.674480 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514eb13f-b343-47af-af87-c6cabab936ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:01.691947 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-514eb13f-b343-47af-af87-c6cabab936ff None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:35:01.693117 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-514eb13f-b343-47af-af87-c6cabab936ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:01.753865 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1136/2271] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:35:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:35:01.761359 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f05825-764b-434b-849c-ef97195634df None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:01.761876 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f05825-764b-434b-849c-ef97195634df None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:01.762212 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f05825-764b-434b-849c-ef97195634df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:01.787612 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-01f05825-764b-434b-849c-ef97195634df None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:35:01.788824 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-01f05825-764b-434b-849c-ef97195634df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:01.803975 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1136/2272] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:35:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:35:01.811210 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514eb13f-b343-47af-af87-c6cabab936ff None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:01.842542 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514eb13f-b343-47af-af87-c6cabab936ff None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:01.858167 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954547f-8068-48ba-a947-90c2b8f5a4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:01.859021 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954547f-8068-48ba-a947-90c2b8f5a4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:01.859429 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954547f-8068-48ba-a947-90c2b8f5a4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:01.859889 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954547f-8068-48ba-a947-90c2b8f5a4c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:01.860870 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d954547f-8068-48ba-a947-90c2b8f5a4c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:35:01.861390 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d954547f-8068-48ba-a947-90c2b8f5a4c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:01.863525 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d954547f-8068-48ba-a947-90c2b8f5a4c0 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:01.878889 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1137/2273] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:35:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:35:01.883812 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f05825-764b-434b-849c-ef97195634df None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:01.893746 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f05825-764b-434b-849c-ef97195634df None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:01.902424 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910d9a6-0144-49d3-894c-3c0804537c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:01.903177 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910d9a6-0144-49d3-894c-3c0804537c97 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:01.903452 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910d9a6-0144-49d3-894c-3c0804537c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:01.903725 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910d9a6-0144-49d3-894c-3c0804537c97 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:01.904432 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910d9a6-0144-49d3-894c-3c0804537c97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:01.906350 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910d9a6-0144-49d3-894c-3c0804537c97 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:01.998601 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1137/2274] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:35:01 2021] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:35:02.002339 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954547f-8068-48ba-a947-90c2b8f5a4c0 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:02.012274 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954547f-8068-48ba-a947-90c2b8f5a4c0 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:02.067735 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7427b-b442-4dd4-8298-86d43fd2549a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:02.068466 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7427b-b442-4dd4-8298-86d43fd2549a admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:02.068754 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7427b-b442-4dd4-8298-86d43fd2549a admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:02.069030 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7427b-b442-4dd4-8298-86d43fd2549a admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:02.069778 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b7427b-b442-4dd4-8298-86d43fd2549a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:02.071867 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b7427b-b442-4dd4-8298-86d43fd2549a admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:02.128295 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910d9a6-0144-49d3-894c-3c0804537c97 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:02.130044 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-0910d9a6-0144-49d3-894c-3c0804537c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:02.148784 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1138/2275] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:35:02 2021] POST /identity/v3/users => generated 288 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:35:02.152983 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7427b-b442-4dd4-8298-86d43fd2549a admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:02.163000 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7427b-b442-4dd4-8298-86d43fd2549a admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:02.169200 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca323ff7-5d69-4acc-b998-0f89fe7c247c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:02.169886 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca323ff7-5d69-4acc-b998-0f89fe7c247c admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:02.170194 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca323ff7-5d69-4acc-b998-0f89fe7c247c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:02.170466 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca323ff7-5d69-4acc-b998-0f89fe7c247c admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:02.171506 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca323ff7-5d69-4acc-b998-0f89fe7c247c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:02.172791 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca323ff7-5d69-4acc-b998-0f89fe7c247c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:02.184261 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1139/2276] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:35:02 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:35:02.188462 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca323ff7-5d69-4acc-b998-0f89fe7c247c admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:02.205057 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910d9a6-0144-49d3-894c-3c0804537c97 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:02.205836 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca323ff7-5d69-4acc-b998-0f89fe7c247c admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:02.209571 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609bda5-a98e-4a5d-969a-fb0b787eb993 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:02.210290 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609bda5-a98e-4a5d-969a-fb0b787eb993 service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:02.210485 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1318ba7-255b-4f9d-8ba9-7215bf116f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:02.210706 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609bda5-a98e-4a5d-969a-fb0b787eb993 service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:02.211097 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609bda5-a98e-4a5d-969a-fb0b787eb993 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:02.211231 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1318ba7-255b-4f9d-8ba9-7215bf116f0d admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:02.211399 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1318ba7-255b-4f9d-8ba9-7215bf116f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:02.211671 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1318ba7-255b-4f9d-8ba9-7215bf116f0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:02.212950 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1318ba7-255b-4f9d-8ba9-7215bf116f0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:02.214858 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1318ba7-255b-4f9d-8ba9-7215bf116f0d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:02.217291 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-1609bda5-a98e-4a5d-969a-fb0b787eb993 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:02.226181 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1140/2277] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:35:02 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:35:02.231603 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1318ba7-255b-4f9d-8ba9-7215bf116f0d admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:02.241801 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1318ba7-255b-4f9d-8ba9-7215bf116f0d admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:02.246838 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384a38a-069d-4ecd-bab5-a36ef7a12638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:02.247709 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384a38a-069d-4ecd-bab5-a36ef7a12638 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:02.247983 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384a38a-069d-4ecd-bab5-a36ef7a12638 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:02.248241 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384a38a-069d-4ecd-bab5-a36ef7a12638 admin admin] PATH_INFO: `/v3/projects/5f0a1660e1fa40bb8b2575afb749ffbc/users/307e05dd2e9e43209d849b705b1f3727/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:02.264779 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5384a38a-069d-4ecd-bab5-a36ef7a12638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f0a1660e1fa40bb8b2575afb749ffbc, user_id=307e05dd2e9e43209d849b705b1f3727, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:02.267552 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5384a38a-069d-4ecd-bab5-a36ef7a12638 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:02.291377 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609bda5-a98e-4a5d-969a-fb0b787eb993 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:02.292747 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609bda5-a98e-4a5d-969a-fb0b787eb993 service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:02.301309 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1138/2278] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:35:02 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:35:02.394705 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1141/2279] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:35:02 2021] PUT /identity/v3/projects/5f0a1660e1fa40bb8b2575afb749ffbc/users/307e05dd2e9e43209d849b705b1f3727/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:35:02.406166 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce22d98-3003-44e6-b184-44b68747a875 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:02.406866 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce22d98-3003-44e6-b184-44b68747a875 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:02.406866 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce22d98-3003-44e6-b184-44b68747a875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:02.432794 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-0ce22d98-3003-44e6-b184-44b68747a875 None None] MFA Rules not processed for user `307e05dd2e9e43209d849b705b1f3727`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:35:02.434040 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-0ce22d98-3003-44e6-b184-44b68747a875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:02.500928 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1139/2280] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:35:02 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:35:02.511015 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384a38a-069d-4ecd-bab5-a36ef7a12638 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:02.574118 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384a38a-069d-4ecd-bab5-a36ef7a12638 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:02.579048 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d81dec-2704-422c-aa8e-f02158ca8f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:02.579691 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d81dec-2704-422c-aa8e-f02158ca8f04 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:02.579970 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d81dec-2704-422c-aa8e-f02158ca8f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:02.580244 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d81dec-2704-422c-aa8e-f02158ca8f04 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:02.581005 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d81dec-2704-422c-aa8e-f02158ca8f04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:02.583085 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d81dec-2704-422c-aa8e-f02158ca8f04 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:02.659486 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1142/2281] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:35:02 2021] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:35:02.663696 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce22d98-3003-44e6-b184-44b68747a875 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:02.675501 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce22d98-3003-44e6-b184-44b68747a875 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:02.735349 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290f7e8-96c6-42ef-975e-37294065168f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:02.736120 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290f7e8-96c6-42ef-975e-37294065168f admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:02.736407 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290f7e8-96c6-42ef-975e-37294065168f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:02.736687 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290f7e8-96c6-42ef-975e-37294065168f admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:02.737428 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290f7e8-96c6-42ef-975e-37294065168f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:02.739364 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290f7e8-96c6-42ef-975e-37294065168f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:02.812385 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1140/2282] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:35:02 2021] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:35:02.816672 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d81dec-2704-422c-aa8e-f02158ca8f04 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:02.828945 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d81dec-2704-422c-aa8e-f02158ca8f04 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:02.833758 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c815dd-17de-4a8b-87c3-33104fda1888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:02.834442 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c815dd-17de-4a8b-87c3-33104fda1888 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:02.834772 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c815dd-17de-4a8b-87c3-33104fda1888 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:02.835094 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c815dd-17de-4a8b-87c3-33104fda1888 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:02.835839 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c815dd-17de-4a8b-87c3-33104fda1888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:02.838789 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c815dd-17de-4a8b-87c3-33104fda1888 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:02.859886 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1143/2283] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:35:02 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:35:02.861938 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290f7e8-96c6-42ef-975e-37294065168f admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:02.878781 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290f7e8-96c6-42ef-975e-37294065168f admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:02.886806 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cfdac7-c74d-469d-8c3d-6174a888305a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:02.888363 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cfdac7-c74d-469d-8c3d-6174a888305a admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:02.888864 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cfdac7-c74d-469d-8c3d-6174a888305a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:02.889434 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cfdac7-c74d-469d-8c3d-6174a888305a admin admin] PATH_INFO: `/v3/projects/631c868425ac4873afb1e1c6aae74875/users/f49ea728c2a34de99945852e193c29d3/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:02.923425 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cfdac7-c74d-469d-8c3d-6174a888305a admin admin] RBAC: Authorizing `identity:create_grant(project_id=631c868425ac4873afb1e1c6aae74875, user_id=f49ea728c2a34de99945852e193c29d3, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:02.923425 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cfdac7-c74d-469d-8c3d-6174a888305a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:03.002279 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1141/2284] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:35:02 2021] PUT /identity/v3/projects/631c868425ac4873afb1e1c6aae74875/users/f49ea728c2a34de99945852e193c29d3/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:35:03.003887 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c815dd-17de-4a8b-87c3-33104fda1888 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:03.016095 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c815dd-17de-4a8b-87c3-33104fda1888 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:03.087375 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eae91b-6e0c-4801-a92d-1fbb8e18063e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:03.088554 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eae91b-6e0c-4801-a92d-1fbb8e18063e admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:03.089040 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eae91b-6e0c-4801-a92d-1fbb8e18063e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:03.089371 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eae91b-6e0c-4801-a92d-1fbb8e18063e admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:03.090377 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eae91b-6e0c-4801-a92d-1fbb8e18063e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:03.092244 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eae91b-6e0c-4801-a92d-1fbb8e18063e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:03.111059 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1144/2285] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:35:03 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:35:03.115509 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cfdac7-c74d-469d-8c3d-6174a888305a admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:03.138903 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cfdac7-c74d-469d-8c3d-6174a888305a admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:03.147403 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf336132-20aa-4b2c-aa77-e75a0b9f525b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:03.148308 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf336132-20aa-4b2c-aa77-e75a0b9f525b admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:03.149651 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf336132-20aa-4b2c-aa77-e75a0b9f525b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:03.155890 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf336132-20aa-4b2c-aa77-e75a0b9f525b admin admin] PATH_INFO: `/v3/projects/631c868425ac4873afb1e1c6aae74875/users/f49ea728c2a34de99945852e193c29d3/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:03.155890 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf336132-20aa-4b2c-aa77-e75a0b9f525b admin admin] RBAC: Authorizing `identity:create_grant(project_id=631c868425ac4873afb1e1c6aae74875, user_id=f49ea728c2a34de99945852e193c29d3, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:03.155890 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf336132-20aa-4b2c-aa77-e75a0b9f525b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:03.166551 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1142/2286] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:35:03 2021] PUT /identity/v3/projects/631c868425ac4873afb1e1c6aae74875/users/f49ea728c2a34de99945852e193c29d3/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:35:03.177443 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3346b-030b-4e1e-a061-7f4b5c2b5fa4 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:03.177733 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3346b-030b-4e1e-a061-7f4b5c2b5fa4 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:03.178015 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3346b-030b-4e1e-a061-7f4b5c2b5fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:03.215825 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-1be3346b-030b-4e1e-a061-7f4b5c2b5fa4 None None] MFA Rules not processed for user `f49ea728c2a34de99945852e193c29d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:35:03.217999 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-1be3346b-030b-4e1e-a061-7f4b5c2b5fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:03.310859 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1145/2287] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:35:03 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:35:03.317450 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf336132-20aa-4b2c-aa77-e75a0b9f525b admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:03.324532 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-bf336132-20aa-4b2c-aa77-e75a0b9f525b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:03.387447 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf336132-20aa-4b2c-aa77-e75a0b9f525b admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:03.393384 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c229303d-eff5-4d62-b373-208733ec26d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:03.394657 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229303d-eff5-4d62-b373-208733ec26d7 service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:03.395330 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229303d-eff5-4d62-b373-208733ec26d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:03.395611 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229303d-eff5-4d62-b373-208733ec26d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:03.460717 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c229303d-eff5-4d62-b373-208733ec26d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:03.463163 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c229303d-eff5-4d62-b373-208733ec26d7 service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:03.472209 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1143/2288] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:35:03 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:35:03.725285 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3346b-030b-4e1e-a061-7f4b5c2b5fa4 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:03.726395 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-1be3346b-030b-4e1e-a061-7f4b5c2b5fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:03.830232 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3346b-030b-4e1e-a061-7f4b5c2b5fa4 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:03.835971 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda87dc-f27a-4872-a5cb-43e292c376c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:03.837850 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda87dc-f27a-4872-a5cb-43e292c376c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:03.838268 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda87dc-f27a-4872-a5cb-43e292c376c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:03.838447 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda87dc-f27a-4872-a5cb-43e292c376c5 admin admin] PATH_INFO: `/v3/users/0b94a91bd86644e8af60a7e50c29ab5b` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:03.839693 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda87dc-f27a-4872-a5cb-43e292c376c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b94a91bd86644e8af60a7e50c29ab5b)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:03.841652 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda87dc-f27a-4872-a5cb-43e292c376c5 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:04.008270 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-1cda87dc-f27a-4872-a5cb-43e292c376c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b94a91bd86644e8af60a7e50c29ab5b'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:04.009238 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-1cda87dc-f27a-4872-a5cb-43e292c376c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b94a91bd86644e8af60a7e50c29ab5b'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:04.018762 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-1cda87dc-f27a-4872-a5cb-43e292c376c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b94a91bd86644e8af60a7e50c29ab5b'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:04.019492 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-1cda87dc-f27a-4872-a5cb-43e292c376c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b94a91bd86644e8af60a7e50c29ab5b'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:04.033434 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-1cda87dc-f27a-4872-a5cb-43e292c376c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b94a91bd86644e8af60a7e50c29ab5b'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:04.123921 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1146/2289] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:35:03 2021] DELETE /identity/v3/users/0b94a91bd86644e8af60a7e50c29ab5b => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:35:04.131724 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa89232-6028-40f9-b4b7-93dc854eaafe None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:04.132511 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa89232-6028-40f9-b4b7-93dc854eaafe None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:04.133056 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa89232-6028-40f9-b4b7-93dc854eaafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:04.144544 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda87dc-f27a-4872-a5cb-43e292c376c5 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:04.149400 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-1cda87dc-f27a-4872-a5cb-43e292c376c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:04.160192 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-1aa89232-6028-40f9-b4b7-93dc854eaafe None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:35:04.168915 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-1aa89232-6028-40f9-b4b7-93dc854eaafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:04.222411 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda87dc-f27a-4872-a5cb-43e292c376c5 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:04.230859 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7969c5-9972-4756-ae81-9e22328eb0c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:04.231850 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7969c5-9972-4756-ae81-9e22328eb0c3 service cinder] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:04.232130 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7969c5-9972-4756-ae81-9e22328eb0c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:04.232402 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7969c5-9972-4756-ae81-9e22328eb0c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:04.234930 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-1a7969c5-9972-4756-ae81-9e22328eb0c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:04.297506 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1144/2290] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:35:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:35:04.319282 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa89232-6028-40f9-b4b7-93dc854eaafe None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:04.323532 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-1aa89232-6028-40f9-b4b7-93dc854eaafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:04.346240 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7969c5-9972-4756-ae81-9e22328eb0c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:04.348416 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7969c5-9972-4756-ae81-9e22328eb0c3 service cinder] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:04.392079 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1147/2291] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:35:04 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:35:04.419061 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa89232-6028-40f9-b4b7-93dc854eaafe None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:04.424235 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795c1d2-990c-4cdf-ba72-e4548c6c138d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:04.426559 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795c1d2-990c-4cdf-ba72-e4548c6c138d service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:04.426559 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795c1d2-990c-4cdf-ba72-e4548c6c138d service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:04.426559 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795c1d2-990c-4cdf-ba72-e4548c6c138d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:04.448844 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795c1d2-990c-4cdf-ba72-e4548c6c138d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:04.450696 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795c1d2-990c-4cdf-ba72-e4548c6c138d service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:04.471752 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1145/2292] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:35:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:35:04.877795 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7969c5-9972-4756-ae81-9e22328eb0c3 service cinder] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:04.878881 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-1a7969c5-9972-4756-ae81-9e22328eb0c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:04.907118 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7969c5-9972-4756-ae81-9e22328eb0c3 service cinder] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:04.921080 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926adbb-34a4-4e38-8b49-ea1003588418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:04.922172 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926adbb-34a4-4e38-8b49-ea1003588418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:04.926321 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926adbb-34a4-4e38-8b49-ea1003588418 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:04.926321 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926adbb-34a4-4e38-8b49-ea1003588418 admin admin] PATH_INFO: `/v3/projects/d88cb76f80dc40eab09248e90b44d38d` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:04.926321 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926adbb-34a4-4e38-8b49-ea1003588418 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d88cb76f80dc40eab09248e90b44d38d)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:04.926321 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926adbb-34a4-4e38-8b49-ea1003588418 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:05.052397 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-6926adbb-34a4-4e38-8b49-ea1003588418 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd88cb76f80dc40eab09248e90b44d38d', 'request_id': 'req-6926adbb-34a4-4e38-8b49-ea1003588418'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:05.058733 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-6926adbb-34a4-4e38-8b49-ea1003588418 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd88cb76f80dc40eab09248e90b44d38d', 'request_id': 'req-6926adbb-34a4-4e38-8b49-ea1003588418'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:05.064520 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-6926adbb-34a4-4e38-8b49-ea1003588418 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd88cb76f80dc40eab09248e90b44d38d', 'request_id': 'req-6926adbb-34a4-4e38-8b49-ea1003588418'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:05.125868 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-6926adbb-34a4-4e38-8b49-ea1003588418 admin admin] The token cache is being invalidate because project d88cb76f80dc40eab09248e90b44d38d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:35:05.126263 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-6926adbb-34a4-4e38-8b49-ea1003588418 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:05.126762 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-6926adbb-34a4-4e38-8b49-ea1003588418 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:05.128287 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1148/2293] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:35:04 2021] DELETE /identity/v3/projects/d88cb76f80dc40eab09248e90b44d38d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:35:05.135491 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1bf57-d4d4-4eea-bc05-bd8f983c1b9a None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:05.135778 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1bf57-d4d4-4eea-bc05-bd8f983c1b9a None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:05.136077 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1bf57-d4d4-4eea-bc05-bd8f983c1b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:05.154109 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-abd1bf57-d4d4-4eea-bc05-bd8f983c1b9a None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:35:05.156304 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-abd1bf57-d4d4-4eea-bc05-bd8f983c1b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:05.232487 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1146/2294] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:35:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:35:05.241645 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231c991-7b14-4f91-a6ef-04ff39c1ceff None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:05.242391 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231c991-7b14-4f91-a6ef-04ff39c1ceff None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:05.242827 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231c991-7b14-4f91-a6ef-04ff39c1ceff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:05.264882 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-5231c991-7b14-4f91-a6ef-04ff39c1ceff None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:35:05.266224 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-5231c991-7b14-4f91-a6ef-04ff39c1ceff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:05.276451 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1149/2295] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:35:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:35:05.280441 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1bf57-d4d4-4eea-bc05-bd8f983c1b9a None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:05.290962 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1bf57-d4d4-4eea-bc05-bd8f983c1b9a None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:05.295793 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593d937-d9cd-4a7e-b86d-696df2655315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:05.296519 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593d937-d9cd-4a7e-b86d-696df2655315 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:05.296868 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593d937-d9cd-4a7e-b86d-696df2655315 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:05.297209 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593d937-d9cd-4a7e-b86d-696df2655315 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:05.298051 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593d937-d9cd-4a7e-b86d-696df2655315 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:35:05.298538 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593d937-d9cd-4a7e-b86d-696df2655315 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:05.300185 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593d937-d9cd-4a7e-b86d-696df2655315 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:05.313611 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1147/2296] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:35:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:35:05.317955 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231c991-7b14-4f91-a6ef-04ff39c1ceff None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:05.328013 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231c991-7b14-4f91-a6ef-04ff39c1ceff None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:05.332813 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc4935-7bce-4d68-8498-7d74f74d57bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:05.333496 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc4935-7bce-4d68-8498-7d74f74d57bc admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:05.333783 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc4935-7bce-4d68-8498-7d74f74d57bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:05.334064 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc4935-7bce-4d68-8498-7d74f74d57bc admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:05.335177 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc4935-7bce-4d68-8498-7d74f74d57bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:05.336637 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc4935-7bce-4d68-8498-7d74f74d57bc admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:05.436389 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1150/2297] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:35:05 2021] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:35:05.441966 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593d937-d9cd-4a7e-b86d-696df2655315 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:05.450849 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593d937-d9cd-4a7e-b86d-696df2655315 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:05.538887 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e95e1-5356-4114-9801-975317f16846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:05.539698 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e95e1-5356-4114-9801-975317f16846 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:05.540105 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e95e1-5356-4114-9801-975317f16846 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:05.541047 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e95e1-5356-4114-9801-975317f16846 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:05.542036 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e95e1-5356-4114-9801-975317f16846 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:05.544384 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e95e1-5356-4114-9801-975317f16846 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:05.631458 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1148/2298] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:35:05 2021] POST /identity/v3/users => generated 287 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:35:05.634630 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc4935-7bce-4d68-8498-7d74f74d57bc admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:05.645442 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc4935-7bce-4d68-8498-7d74f74d57bc admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:05.650873 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3b993-71c4-4fe1-a9b0-1ab69a510f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:05.651903 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3b993-71c4-4fe1-a9b0-1ab69a510f5c admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:05.652235 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3b993-71c4-4fe1-a9b0-1ab69a510f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:05.652518 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3b993-71c4-4fe1-a9b0-1ab69a510f5c admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:05.653296 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3b993-71c4-4fe1-a9b0-1ab69a510f5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:05.655048 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3b993-71c4-4fe1-a9b0-1ab69a510f5c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:05.673428 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1151/2299] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:35:05 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:35:05.677455 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e95e1-5356-4114-9801-975317f16846 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:05.687634 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e95e1-5356-4114-9801-975317f16846 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:05.692411 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d768a-7e9c-42cc-bed0-153c518ed12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:05.693231 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d768a-7e9c-42cc-bed0-153c518ed12a admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:05.693614 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d768a-7e9c-42cc-bed0-153c518ed12a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:05.693959 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d768a-7e9c-42cc-bed0-153c518ed12a admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:05.694789 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d768a-7e9c-42cc-bed0-153c518ed12a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:05.696408 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d768a-7e9c-42cc-bed0-153c518ed12a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:05.707382 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1149/2300] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:35:05 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:35:05.711512 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3b993-71c4-4fe1-a9b0-1ab69a510f5c admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:05.722756 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3b993-71c4-4fe1-a9b0-1ab69a510f5c admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:05.727620 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce714f0e-b16b-41b3-b35e-cef1f03a49e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:05.729251 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce714f0e-b16b-41b3-b35e-cef1f03a49e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:05.729810 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce714f0e-b16b-41b3-b35e-cef1f03a49e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:05.730090 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce714f0e-b16b-41b3-b35e-cef1f03a49e6 admin admin] PATH_INFO: `/v3/projects/f548fe5f7dee419498ca7d7e9531af8b/users/d2f46a3429944972925e8c753afad683/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:05.744807 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce714f0e-b16b-41b3-b35e-cef1f03a49e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f548fe5f7dee419498ca7d7e9531af8b, user_id=d2f46a3429944972925e8c753afad683, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:05.747548 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce714f0e-b16b-41b3-b35e-cef1f03a49e6 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:05.841732 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1152/2301] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:35:05 2021] PUT /identity/v3/projects/f548fe5f7dee419498ca7d7e9531af8b/users/d2f46a3429944972925e8c753afad683/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:35:05.852089 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c3d4c-11e7-453c-8d27-7b684106bca7 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:05.852396 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c3d4c-11e7-453c-8d27-7b684106bca7 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:05.852703 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c3d4c-11e7-453c-8d27-7b684106bca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:05.893564 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-a36c3d4c-11e7-453c-8d27-7b684106bca7 None None] MFA Rules not processed for user `d2f46a3429944972925e8c753afad683`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:35:05.894796 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-a36c3d4c-11e7-453c-8d27-7b684106bca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:05.959506 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1150/2302] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:35:05 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:35:05.964194 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce714f0e-b16b-41b3-b35e-cef1f03a49e6 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:06.027994 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce714f0e-b16b-41b3-b35e-cef1f03a49e6 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:06.032495 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f29c46-12ae-444d-9a7f-eaa610a2dc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:06.033322 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f29c46-12ae-444d-9a7f-eaa610a2dc20 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:06.033447 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f29c46-12ae-444d-9a7f-eaa610a2dc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:06.033753 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f29c46-12ae-444d-9a7f-eaa610a2dc20 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:06.034536 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f29c46-12ae-444d-9a7f-eaa610a2dc20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:06.036440 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f29c46-12ae-444d-9a7f-eaa610a2dc20 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:06.117826 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1153/2303] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:35:05 2021] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:35:06.121657 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c3d4c-11e7-453c-8d27-7b684106bca7 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:06.132293 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c3d4c-11e7-453c-8d27-7b684106bca7 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:06.190515 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34edb59-245a-4521-aa32-bcca67e90c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:06.191272 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34edb59-245a-4521-aa32-bcca67e90c52 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:06.191548 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34edb59-245a-4521-aa32-bcca67e90c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:06.191848 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34edb59-245a-4521-aa32-bcca67e90c52 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:06.192585 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34edb59-245a-4521-aa32-bcca67e90c52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:06.194533 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34edb59-245a-4521-aa32-bcca67e90c52 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:06.263571 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1151/2304] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:35:06 2021] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:35:06.270116 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f29c46-12ae-444d-9a7f-eaa610a2dc20 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:06.281093 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f29c46-12ae-444d-9a7f-eaa610a2dc20 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:06.286010 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cc286-faa7-4206-b0b7-00675680feea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:06.286668 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cc286-faa7-4206-b0b7-00675680feea admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:06.286952 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cc286-faa7-4206-b0b7-00675680feea admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:06.290973 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cc286-faa7-4206-b0b7-00675680feea admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:06.290973 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215cc286-faa7-4206-b0b7-00675680feea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:06.290973 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215cc286-faa7-4206-b0b7-00675680feea admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:06.301762 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1154/2305] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:35:06 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:35:06.306306 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34edb59-245a-4521-aa32-bcca67e90c52 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:06.316395 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34edb59-245a-4521-aa32-bcca67e90c52 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:06.321113 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9343b7-2a2b-4577-a759-01ddfa6562fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:06.322537 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9343b7-2a2b-4577-a759-01ddfa6562fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:06.322820 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9343b7-2a2b-4577-a759-01ddfa6562fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:06.323097 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9343b7-2a2b-4577-a759-01ddfa6562fd admin admin] PATH_INFO: `/v3/projects/6e9a24d7eeed4e93b4e6b3f1eef8fa8c/users/f76265a313374b68821498e318ddc086/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:06.338755 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9343b7-2a2b-4577-a759-01ddfa6562fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9a24d7eeed4e93b4e6b3f1eef8fa8c, user_id=f76265a313374b68821498e318ddc086, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:06.341401 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9343b7-2a2b-4577-a759-01ddfa6562fd admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:06.417549 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1152/2306] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:35:06 2021] PUT /identity/v3/projects/6e9a24d7eeed4e93b4e6b3f1eef8fa8c/users/f76265a313374b68821498e318ddc086/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:35:06.421945 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cc286-faa7-4206-b0b7-00675680feea admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:06.432241 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cc286-faa7-4206-b0b7-00675680feea admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:06.496008 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb216b6-af22-4d73-a2e5-c4c27b26a9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:06.496661 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb216b6-af22-4d73-a2e5-c4c27b26a9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:06.496946 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb216b6-af22-4d73-a2e5-c4c27b26a9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:06.497223 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb216b6-af22-4d73-a2e5-c4c27b26a9d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:06.498007 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb216b6-af22-4d73-a2e5-c4c27b26a9d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:06.499585 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb216b6-af22-4d73-a2e5-c4c27b26a9d1 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:06.510041 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1155/2307] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:35:06 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:35:06.513978 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9343b7-2a2b-4577-a759-01ddfa6562fd admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:06.524570 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9343b7-2a2b-4577-a759-01ddfa6562fd admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:06.533923 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97942c05-d16d-4a19-9789-a79feb993e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:06.534525 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb216b6-af22-4d73-a2e5-c4c27b26a9d1 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:06.535034 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97942c05-d16d-4a19-9789-a79feb993e84 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:06.535322 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97942c05-d16d-4a19-9789-a79feb993e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:06.535606 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97942c05-d16d-4a19-9789-a79feb993e84 admin admin] PATH_INFO: `/v3/projects/6e9a24d7eeed4e93b4e6b3f1eef8fa8c/users/f76265a313374b68821498e318ddc086/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:06.536241 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-2fb216b6-af22-4d73-a2e5-c4c27b26a9d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:06.537815 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97942c05-d16d-4a19-9789-a79feb993e84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9a24d7eeed4e93b4e6b3f1eef8fa8c, user_id=f76265a313374b68821498e318ddc086, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:06.540449 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97942c05-d16d-4a19-9789-a79feb993e84 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:06.548653 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb216b6-af22-4d73-a2e5-c4c27b26a9d1 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:06.551433 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1153/2308] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:35:06 2021] PUT /identity/v3/projects/6e9a24d7eeed4e93b4e6b3f1eef8fa8c/users/f76265a313374b68821498e318ddc086/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:35:06.562868 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17297e-c603-4d60-9f7a-fd0b58a1cdc0 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:06.563247 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17297e-c603-4d60-9f7a-fd0b58a1cdc0 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:06.563535 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17297e-c603-4d60-9f7a-fd0b58a1cdc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:06.595138 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-ef17297e-c603-4d60-9f7a-fd0b58a1cdc0 None None] MFA Rules not processed for user `f76265a313374b68821498e318ddc086`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:35:06.596561 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-ef17297e-c603-4d60-9f7a-fd0b58a1cdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:06.607174 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120caba7-096a-4a8d-85ef-df234414a7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:06.608038 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120caba7-096a-4a8d-85ef-df234414a7f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:06.608352 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120caba7-096a-4a8d-85ef-df234414a7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:06.608644 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120caba7-096a-4a8d-85ef-df234414a7f3 admin admin] PATH_INFO: `/v3/users/307e05dd2e9e43209d849b705b1f3727` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:06.609911 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120caba7-096a-4a8d-85ef-df234414a7f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=307e05dd2e9e43209d849b705b1f3727)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:06.611805 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120caba7-096a-4a8d-85ef-df234414a7f3 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:06.668467 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1154/2309] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:35:06 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:35:06.683304 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17297e-c603-4d60-9f7a-fd0b58a1cdc0 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:06.684369 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-ef17297e-c603-4d60-9f7a-fd0b58a1cdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:06.741887 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17297e-c603-4d60-9f7a-fd0b58a1cdc0 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:06.746284 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8952598-f3c9-40ee-9633-3f7a8c306edb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:06.746924 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8952598-f3c9-40ee-9633-3f7a8c306edb service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:06.747204 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8952598-f3c9-40ee-9633-3f7a8c306edb service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:06.747510 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8952598-f3c9-40ee-9633-3f7a8c306edb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:06.756776 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8952598-f3c9-40ee-9633-3f7a8c306edb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:06.758375 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8952598-f3c9-40ee-9633-3f7a8c306edb service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:06.769663 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1155/2310] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:35:06 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:35:06.792283 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-120caba7-096a-4a8d-85ef-df234414a7f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '307e05dd2e9e43209d849b705b1f3727'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:06.792882 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-120caba7-096a-4a8d-85ef-df234414a7f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '307e05dd2e9e43209d849b705b1f3727'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:06.800271 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-120caba7-096a-4a8d-85ef-df234414a7f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '307e05dd2e9e43209d849b705b1f3727'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:06.800954 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-120caba7-096a-4a8d-85ef-df234414a7f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '307e05dd2e9e43209d849b705b1f3727'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:06.814613 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-120caba7-096a-4a8d-85ef-df234414a7f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '307e05dd2e9e43209d849b705b1f3727'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:06.875558 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1156/2311] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:35:06 2021] DELETE /identity/v3/users/307e05dd2e9e43209d849b705b1f3727 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:35:06.880257 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e080047-e66a-4024-8add-c77145a78047 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:06.880544 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e080047-e66a-4024-8add-c77145a78047 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:06.880845 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e080047-e66a-4024-8add-c77145a78047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:06.898526 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-0e080047-e66a-4024-8add-c77145a78047 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:35:06.899931 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-0e080047-e66a-4024-8add-c77145a78047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:06.953889 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120caba7-096a-4a8d-85ef-df234414a7f3 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:06.955989 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-120caba7-096a-4a8d-85ef-df234414a7f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:06.967777 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1156/2312] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:35:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:35:06.977687 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e080047-e66a-4024-8add-c77145a78047 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:06.979044 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-0e080047-e66a-4024-8add-c77145a78047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:07.012155 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120caba7-096a-4a8d-85ef-df234414a7f3 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:07.016058 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925767a9-7b76-471b-8045-2378b0a39ce6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:07.016648 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925767a9-7b76-471b-8045-2378b0a39ce6 service cinder] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:07.016930 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925767a9-7b76-471b-8045-2378b0a39ce6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:07.017210 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925767a9-7b76-471b-8045-2378b0a39ce6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:07.019113 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-925767a9-7b76-471b-8045-2378b0a39ce6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:07.034636 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e080047-e66a-4024-8add-c77145a78047 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:07.038409 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83ef09-df0b-4c0b-a9ea-a3472543aa32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:07.039048 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83ef09-df0b-4c0b-a9ea-a3472543aa32 service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:07.039333 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83ef09-df0b-4c0b-a9ea-a3472543aa32 service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:07.039608 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83ef09-df0b-4c0b-a9ea-a3472543aa32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:07.048795 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83ef09-df0b-4c0b-a9ea-a3472543aa32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:07.050255 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83ef09-df0b-4c0b-a9ea-a3472543aa32 service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:07.060354 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1157/2313] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:35:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:35:07.080043 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925767a9-7b76-471b-8045-2378b0a39ce6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:07.081518 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925767a9-7b76-471b-8045-2378b0a39ce6 service cinder] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:07.090808 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1157/2314] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:35:06 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:35:07.540463 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83ef09-df0b-4c0b-a9ea-a3472543aa32 service neutron] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:07.542837 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-be83ef09-df0b-4c0b-a9ea-a3472543aa32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:07.558968 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83ef09-df0b-4c0b-a9ea-a3472543aa32 service neutron] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:07.562115 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32d9a7-2ad8-4e2d-9929-ac73638cffee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:07.563045 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32d9a7-2ad8-4e2d-9929-ac73638cffee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:07.563405 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32d9a7-2ad8-4e2d-9929-ac73638cffee admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:07.563697 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32d9a7-2ad8-4e2d-9929-ac73638cffee admin admin] PATH_INFO: `/v3/projects/5f0a1660e1fa40bb8b2575afb749ffbc` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:07.564928 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32d9a7-2ad8-4e2d-9929-ac73638cffee admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f0a1660e1fa40bb8b2575afb749ffbc)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:07.566828 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32d9a7-2ad8-4e2d-9929-ac73638cffee admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:07.709917 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-ce32d9a7-2ad8-4e2d-9929-ac73638cffee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f0a1660e1fa40bb8b2575afb749ffbc', 'request_id': 'req-ce32d9a7-2ad8-4e2d-9929-ac73638cffee'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:07.716393 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-ce32d9a7-2ad8-4e2d-9929-ac73638cffee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f0a1660e1fa40bb8b2575afb749ffbc', 'request_id': 'req-ce32d9a7-2ad8-4e2d-9929-ac73638cffee'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:07.723040 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-ce32d9a7-2ad8-4e2d-9929-ac73638cffee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f0a1660e1fa40bb8b2575afb749ffbc', 'request_id': 'req-ce32d9a7-2ad8-4e2d-9929-ac73638cffee'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:07.777918 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-ce32d9a7-2ad8-4e2d-9929-ac73638cffee admin admin] The token cache is being invalidate because project 5f0a1660e1fa40bb8b2575afb749ffbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:35:07.778491 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-ce32d9a7-2ad8-4e2d-9929-ac73638cffee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:07.779089 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-ce32d9a7-2ad8-4e2d-9929-ac73638cffee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:07.780920 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1158/2315] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:35:07 2021] DELETE /identity/v3/projects/5f0a1660e1fa40bb8b2575afb749ffbc => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:35:07.784852 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925767a9-7b76-471b-8045-2378b0a39ce6 service cinder] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:07.800142 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925767a9-7b76-471b-8045-2378b0a39ce6 service cinder] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:07.874931 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f95a8d-b07a-4b09-b0b7-82eac28a0d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:07.875796 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f95a8d-b07a-4b09-b0b7-82eac28a0d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:07.876109 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f95a8d-b07a-4b09-b0b7-82eac28a0d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:07.876377 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f95a8d-b07a-4b09-b0b7-82eac28a0d6f admin admin] PATH_INFO: `/v3/users/f49ea728c2a34de99945852e193c29d3` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:07.877634 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f95a8d-b07a-4b09-b0b7-82eac28a0d6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f49ea728c2a34de99945852e193c29d3)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:07.879502 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f95a8d-b07a-4b09-b0b7-82eac28a0d6f admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:08.095255 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-f3f95a8d-b07a-4b09-b0b7-82eac28a0d6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f49ea728c2a34de99945852e193c29d3'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:08.095963 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-f3f95a8d-b07a-4b09-b0b7-82eac28a0d6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f49ea728c2a34de99945852e193c29d3'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:08.102576 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-f3f95a8d-b07a-4b09-b0b7-82eac28a0d6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f49ea728c2a34de99945852e193c29d3'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:08.103733 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-f3f95a8d-b07a-4b09-b0b7-82eac28a0d6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f49ea728c2a34de99945852e193c29d3'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:08.115009 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-f3f95a8d-b07a-4b09-b0b7-82eac28a0d6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f49ea728c2a34de99945852e193c29d3'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:08.179274 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1158/2316] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:35:07 2021] DELETE /identity/v3/users/f49ea728c2a34de99945852e193c29d3 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:35:08.667013 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32d9a7-2ad8-4e2d-9929-ac73638cffee admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:08.668389 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-ce32d9a7-2ad8-4e2d-9929-ac73638cffee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:08.681131 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32d9a7-2ad8-4e2d-9929-ac73638cffee admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:08.741547 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87b4b7-36ae-44ac-9001-9f2ba1f0ec7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:08.742408 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87b4b7-36ae-44ac-9001-9f2ba1f0ec7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:08.742690 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87b4b7-36ae-44ac-9001-9f2ba1f0ec7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:08.742966 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87b4b7-36ae-44ac-9001-9f2ba1f0ec7e admin admin] PATH_INFO: `/v3/projects/631c868425ac4873afb1e1c6aae74875` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:08.744742 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87b4b7-36ae-44ac-9001-9f2ba1f0ec7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=631c868425ac4873afb1e1c6aae74875)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:08.746658 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87b4b7-36ae-44ac-9001-9f2ba1f0ec7e admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:08.858066 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-db87b4b7-36ae-44ac-9001-9f2ba1f0ec7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '631c868425ac4873afb1e1c6aae74875', 'request_id': 'req-db87b4b7-36ae-44ac-9001-9f2ba1f0ec7e'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:08.863345 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-db87b4b7-36ae-44ac-9001-9f2ba1f0ec7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '631c868425ac4873afb1e1c6aae74875', 'request_id': 'req-db87b4b7-36ae-44ac-9001-9f2ba1f0ec7e'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:08.869924 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-db87b4b7-36ae-44ac-9001-9f2ba1f0ec7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '631c868425ac4873afb1e1c6aae74875', 'request_id': 'req-db87b4b7-36ae-44ac-9001-9f2ba1f0ec7e'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:08.954778 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-db87b4b7-36ae-44ac-9001-9f2ba1f0ec7e admin admin] The token cache is being invalidate because project 631c868425ac4873afb1e1c6aae74875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:35:08.955122 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-db87b4b7-36ae-44ac-9001-9f2ba1f0ec7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:08.955783 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-db87b4b7-36ae-44ac-9001-9f2ba1f0ec7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:08.957335 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1159/2317] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:35:08 2021] DELETE /identity/v3/projects/631c868425ac4873afb1e1c6aae74875 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:35:08.972001 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c378f-9044-4529-8f42-0f5a76ef6d7c None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:08.972294 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c378f-9044-4529-8f42-0f5a76ef6d7c None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:08.972579 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c378f-9044-4529-8f42-0f5a76ef6d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:08.992607 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-cc9c378f-9044-4529-8f42-0f5a76ef6d7c None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:35:08.992607 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-cc9c378f-9044-4529-8f42-0f5a76ef6d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:09.055641 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1159/2318] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:35:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:35:09.063966 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ea85e-9d95-4061-9d06-faaf7aca88fe None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:09.064255 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ea85e-9d95-4061-9d06-faaf7aca88fe None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:09.064586 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ea85e-9d95-4061-9d06-faaf7aca88fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:09.083487 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-fa0ea85e-9d95-4061-9d06-faaf7aca88fe None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:35:09.084703 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-fa0ea85e-9d95-4061-9d06-faaf7aca88fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:09.092894 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1160/2319] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:35:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:35:09.097120 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c378f-9044-4529-8f42-0f5a76ef6d7c None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:09.106556 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c378f-9044-4529-8f42-0f5a76ef6d7c None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:09.111315 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb7efc-07b3-4dc8-a3c2-433251393844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:09.111893 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb7efc-07b3-4dc8-a3c2-433251393844 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:09.112232 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb7efc-07b3-4dc8-a3c2-433251393844 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:09.112444 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb7efc-07b3-4dc8-a3c2-433251393844 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:09.117467 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb7efc-07b3-4dc8-a3c2-433251393844 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:35:09.117467 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb7efc-07b3-4dc8-a3c2-433251393844 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:09.117467 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb7efc-07b3-4dc8-a3c2-433251393844 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:09.129736 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1160/2320] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:35:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:35:09.135799 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ea85e-9d95-4061-9d06-faaf7aca88fe None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:09.145264 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ea85e-9d95-4061-9d06-faaf7aca88fe None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:09.151664 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3e5cb-d2d9-4be3-9ebf-64a32b3b81c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:09.152335 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3e5cb-d2d9-4be3-9ebf-64a32b3b81c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:09.152880 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3e5cb-d2d9-4be3-9ebf-64a32b3b81c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:09.154092 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3e5cb-d2d9-4be3-9ebf-64a32b3b81c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:09.155302 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad3e5cb-d2d9-4be3-9ebf-64a32b3b81c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:09.157399 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad3e5cb-d2d9-4be3-9ebf-64a32b3b81c1 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:09.259149 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1161/2321] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:35:09 2021] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:35:09.267097 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb7efc-07b3-4dc8-a3c2-433251393844 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:09.278172 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb7efc-07b3-4dc8-a3c2-433251393844 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:09.340633 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaeeee2-1d33-4bba-bdb9-e98484bed661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:09.341349 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaeeee2-1d33-4bba-bdb9-e98484bed661 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:09.343359 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaeeee2-1d33-4bba-bdb9-e98484bed661 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:09.343596 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaeeee2-1d33-4bba-bdb9-e98484bed661 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:09.344325 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaeeee2-1d33-4bba-bdb9-e98484bed661 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:09.346636 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaeeee2-1d33-4bba-bdb9-e98484bed661 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:09.350114 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3e5cb-d2d9-4be3-9ebf-64a32b3b81c1 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:09.351779 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-8ad3e5cb-d2d9-4be3-9ebf-64a32b3b81c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:09.364614 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3e5cb-d2d9-4be3-9ebf-64a32b3b81c1 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:09.370004 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc114db-4095-4bf1-a6d8-f8c63656f99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:09.371636 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc114db-4095-4bf1-a6d8-f8c63656f99b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:09.371993 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc114db-4095-4bf1-a6d8-f8c63656f99b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:09.372436 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc114db-4095-4bf1-a6d8-f8c63656f99b admin admin] PATH_INFO: `/v3/users/7abf7fb6358141ac9e63cb0713087e7f` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:09.374568 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc114db-4095-4bf1-a6d8-f8c63656f99b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7abf7fb6358141ac9e63cb0713087e7f)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:09.377955 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc114db-4095-4bf1-a6d8-f8c63656f99b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:09.447611 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1161/2322] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:35:09 2021] POST /identity/v3/users => generated 290 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:35:09.451279 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaeeee2-1d33-4bba-bdb9-e98484bed661 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:09.461314 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaeeee2-1d33-4bba-bdb9-e98484bed661 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:09.467330 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e579a32-20d4-4953-a25f-d4a2ba8863f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:09.467978 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e579a32-20d4-4953-a25f-d4a2ba8863f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:09.468257 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e579a32-20d4-4953-a25f-d4a2ba8863f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:09.468532 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e579a32-20d4-4953-a25f-d4a2ba8863f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:09.469261 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e579a32-20d4-4953-a25f-d4a2ba8863f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:09.470863 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e579a32-20d4-4953-a25f-d4a2ba8863f8 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:09.480878 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1162/2323] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:35:09 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:35:09.484758 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e579a32-20d4-4953-a25f-d4a2ba8863f8 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:09.494258 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e579a32-20d4-4953-a25f-d4a2ba8863f8 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:09.498853 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90605ded-d1b6-49cb-8e67-5af4b3ed7519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:09.499488 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90605ded-d1b6-49cb-8e67-5af4b3ed7519 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:09.499769 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90605ded-d1b6-49cb-8e67-5af4b3ed7519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:09.500036 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90605ded-d1b6-49cb-8e67-5af4b3ed7519 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:09.500771 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90605ded-d1b6-49cb-8e67-5af4b3ed7519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:09.502372 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90605ded-d1b6-49cb-8e67-5af4b3ed7519 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:09.513400 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1163/2324] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:35:09 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:35:09.517664 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90605ded-d1b6-49cb-8e67-5af4b3ed7519 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:09.527824 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90605ded-d1b6-49cb-8e67-5af4b3ed7519 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:09.529073 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-6cc114db-4095-4bf1-a6d8-f8c63656f99b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7abf7fb6358141ac9e63cb0713087e7f'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:09.529754 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-6cc114db-4095-4bf1-a6d8-f8c63656f99b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7abf7fb6358141ac9e63cb0713087e7f'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:09.532714 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff08d1c-2968-4306-b64f-722ed81906ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:09.533616 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff08d1c-2968-4306-b64f-722ed81906ba admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:09.533901 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff08d1c-2968-4306-b64f-722ed81906ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:09.534181 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff08d1c-2968-4306-b64f-722ed81906ba admin admin] PATH_INFO: `/v3/projects/766c6a829b9945cfb36bad289566c0ad/users/1c9eae7258ce43f0b7838a82396121d3/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:09.548361 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff08d1c-2968-4306-b64f-722ed81906ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=766c6a829b9945cfb36bad289566c0ad, user_id=1c9eae7258ce43f0b7838a82396121d3, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:09.551022 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff08d1c-2968-4306-b64f-722ed81906ba admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:09.635629 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-6cc114db-4095-4bf1-a6d8-f8c63656f99b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7abf7fb6358141ac9e63cb0713087e7f'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:09.636391 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-6cc114db-4095-4bf1-a6d8-f8c63656f99b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7abf7fb6358141ac9e63cb0713087e7f'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:09.648867 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-6cc114db-4095-4bf1-a6d8-f8c63656f99b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7abf7fb6358141ac9e63cb0713087e7f'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:09.661344 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1162/2325] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:35:09 2021] DELETE /identity/v3/users/7abf7fb6358141ac9e63cb0713087e7f => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:35:09.666073 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860baf0b-c920-4477-9226-2a5a987ce59b None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:09.666361 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860baf0b-c920-4477-9226-2a5a987ce59b None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:09.666687 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860baf0b-c920-4477-9226-2a5a987ce59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:09.669348 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1164/2326] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:35:09 2021] PUT /identity/v3/projects/766c6a829b9945cfb36bad289566c0ad/users/1c9eae7258ce43f0b7838a82396121d3/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:35:09.679830 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb651b-33a9-4e69-be1c-76c2ad309d1a None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:09.680096 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb651b-33a9-4e69-be1c-76c2ad309d1a None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:09.680371 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb651b-33a9-4e69-be1c-76c2ad309d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:09.683596 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-860baf0b-c920-4477-9226-2a5a987ce59b None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:35:09.684756 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-860baf0b-c920-4477-9226-2a5a987ce59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:09.697502 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-bdbb651b-33a9-4e69-be1c-76c2ad309d1a None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:35:09.699198 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-bdbb651b-33a9-4e69-be1c-76c2ad309d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:09.745285 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1163/2327] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:35:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:35:09.762853 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860baf0b-c920-4477-9226-2a5a987ce59b None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:09.762853 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-860baf0b-c920-4477-9226-2a5a987ce59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:09.765706 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1165/2328] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:35:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:35:09.774886 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb651b-33a9-4e69-be1c-76c2ad309d1a None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:09.779584 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-bdbb651b-33a9-4e69-be1c-76c2ad309d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:09.788465 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb651b-33a9-4e69-be1c-76c2ad309d1a None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:09.794175 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936756e1-93ba-439d-b381-f3ba55a0ea88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:09.795286 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936756e1-93ba-439d-b381-f3ba55a0ea88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:09.795565 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936756e1-93ba-439d-b381-f3ba55a0ea88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:09.795836 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936756e1-93ba-439d-b381-f3ba55a0ea88 admin admin] PATH_INFO: `/v3/users/b316cce3d0ec4a9cae48c43b189fcfac` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:09.797049 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936756e1-93ba-439d-b381-f3ba55a0ea88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b316cce3d0ec4a9cae48c43b189fcfac)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:09.798961 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936756e1-93ba-439d-b381-f3ba55a0ea88 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:09.827505 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860baf0b-c920-4477-9226-2a5a987ce59b None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:09.831151 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14b9ac-aebe-47d8-b895-2e1990906c19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:09.834138 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14b9ac-aebe-47d8-b895-2e1990906c19 service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:09.834138 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14b9ac-aebe-47d8-b895-2e1990906c19 service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:09.834138 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14b9ac-aebe-47d8-b895-2e1990906c19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:09.842872 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf14b9ac-aebe-47d8-b895-2e1990906c19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:09.844285 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf14b9ac-aebe-47d8-b895-2e1990906c19 service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:09.853561 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1164/2329] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:35:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:35:09.854336 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14b9ac-aebe-47d8-b895-2e1990906c19 service neutron] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:09.861825 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14b9ac-aebe-47d8-b895-2e1990906c19 service neutron] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:09.865524 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b873638-5149-48f6-9706-abb0dc61c1aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:09.866143 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b873638-5149-48f6-9706-abb0dc61c1aa service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:09.866425 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b873638-5149-48f6-9706-abb0dc61c1aa service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:09.866702 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b873638-5149-48f6-9706-abb0dc61c1aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:09.876759 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b873638-5149-48f6-9706-abb0dc61c1aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:09.882869 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b873638-5149-48f6-9706-abb0dc61c1aa service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:09.888933 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1165/2330] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:35:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:35:09.974031 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-936756e1-93ba-439d-b381-f3ba55a0ea88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b316cce3d0ec4a9cae48c43b189fcfac'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:09.974704 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-936756e1-93ba-439d-b381-f3ba55a0ea88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b316cce3d0ec4a9cae48c43b189fcfac'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:09.982026 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-936756e1-93ba-439d-b381-f3ba55a0ea88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b316cce3d0ec4a9cae48c43b189fcfac'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:09.982671 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-936756e1-93ba-439d-b381-f3ba55a0ea88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b316cce3d0ec4a9cae48c43b189fcfac'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:09.994597 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-936756e1-93ba-439d-b381-f3ba55a0ea88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b316cce3d0ec4a9cae48c43b189fcfac'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:10.080872 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1166/2331] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:35:09 2021] DELETE /identity/v3/users/b316cce3d0ec4a9cae48c43b189fcfac => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:35:10.088070 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01dd0d-f5c8-4997-9c65-3c9d3df9e888 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:10.088070 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01dd0d-f5c8-4997-9c65-3c9d3df9e888 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:10.088070 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01dd0d-f5c8-4997-9c65-3c9d3df9e888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:10.113039 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-8c01dd0d-f5c8-4997-9c65-3c9d3df9e888 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:35:10.114343 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-8c01dd0d-f5c8-4997-9c65-3c9d3df9e888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:10.182307 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1166/2332] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:35:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:35:10.192037 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936756e1-93ba-439d-b381-f3ba55a0ea88 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:10.193516 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-936756e1-93ba-439d-b381-f3ba55a0ea88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:10.258773 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936756e1-93ba-439d-b381-f3ba55a0ea88 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:10.263978 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911d166-a433-404d-b7f6-8e0ad25ad150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:10.264642 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911d166-a433-404d-b7f6-8e0ad25ad150 service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:10.266067 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911d166-a433-404d-b7f6-8e0ad25ad150 service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:10.266067 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911d166-a433-404d-b7f6-8e0ad25ad150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:10.275002 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911d166-a433-404d-b7f6-8e0ad25ad150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:10.276504 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911d166-a433-404d-b7f6-8e0ad25ad150 service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:10.287684 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1167/2333] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:35:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:35:10.295300 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01dd0d-f5c8-4997-9c65-3c9d3df9e888 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:10.296775 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-8c01dd0d-f5c8-4997-9c65-3c9d3df9e888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:10.317620 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01dd0d-f5c8-4997-9c65-3c9d3df9e888 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:10.329854 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144eda2-e866-40e9-99c7-2b7b47c5ef5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:10.330726 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144eda2-e866-40e9-99c7-2b7b47c5ef5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:10.331012 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144eda2-e866-40e9-99c7-2b7b47c5ef5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:10.331294 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144eda2-e866-40e9-99c7-2b7b47c5ef5f admin admin] PATH_INFO: `/v3/projects/3defe0f00d114d658520b90a888c2b27` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:10.332562 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144eda2-e866-40e9-99c7-2b7b47c5ef5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3defe0f00d114d658520b90a888c2b27)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:10.334768 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144eda2-e866-40e9-99c7-2b7b47c5ef5f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:10.471241 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-6144eda2-e866-40e9-99c7-2b7b47c5ef5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3defe0f00d114d658520b90a888c2b27', 'request_id': 'req-6144eda2-e866-40e9-99c7-2b7b47c5ef5f'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:10.476457 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-6144eda2-e866-40e9-99c7-2b7b47c5ef5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3defe0f00d114d658520b90a888c2b27', 'request_id': 'req-6144eda2-e866-40e9-99c7-2b7b47c5ef5f'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:10.482660 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-6144eda2-e866-40e9-99c7-2b7b47c5ef5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3defe0f00d114d658520b90a888c2b27', 'request_id': 'req-6144eda2-e866-40e9-99c7-2b7b47c5ef5f'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:10.594816 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-6144eda2-e866-40e9-99c7-2b7b47c5ef5f admin admin] The token cache is being invalidate because project 3defe0f00d114d658520b90a888c2b27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:35:10.595304 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-6144eda2-e866-40e9-99c7-2b7b47c5ef5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:10.596060 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-6144eda2-e866-40e9-99c7-2b7b47c5ef5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:10.597833 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1167/2334] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:35:10 2021] DELETE /identity/v3/projects/3defe0f00d114d658520b90a888c2b27 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:35:10.601779 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911d166-a433-404d-b7f6-8e0ad25ad150 service neutron] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:10.612646 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911d166-a433-404d-b7f6-8e0ad25ad150 service neutron] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:10.692696 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d398db-e0ef-4ef6-a47f-e4868575694e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:10.694224 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d398db-e0ef-4ef6-a47f-e4868575694e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:10.694511 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d398db-e0ef-4ef6-a47f-e4868575694e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:10.694788 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d398db-e0ef-4ef6-a47f-e4868575694e admin admin] PATH_INFO: `/v3/users/2241a85270454f1ba12de8e8d5a0f398` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:10.696419 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d398db-e0ef-4ef6-a47f-e4868575694e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2241a85270454f1ba12de8e8d5a0f398)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:10.699927 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d398db-e0ef-4ef6-a47f-e4868575694e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:10.880841 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144eda2-e866-40e9-99c7-2b7b47c5ef5f admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:10.886991 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-6144eda2-e866-40e9-99c7-2b7b47c5ef5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:10.899679 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-a2d398db-e0ef-4ef6-a47f-e4868575694e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2241a85270454f1ba12de8e8d5a0f398'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:10.900523 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-a2d398db-e0ef-4ef6-a47f-e4868575694e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2241a85270454f1ba12de8e8d5a0f398'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:10.908736 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-a2d398db-e0ef-4ef6-a47f-e4868575694e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2241a85270454f1ba12de8e8d5a0f398'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:10.909552 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-a2d398db-e0ef-4ef6-a47f-e4868575694e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2241a85270454f1ba12de8e8d5a0f398'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:10.915503 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144eda2-e866-40e9-99c7-2b7b47c5ef5f admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:10.923145 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-a2d398db-e0ef-4ef6-a47f-e4868575694e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2241a85270454f1ba12de8e8d5a0f398'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:10.929518 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13375ec9-9d74-4962-985d-c1ea9ea3c827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:10.930538 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13375ec9-9d74-4962-985d-c1ea9ea3c827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:10.930704 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13375ec9-9d74-4962-985d-c1ea9ea3c827 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:10.931319 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13375ec9-9d74-4962-985d-c1ea9ea3c827 admin admin] PATH_INFO: `/v3/projects/40b590d43a4a4aaebf06487cd89b84ba` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:10.934235 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13375ec9-9d74-4962-985d-c1ea9ea3c827 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40b590d43a4a4aaebf06487cd89b84ba)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:10.936411 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13375ec9-9d74-4962-985d-c1ea9ea3c827 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:11.024302 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1168/2335] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:35:10 2021] DELETE /identity/v3/users/2241a85270454f1ba12de8e8d5a0f398 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:35:11.070160 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-13375ec9-9d74-4962-985d-c1ea9ea3c827 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40b590d43a4a4aaebf06487cd89b84ba', 'request_id': 'req-13375ec9-9d74-4962-985d-c1ea9ea3c827'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:11.075906 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-13375ec9-9d74-4962-985d-c1ea9ea3c827 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40b590d43a4a4aaebf06487cd89b84ba', 'request_id': 'req-13375ec9-9d74-4962-985d-c1ea9ea3c827'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:11.082209 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-13375ec9-9d74-4962-985d-c1ea9ea3c827 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40b590d43a4a4aaebf06487cd89b84ba', 'request_id': 'req-13375ec9-9d74-4962-985d-c1ea9ea3c827'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:11.135599 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-13375ec9-9d74-4962-985d-c1ea9ea3c827 admin admin] The token cache is being invalidate because project 40b590d43a4a4aaebf06487cd89b84ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:35:11.139643 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-13375ec9-9d74-4962-985d-c1ea9ea3c827 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:11.139643 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-13375ec9-9d74-4962-985d-c1ea9ea3c827 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:11.139643 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1168/2336] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:35:10 2021] DELETE /identity/v3/projects/40b590d43a4a4aaebf06487cd89b84ba => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:35:11.500282 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d398db-e0ef-4ef6-a47f-e4868575694e admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:11.502080 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-a2d398db-e0ef-4ef6-a47f-e4868575694e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:11.530757 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b4bf7-817d-4f8d-a295-e9cceba36a02 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:11.531054 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b4bf7-817d-4f8d-a295-e9cceba36a02 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:11.531336 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b4bf7-817d-4f8d-a295-e9cceba36a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:11.569071 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-eb3b4bf7-817d-4f8d-a295-e9cceba36a02 None None] MFA Rules not processed for user `1c9eae7258ce43f0b7838a82396121d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:35:11.571229 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-eb3b4bf7-817d-4f8d-a295-e9cceba36a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:11.591738 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d398db-e0ef-4ef6-a47f-e4868575694e admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:11.665620 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1169/2337] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:35:11 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:35:11.677087 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541fa47e-ff87-4db5-9fb0-cc8eb5d92804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:11.677542 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b4bf7-817d-4f8d-a295-e9cceba36a02 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:11.678500 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fa47e-ff87-4db5-9fb0-cc8eb5d92804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:11.678756 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fa47e-ff87-4db5-9fb0-cc8eb5d92804 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:11.679028 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fa47e-ff87-4db5-9fb0-cc8eb5d92804 admin admin] PATH_INFO: `/v3/projects/28227a7aed324ef4ae79d1186a550112` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:11.680189 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-eb3b4bf7-817d-4f8d-a295-e9cceba36a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:11.680311 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541fa47e-ff87-4db5-9fb0-cc8eb5d92804 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28227a7aed324ef4ae79d1186a550112)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:11.682679 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541fa47e-ff87-4db5-9fb0-cc8eb5d92804 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:11.746182 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b4bf7-817d-4f8d-a295-e9cceba36a02 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:11.749810 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5843a-79e4-4b79-b7e7-7acd89b9d49d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:11.750449 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5843a-79e4-4b79-b7e7-7acd89b9d49d service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:11.750725 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5843a-79e4-4b79-b7e7-7acd89b9d49d service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:11.750993 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5843a-79e4-4b79-b7e7-7acd89b9d49d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:11.759390 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e5843a-79e4-4b79-b7e7-7acd89b9d49d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:11.760810 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e5843a-79e4-4b79-b7e7-7acd89b9d49d service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:11.769434 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1170/2338] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:35:11 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:35:11.815359 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-541fa47e-ff87-4db5-9fb0-cc8eb5d92804 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28227a7aed324ef4ae79d1186a550112', 'request_id': 'req-541fa47e-ff87-4db5-9fb0-cc8eb5d92804'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:11.821553 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-541fa47e-ff87-4db5-9fb0-cc8eb5d92804 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28227a7aed324ef4ae79d1186a550112', 'request_id': 'req-541fa47e-ff87-4db5-9fb0-cc8eb5d92804'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:11.827521 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-541fa47e-ff87-4db5-9fb0-cc8eb5d92804 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28227a7aed324ef4ae79d1186a550112', 'request_id': 'req-541fa47e-ff87-4db5-9fb0-cc8eb5d92804'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:11.898180 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-541fa47e-ff87-4db5-9fb0-cc8eb5d92804 admin admin] The token cache is being invalidate because project 28227a7aed324ef4ae79d1186a550112 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:35:11.898528 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-541fa47e-ff87-4db5-9fb0-cc8eb5d92804 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:11.899227 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-541fa47e-ff87-4db5-9fb0-cc8eb5d92804 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:11.901438 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1169/2339] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:35:11 2021] DELETE /identity/v3/projects/28227a7aed324ef4ae79d1186a550112 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:35:11.905367 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5843a-79e4-4b79-b7e7-7acd89b9d49d service cinder] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:11.906878 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-14e5843a-79e4-4b79-b7e7-7acd89b9d49d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:11.920888 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5843a-79e4-4b79-b7e7-7acd89b9d49d service cinder] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:11.985849 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743be743-4275-4728-b247-0fa6923dcabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:11.986726 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743be743-4275-4728-b247-0fa6923dcabb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:11.987003 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743be743-4275-4728-b247-0fa6923dcabb admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:11.987273 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743be743-4275-4728-b247-0fa6923dcabb admin admin] PATH_INFO: `/v3/users/ab51c8f9394d41b0871ea2eb901398b3` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:11.988515 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743be743-4275-4728-b247-0fa6923dcabb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab51c8f9394d41b0871ea2eb901398b3)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:11.990450 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743be743-4275-4728-b247-0fa6923dcabb admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:12.213079 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-743be743-4275-4728-b247-0fa6923dcabb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab51c8f9394d41b0871ea2eb901398b3'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:12.213875 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-743be743-4275-4728-b247-0fa6923dcabb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab51c8f9394d41b0871ea2eb901398b3'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:12.280091 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-743be743-4275-4728-b247-0fa6923dcabb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab51c8f9394d41b0871ea2eb901398b3'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:12.280702 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-743be743-4275-4728-b247-0fa6923dcabb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab51c8f9394d41b0871ea2eb901398b3'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:12.292887 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-743be743-4275-4728-b247-0fa6923dcabb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab51c8f9394d41b0871ea2eb901398b3'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:12.307097 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1171/2340] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:35:11 2021] DELETE /identity/v3/users/ab51c8f9394d41b0871ea2eb901398b3 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:35:12.682486 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541fa47e-ff87-4db5-9fb0-cc8eb5d92804 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:12.683973 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-541fa47e-ff87-4db5-9fb0-cc8eb5d92804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:12.701447 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541fa47e-ff87-4db5-9fb0-cc8eb5d92804 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:12.758944 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93602b-d8d3-4557-95e8-7b8060a5ec0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:12.760551 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93602b-d8d3-4557-95e8-7b8060a5ec0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:12.760551 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93602b-d8d3-4557-95e8-7b8060a5ec0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:12.761124 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93602b-d8d3-4557-95e8-7b8060a5ec0d admin admin] PATH_INFO: `/v3/projects/15726b0ea4064a2fbc497b7f3518ea76` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:12.762364 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93602b-d8d3-4557-95e8-7b8060a5ec0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=15726b0ea4064a2fbc497b7f3518ea76)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:12.764230 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93602b-d8d3-4557-95e8-7b8060a5ec0d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:12.879568 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-4d93602b-d8d3-4557-95e8-7b8060a5ec0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15726b0ea4064a2fbc497b7f3518ea76', 'request_id': 'req-4d93602b-d8d3-4557-95e8-7b8060a5ec0d'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:12.885948 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-4d93602b-d8d3-4557-95e8-7b8060a5ec0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15726b0ea4064a2fbc497b7f3518ea76', 'request_id': 'req-4d93602b-d8d3-4557-95e8-7b8060a5ec0d'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:12.891382 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-4d93602b-d8d3-4557-95e8-7b8060a5ec0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15726b0ea4064a2fbc497b7f3518ea76', 'request_id': 'req-4d93602b-d8d3-4557-95e8-7b8060a5ec0d'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:12.965515 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-4d93602b-d8d3-4557-95e8-7b8060a5ec0d admin admin] The token cache is being invalidate because project 15726b0ea4064a2fbc497b7f3518ea76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:35:12.965806 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-4d93602b-d8d3-4557-95e8-7b8060a5ec0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:12.966452 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-4d93602b-d8d3-4557-95e8-7b8060a5ec0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:12.968005 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1170/2341] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:35:12 2021] DELETE /identity/v3/projects/15726b0ea4064a2fbc497b7f3518ea76 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:35:12.973819 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486c3cc-fceb-4b26-bc55-27ce84a22906 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:12.974424 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486c3cc-fceb-4b26-bc55-27ce84a22906 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:12.974424 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486c3cc-fceb-4b26-bc55-27ce84a22906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:12.992158 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-f486c3cc-fceb-4b26-bc55-27ce84a22906 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:35:12.993339 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-f486c3cc-fceb-4b26-bc55-27ce84a22906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:13.049233 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1172/2342] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:35:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:35:13.057367 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1117132-dff5-4f49-b170-c04fa8d73d92 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:13.057689 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1117132-dff5-4f49-b170-c04fa8d73d92 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:13.057965 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1117132-dff5-4f49-b170-c04fa8d73d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:13.077008 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-f1117132-dff5-4f49-b170-c04fa8d73d92 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:35:13.078224 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-f1117132-dff5-4f49-b170-c04fa8d73d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:13.085957 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1171/2343] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:35:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:35:13.090899 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486c3cc-fceb-4b26-bc55-27ce84a22906 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:13.100215 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486c3cc-fceb-4b26-bc55-27ce84a22906 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:13.104826 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe82bbb-b526-49a5-bc5a-06ac5d793600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:13.105497 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe82bbb-b526-49a5-bc5a-06ac5d793600 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:13.105774 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe82bbb-b526-49a5-bc5a-06ac5d793600 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:13.106041 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe82bbb-b526-49a5-bc5a-06ac5d793600 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:13.106774 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe82bbb-b526-49a5-bc5a-06ac5d793600 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:35:13.107063 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe82bbb-b526-49a5-bc5a-06ac5d793600 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:13.108609 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe82bbb-b526-49a5-bc5a-06ac5d793600 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:13.120200 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1173/2344] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:35:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:35:13.124391 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1117132-dff5-4f49-b170-c04fa8d73d92 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:13.133516 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1117132-dff5-4f49-b170-c04fa8d73d92 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:13.138870 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218928a-68f2-452b-b794-f9d5c4a4413d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:13.139509 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218928a-68f2-452b-b794-f9d5c4a4413d admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:13.139792 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218928a-68f2-452b-b794-f9d5c4a4413d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:13.140069 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218928a-68f2-452b-b794-f9d5c4a4413d admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:13.140768 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218928a-68f2-452b-b794-f9d5c4a4413d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:13.142672 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218928a-68f2-452b-b794-f9d5c4a4413d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:13.253531 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1172/2345] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:35:13 2021] POST /identity/v3/projects => generated 371 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:35:13.257662 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe82bbb-b526-49a5-bc5a-06ac5d793600 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:13.268890 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe82bbb-b526-49a5-bc5a-06ac5d793600 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:13.323193 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae993c-bf23-4645-aa92-4ee0179a18cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:13.323839 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae993c-bf23-4645-aa92-4ee0179a18cc admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:13.324115 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae993c-bf23-4645-aa92-4ee0179a18cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:13.324385 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae993c-bf23-4645-aa92-4ee0179a18cc admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:13.325074 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae993c-bf23-4645-aa92-4ee0179a18cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:13.327273 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae993c-bf23-4645-aa92-4ee0179a18cc admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:13.423871 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1174/2346] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:35:13 2021] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:35:13.429266 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218928a-68f2-452b-b794-f9d5c4a4413d admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:13.439738 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218928a-68f2-452b-b794-f9d5c4a4413d admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:13.444323 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e36ca-779e-4ec0-b70b-969cf3f37306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:13.448384 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e36ca-779e-4ec0-b70b-969cf3f37306 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:13.448384 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e36ca-779e-4ec0-b70b-969cf3f37306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:13.448384 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e36ca-779e-4ec0-b70b-969cf3f37306 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:13.448384 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e36ca-779e-4ec0-b70b-969cf3f37306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:13.448870 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e36ca-779e-4ec0-b70b-969cf3f37306 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:13.459344 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1173/2347] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:35:13 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:35:13.464277 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae993c-bf23-4645-aa92-4ee0179a18cc admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:13.473960 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae993c-bf23-4645-aa92-4ee0179a18cc admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:13.478700 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252e02f-2757-4579-8ff6-3839f40f0230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:13.479394 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252e02f-2757-4579-8ff6-3839f40f0230 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:13.479669 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252e02f-2757-4579-8ff6-3839f40f0230 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:13.479942 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252e02f-2757-4579-8ff6-3839f40f0230 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:13.480665 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252e02f-2757-4579-8ff6-3839f40f0230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:13.482235 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252e02f-2757-4579-8ff6-3839f40f0230 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:13.492068 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1175/2348] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:35:13 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:35:13.497116 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e36ca-779e-4ec0-b70b-969cf3f37306 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:13.507094 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e36ca-779e-4ec0-b70b-969cf3f37306 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:13.512612 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d17e6f-f1d2-446b-b817-7b878ab30612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:13.513589 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d17e6f-f1d2-446b-b817-7b878ab30612 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:13.515264 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d17e6f-f1d2-446b-b817-7b878ab30612 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:13.515264 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d17e6f-f1d2-446b-b817-7b878ab30612 admin admin] PATH_INFO: `/v3/projects/893242e83e2b490a98fcd7fafca0a833/users/e8dfc8e331664933992e8adcd1fd222a/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:13.528232 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d17e6f-f1d2-446b-b817-7b878ab30612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=893242e83e2b490a98fcd7fafca0a833, user_id=e8dfc8e331664933992e8adcd1fd222a, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:13.530841 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d17e6f-f1d2-446b-b817-7b878ab30612 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:13.599648 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1174/2349] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:35:13 2021] PUT /identity/v3/projects/893242e83e2b490a98fcd7fafca0a833/users/e8dfc8e331664933992e8adcd1fd222a/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:35:13.604873 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da02622-109d-4bcb-8c9f-cfad57ca0993 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:13.605162 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da02622-109d-4bcb-8c9f-cfad57ca0993 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:13.605468 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da02622-109d-4bcb-8c9f-cfad57ca0993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:13.623312 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-8da02622-109d-4bcb-8c9f-cfad57ca0993 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:35:13.624514 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-8da02622-109d-4bcb-8c9f-cfad57ca0993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:13.679835 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1176/2350] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:35:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:35:13.690353 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d17e6f-f1d2-446b-b817-7b878ab30612 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:13.692106 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-22d17e6f-f1d2-446b-b817-7b878ab30612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:13.747591 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d17e6f-f1d2-446b-b817-7b878ab30612 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:13.751211 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7d0c3-580f-45f2-b071-60ceab89b6cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:13.751837 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7d0c3-580f-45f2-b071-60ceab89b6cd service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:13.752114 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7d0c3-580f-45f2-b071-60ceab89b6cd service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:13.752382 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7d0c3-580f-45f2-b071-60ceab89b6cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:13.761802 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c7d0c3-580f-45f2-b071-60ceab89b6cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:13.763206 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c7d0c3-580f-45f2-b071-60ceab89b6cd service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:13.772242 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1175/2351] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:35:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:35:14.984974 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf10f6-bca5-404f-8fd8-25996d7c44c5 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:14.985586 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf10f6-bca5-404f-8fd8-25996d7c44c5 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:14.986767 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf10f6-bca5-404f-8fd8-25996d7c44c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:15.016698 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-1abf10f6-bca5-404f-8fd8-25996d7c44c5 None None] MFA Rules not processed for user `e8dfc8e331664933992e8adcd1fd222a`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:35:15.017931 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-1abf10f6-bca5-404f-8fd8-25996d7c44c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:15.085520 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1177/2352] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:35:14 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:35:15.095848 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7d0c3-580f-45f2-b071-60ceab89b6cd service neutron] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:15.097631 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-a4c7d0c3-580f-45f2-b071-60ceab89b6cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:15.177090 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7d0c3-580f-45f2-b071-60ceab89b6cd service neutron] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:15.183718 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61bce11-4ecf-49e6-895c-d2a5238808da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:15.183718 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bce11-4ecf-49e6-895c-d2a5238808da service cinder] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:15.183718 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bce11-4ecf-49e6-895c-d2a5238808da service cinder] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:15.183718 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61bce11-4ecf-49e6-895c-d2a5238808da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:15.192779 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61bce11-4ecf-49e6-895c-d2a5238808da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:15.195161 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61bce11-4ecf-49e6-895c-d2a5238808da service cinder] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:15.208755 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1176/2353] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:35:15 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:35:15.749885 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940edd77-201e-4b62-9792-8387c79b7322 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:15.750251 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940edd77-201e-4b62-9792-8387c79b7322 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:15.750601 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940edd77-201e-4b62-9792-8387c79b7322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:15.781388 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-940edd77-201e-4b62-9792-8387c79b7322 None None] MFA Rules not processed for user `1c9eae7258ce43f0b7838a82396121d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:35:15.782909 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-940edd77-201e-4b62-9792-8387c79b7322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:15.858923 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1178/2354] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:35:15 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:35:16.145573 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737a2db-437b-4dce-8392-dc1c065eb88f None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:16.146112 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737a2db-437b-4dce-8392-dc1c065eb88f None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:16.146298 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737a2db-437b-4dce-8392-dc1c065eb88f None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:16.148122 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1177/2355] 10.222.0.62 () {54 vars in 912 bytes} [Tue Nov 23 19:35:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:35:16.154477 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ecf4e-0d77-45e3-84c9-e24d3ce6ee01 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:16.155113 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ecf4e-0d77-45e3-84c9-e24d3ce6ee01 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:16.155113 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ecf4e-0d77-45e3-84c9-e24d3ce6ee01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:16.174236 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-454ecf4e-0d77-45e3-84c9-e24d3ce6ee01 None None] MFA Rules not processed for user `f1ef2ac0a788451eb50fa80f559f808f`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:35:16.175442 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-454ecf4e-0d77-45e3-84c9-e24d3ce6ee01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:16.181865 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1179/2356] 10.222.0.62 () {58 vars in 1009 bytes} [Tue Nov 23 19:35:16 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:35:16.198922 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737a2db-437b-4dce-8392-dc1c065eb88f None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:16.209715 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737a2db-437b-4dce-8392-dc1c065eb88f None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:16.213372 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0916269-3b88-457e-95d8-f2c161d88865 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:16.214061 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0916269-3b88-457e-95d8-f2c161d88865 service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:16.215127 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0916269-3b88-457e-95d8-f2c161d88865 service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:16.215547 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0916269-3b88-457e-95d8-f2c161d88865 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:16.222686 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0916269-3b88-457e-95d8-f2c161d88865 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:16.224188 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0916269-3b88-457e-95d8-f2c161d88865 service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:16.232399 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1178/2357] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:35:16 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:35:16.877865 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecda037-9a6b-4d70-9b26-3c20b25e2e9a None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:16.880925 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecda037-9a6b-4d70-9b26-3c20b25e2e9a None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:16.880925 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecda037-9a6b-4d70-9b26-3c20b25e2e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:16.897576 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-eecda037-9a6b-4d70-9b26-3c20b25e2e9a None None] MFA Rules not processed for user `e8dfc8e331664933992e8adcd1fd222a`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:35:16.898777 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-eecda037-9a6b-4d70-9b26-3c20b25e2e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:16.906172 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1180/2358] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:35:16 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:35:25.848639 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0916269-3b88-457e-95d8-f2c161d88865 service neutron] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:25.851303 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-c0916269-3b88-457e-95d8-f2c161d88865 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:25.871527 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0916269-3b88-457e-95d8-f2c161d88865 service neutron] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:25.876949 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeccbaa-4fca-4a51-8d49-b1bd4370186f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:25.877952 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeccbaa-4fca-4a51-8d49-b1bd4370186f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:25.878236 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeccbaa-4fca-4a51-8d49-b1bd4370186f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:25.878513 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeccbaa-4fca-4a51-8d49-b1bd4370186f admin admin] PATH_INFO: `/v3/users/febe872cfbc34bfe97cc5982e4f2200e` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:25.879948 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeccbaa-4fca-4a51-8d49-b1bd4370186f admin admin] RBAC: Authorizing `identity:delete_user(user_id=febe872cfbc34bfe97cc5982e4f2200e)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:25.881885 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeccbaa-4fca-4a51-8d49-b1bd4370186f admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:26.099558 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-fbeccbaa-4fca-4a51-8d49-b1bd4370186f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'febe872cfbc34bfe97cc5982e4f2200e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:26.100201 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-fbeccbaa-4fca-4a51-8d49-b1bd4370186f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'febe872cfbc34bfe97cc5982e4f2200e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:26.106747 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-fbeccbaa-4fca-4a51-8d49-b1bd4370186f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'febe872cfbc34bfe97cc5982e4f2200e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:26.107361 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-fbeccbaa-4fca-4a51-8d49-b1bd4370186f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'febe872cfbc34bfe97cc5982e4f2200e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:26.119440 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-fbeccbaa-4fca-4a51-8d49-b1bd4370186f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'febe872cfbc34bfe97cc5982e4f2200e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:26.177296 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1179/2359] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:35:25 2021] DELETE /identity/v3/users/febe872cfbc34bfe97cc5982e4f2200e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:35:26.181766 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172bd55-0f53-490f-9958-d88283512b6f None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:26.182238 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172bd55-0f53-490f-9958-d88283512b6f None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:26.182329 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172bd55-0f53-490f-9958-d88283512b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:26.199625 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-6172bd55-0f53-490f-9958-d88283512b6f None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:35:26.200826 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-6172bd55-0f53-490f-9958-d88283512b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:26.261937 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1181/2360] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:35:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:35:26.272436 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeccbaa-4fca-4a51-8d49-b1bd4370186f admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:26.273967 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-fbeccbaa-4fca-4a51-8d49-b1bd4370186f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:26.331350 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeccbaa-4fca-4a51-8d49-b1bd4370186f admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:26.335042 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fd324-a464-4307-a03c-fe3836ec606b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:26.335719 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fd324-a464-4307-a03c-fe3836ec606b service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:26.336001 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fd324-a464-4307-a03c-fe3836ec606b service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:26.336304 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fd324-a464-4307-a03c-fe3836ec606b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:26.345550 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0fd324-a464-4307-a03c-fe3836ec606b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:26.348194 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0fd324-a464-4307-a03c-fe3836ec606b service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:26.357864 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1180/2361] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:35:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:35:26.768318 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172bd55-0f53-490f-9958-d88283512b6f None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:26.769801 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-6172bd55-0f53-490f-9958-d88283512b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:26.782491 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172bd55-0f53-490f-9958-d88283512b6f None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:26.793589 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598d9fe-2382-4b3f-872b-e22ef7e82705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:26.794590 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598d9fe-2382-4b3f-872b-e22ef7e82705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:26.794882 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598d9fe-2382-4b3f-872b-e22ef7e82705 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:26.795255 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598d9fe-2382-4b3f-872b-e22ef7e82705 admin admin] PATH_INFO: `/v3/projects/0c047bad97094523a07eed09ac4a7175` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:26.796438 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7598d9fe-2382-4b3f-872b-e22ef7e82705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c047bad97094523a07eed09ac4a7175)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:26.798411 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7598d9fe-2382-4b3f-872b-e22ef7e82705 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:26.904227 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-7598d9fe-2382-4b3f-872b-e22ef7e82705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c047bad97094523a07eed09ac4a7175', 'request_id': 'req-7598d9fe-2382-4b3f-872b-e22ef7e82705'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:26.910246 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-7598d9fe-2382-4b3f-872b-e22ef7e82705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c047bad97094523a07eed09ac4a7175', 'request_id': 'req-7598d9fe-2382-4b3f-872b-e22ef7e82705'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:26.916636 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-7598d9fe-2382-4b3f-872b-e22ef7e82705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c047bad97094523a07eed09ac4a7175', 'request_id': 'req-7598d9fe-2382-4b3f-872b-e22ef7e82705'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:27.017197 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-7598d9fe-2382-4b3f-872b-e22ef7e82705 admin admin] The token cache is being invalidate because project 0c047bad97094523a07eed09ac4a7175 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:35:27.018041 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-7598d9fe-2382-4b3f-872b-e22ef7e82705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:27.019008 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-7598d9fe-2382-4b3f-872b-e22ef7e82705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:35:27.020374 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1182/2362] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:35:26 2021] DELETE /identity/v3/projects/0c047bad97094523a07eed09ac4a7175 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:35:27.026072 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b2393-4439-4868-b762-7c01212ca1d3 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:27.026654 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b2393-4439-4868-b762-7c01212ca1d3 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:27.027100 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b2393-4439-4868-b762-7c01212ca1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:27.050652 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-d16b2393-4439-4868-b762-7c01212ca1d3 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:35:27.053214 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-d16b2393-4439-4868-b762-7c01212ca1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:27.156881 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1181/2363] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:35:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:35:27.166546 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b788d4-21e7-4098-ba52-1de8b3c130b6 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:27.167047 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b788d4-21e7-4098-ba52-1de8b3c130b6 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:27.167500 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b788d4-21e7-4098-ba52-1de8b3c130b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:27.188762 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-09b788d4-21e7-4098-ba52-1de8b3c130b6 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:35:27.191025 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-09b788d4-21e7-4098-ba52-1de8b3c130b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:27.200762 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1183/2364] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:35:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:35:27.206424 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b2393-4439-4868-b762-7c01212ca1d3 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:27.218110 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b2393-4439-4868-b762-7c01212ca1d3 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:27.223700 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40fbe5-6105-4f6c-9ee5-e8d598bc5207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:27.224366 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40fbe5-6105-4f6c-9ee5-e8d598bc5207 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:27.224644 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40fbe5-6105-4f6c-9ee5-e8d598bc5207 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:27.224917 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40fbe5-6105-4f6c-9ee5-e8d598bc5207 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:27.225704 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40fbe5-6105-4f6c-9ee5-e8d598bc5207 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:35:27.226012 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40fbe5-6105-4f6c-9ee5-e8d598bc5207 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:27.227596 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40fbe5-6105-4f6c-9ee5-e8d598bc5207 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:27.243328 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1182/2365] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:35:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:35:27.244418 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b788d4-21e7-4098-ba52-1de8b3c130b6 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:27.254157 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b788d4-21e7-4098-ba52-1de8b3c130b6 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:27.258931 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effacd1f-5039-4475-989b-fd945f7e6cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:27.259582 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effacd1f-5039-4475-989b-fd945f7e6cdf admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:27.259864 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effacd1f-5039-4475-989b-fd945f7e6cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:27.260139 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effacd1f-5039-4475-989b-fd945f7e6cdf admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:27.260839 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effacd1f-5039-4475-989b-fd945f7e6cdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:27.262741 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effacd1f-5039-4475-989b-fd945f7e6cdf admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:27.399904 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1184/2366] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:35:27 2021] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:35:27.401019 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40fbe5-6105-4f6c-9ee5-e8d598bc5207 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:27.412346 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40fbe5-6105-4f6c-9ee5-e8d598bc5207 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:27.479308 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa0fd2-6224-46b2-9287-4af5b267edf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:27.480051 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa0fd2-6224-46b2-9287-4af5b267edf5 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:27.480333 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa0fd2-6224-46b2-9287-4af5b267edf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:27.480613 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa0fd2-6224-46b2-9287-4af5b267edf5 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:27.481338 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa0fd2-6224-46b2-9287-4af5b267edf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:27.483318 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa0fd2-6224-46b2-9287-4af5b267edf5 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:27.582324 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1183/2367] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:35:27 2021] POST /identity/v3/users => generated 289 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:35:27.588026 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effacd1f-5039-4475-989b-fd945f7e6cdf admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:27.603768 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effacd1f-5039-4475-989b-fd945f7e6cdf admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:27.624494 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2e15d-c407-4788-a100-a253aacfa074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:27.625825 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2e15d-c407-4788-a100-a253aacfa074 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:27.626515 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2e15d-c407-4788-a100-a253aacfa074 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:27.628400 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2e15d-c407-4788-a100-a253aacfa074 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:27.630655 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2e15d-c407-4788-a100-a253aacfa074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:27.635672 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2e15d-c407-4788-a100-a253aacfa074 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:27.664141 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1185/2368] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:35:27 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:35:27.665444 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa0fd2-6224-46b2-9287-4af5b267edf5 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:27.680473 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa0fd2-6224-46b2-9287-4af5b267edf5 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:27.696007 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75181d-3fe5-43c3-ac24-b5d9d341f9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:27.702946 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75181d-3fe5-43c3-ac24-b5d9d341f9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:27.703227 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75181d-3fe5-43c3-ac24-b5d9d341f9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:27.703478 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75181d-3fe5-43c3-ac24-b5d9d341f9e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:27.704729 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75181d-3fe5-43c3-ac24-b5d9d341f9e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:27.706525 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75181d-3fe5-43c3-ac24-b5d9d341f9e7 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:27.731762 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1184/2369] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:35:27 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:35:27.732031 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2e15d-c407-4788-a100-a253aacfa074 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:27.747954 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2e15d-c407-4788-a100-a253aacfa074 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:27.757747 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a69ce-bb47-4887-a8e3-6061d2a3662a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:27.759238 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a69ce-bb47-4887-a8e3-6061d2a3662a admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:27.761480 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a69ce-bb47-4887-a8e3-6061d2a3662a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:27.761841 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a69ce-bb47-4887-a8e3-6061d2a3662a admin admin] PATH_INFO: `/v3/projects/257b0b2e531441b4bb745e99cfd799f3/users/ecaf914ba335477182e4e1153d0d3f71/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:27.785447 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a69ce-bb47-4887-a8e3-6061d2a3662a admin admin] RBAC: Authorizing `identity:create_grant(project_id=257b0b2e531441b4bb745e99cfd799f3, user_id=ecaf914ba335477182e4e1153d0d3f71, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:27.788941 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a69ce-bb47-4887-a8e3-6061d2a3662a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:27.911971 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1186/2370] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:35:27 2021] PUT /identity/v3/projects/257b0b2e531441b4bb745e99cfd799f3/users/ecaf914ba335477182e4e1153d0d3f71/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:35:27.917661 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1f683-6b9f-4098-9cd1-3efcc5a0cfb2 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:27.917885 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1f683-6b9f-4098-9cd1-3efcc5a0cfb2 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:27.918176 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1f683-6b9f-4098-9cd1-3efcc5a0cfb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:27.963412 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-84d1f683-6b9f-4098-9cd1-3efcc5a0cfb2 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:35:27.964939 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-84d1f683-6b9f-4098-9cd1-3efcc5a0cfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:28.038983 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1185/2371] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:35:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:35:28.049381 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a69ce-bb47-4887-a8e3-6061d2a3662a admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:28.051420 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-6b5a69ce-bb47-4887-a8e3-6061d2a3662a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:28.106578 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a69ce-bb47-4887-a8e3-6061d2a3662a admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:28.110254 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f75a5-3d8c-4949-9337-ba4b7aae69ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:28.111032 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f75a5-3d8c-4949-9337-ba4b7aae69ad service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:28.111156 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f75a5-3d8c-4949-9337-ba4b7aae69ad service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:28.111459 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f75a5-3d8c-4949-9337-ba4b7aae69ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:28.120646 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022f75a5-3d8c-4949-9337-ba4b7aae69ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:28.122090 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022f75a5-3d8c-4949-9337-ba4b7aae69ad service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:28.132361 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1187/2372] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:35:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:35:34.307638 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e4ee0-03c9-4e85-9fb8-7047b68d7f9f None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:34.308106 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e4ee0-03c9-4e85-9fb8-7047b68d7f9f None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:34.308184 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e4ee0-03c9-4e85-9fb8-7047b68d7f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:34.373001 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-141e4ee0-03c9-4e85-9fb8-7047b68d7f9f None None] MFA Rules not processed for user `ecaf914ba335477182e4e1153d0d3f71`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:35:34.374334 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-141e4ee0-03c9-4e85-9fb8-7047b68d7f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:34.451133 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1186/2373] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:35:34 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:35:34.458510 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f75a5-3d8c-4949-9337-ba4b7aae69ad service neutron] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:34.468438 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f75a5-3d8c-4949-9337-ba4b7aae69ad service neutron] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:34.474453 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef63e1-4152-4af5-b431-a6d6f673189f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:34.475131 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef63e1-4152-4af5-b431-a6d6f673189f admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:34.475413 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef63e1-4152-4af5-b431-a6d6f673189f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:34.475692 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef63e1-4152-4af5-b431-a6d6f673189f admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:34.476426 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef63e1-4152-4af5-b431-a6d6f673189f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:34.478367 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef63e1-4152-4af5-b431-a6d6f673189f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:34.593307 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1188/2374] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:35:34 2021] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:35:34.595757 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e4ee0-03c9-4e85-9fb8-7047b68d7f9f None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:34.610389 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e4ee0-03c9-4e85-9fb8-7047b68d7f9f None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:34.677132 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663931d9-0bc2-4f4e-9655-13f0eacea30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:34.678007 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663931d9-0bc2-4f4e-9655-13f0eacea30b admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:34.678297 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663931d9-0bc2-4f4e-9655-13f0eacea30b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:34.678576 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663931d9-0bc2-4f4e-9655-13f0eacea30b admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:34.679347 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663931d9-0bc2-4f4e-9655-13f0eacea30b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:34.681428 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663931d9-0bc2-4f4e-9655-13f0eacea30b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:34.784917 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1187/2375] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:35:34 2021] POST /identity/v3/users => generated 295 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:35:34.789187 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef63e1-4152-4af5-b431-a6d6f673189f admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:34.800129 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef63e1-4152-4af5-b431-a6d6f673189f admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:34.804709 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248ab96-deff-4b38-83bd-9811368fb3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:34.805362 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248ab96-deff-4b38-83bd-9811368fb3e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:34.805687 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248ab96-deff-4b38-83bd-9811368fb3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:34.805959 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248ab96-deff-4b38-83bd-9811368fb3e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:34.806692 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248ab96-deff-4b38-83bd-9811368fb3e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:34.808294 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248ab96-deff-4b38-83bd-9811368fb3e5 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:34.818945 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1189/2376] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:35:34 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:35:34.823161 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663931d9-0bc2-4f4e-9655-13f0eacea30b admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:34.833874 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663931d9-0bc2-4f4e-9655-13f0eacea30b admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:34.838653 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5596091-387a-4f98-a3ad-f25c5a5f4e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:34.839541 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5596091-387a-4f98-a3ad-f25c5a5f4e26 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:34.839821 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5596091-387a-4f98-a3ad-f25c5a5f4e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:34.840093 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5596091-387a-4f98-a3ad-f25c5a5f4e26 admin admin] PATH_INFO: `/v3/projects/1e70ae5f657c4aebb6c283d99f5ccde0/users/c0cfffaa6c7e464faeb2aca43d570045/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:34.855624 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5596091-387a-4f98-a3ad-f25c5a5f4e26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e70ae5f657c4aebb6c283d99f5ccde0, user_id=c0cfffaa6c7e464faeb2aca43d570045, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:34.858280 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5596091-387a-4f98-a3ad-f25c5a5f4e26 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:34.938738 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1188/2377] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:35:34 2021] PUT /identity/v3/projects/1e70ae5f657c4aebb6c283d99f5ccde0/users/c0cfffaa6c7e464faeb2aca43d570045/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:35:34.942906 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248ab96-deff-4b38-83bd-9811368fb3e5 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:34.953175 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248ab96-deff-4b38-83bd-9811368fb3e5 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:35.008282 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2e224-a767-47bc-975f-490a1074045d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:35.008948 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2e224-a767-47bc-975f-490a1074045d admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:35.009287 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2e224-a767-47bc-975f-490a1074045d admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:35.009598 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2e224-a767-47bc-975f-490a1074045d admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:35.010332 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2e224-a767-47bc-975f-490a1074045d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:35.011919 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2e224-a767-47bc-975f-490a1074045d admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:35.022405 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1190/2378] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:35:34 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:35:35.026769 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5596091-387a-4f98-a3ad-f25c5a5f4e26 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:35.039017 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5596091-387a-4f98-a3ad-f25c5a5f4e26 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:35.044036 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4283e1-aa88-4988-8f9d-2e45ea50011b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:35.044897 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4283e1-aa88-4988-8f9d-2e45ea50011b admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:35.045183 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4283e1-aa88-4988-8f9d-2e45ea50011b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:35.045694 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4283e1-aa88-4988-8f9d-2e45ea50011b admin admin] PATH_INFO: `/v3/projects/1e70ae5f657c4aebb6c283d99f5ccde0/users/c0cfffaa6c7e464faeb2aca43d570045/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:35.047893 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4283e1-aa88-4988-8f9d-2e45ea50011b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e70ae5f657c4aebb6c283d99f5ccde0, user_id=c0cfffaa6c7e464faeb2aca43d570045, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:35.051606 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4283e1-aa88-4988-8f9d-2e45ea50011b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:35.063529 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1189/2379] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:35:35 2021] PUT /identity/v3/projects/1e70ae5f657c4aebb6c283d99f5ccde0/users/c0cfffaa6c7e464faeb2aca43d570045/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:35:41.464557 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99f492-58e0-4e8d-a681-a9ced12afbe2 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:41.465192 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99f492-58e0-4e8d-a681-a9ced12afbe2 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:41.465192 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99f492-58e0-4e8d-a681-a9ced12afbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:41.495218 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-6b99f492-58e0-4e8d-a681-a9ced12afbe2 None None] MFA Rules not processed for user `c0cfffaa6c7e464faeb2aca43d570045`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:35:41.496198 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-6b99f492-58e0-4e8d-a681-a9ced12afbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:41.681530 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1191/2380] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:35:41 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:35:41.696988 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4283e1-aa88-4988-8f9d-2e45ea50011b admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:41.705989 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-ed4283e1-aa88-4988-8f9d-2e45ea50011b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:41.802374 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4283e1-aa88-4988-8f9d-2e45ea50011b admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:41.813683 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4491e-7b34-40b5-8a0f-7e6df5e0aa1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:41.814457 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4491e-7b34-40b5-8a0f-7e6df5e0aa1a service nova] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:41.815016 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4491e-7b34-40b5-8a0f-7e6df5e0aa1a service nova] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:41.815689 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4491e-7b34-40b5-8a0f-7e6df5e0aa1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:41.926438 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4491e-7b34-40b5-8a0f-7e6df5e0aa1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:41.929095 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4491e-7b34-40b5-8a0f-7e6df5e0aa1a service nova] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:41.973754 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1190/2381] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:35:41 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:35:42.427245 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91aa372-5521-4d0f-a5ab-61bdb91cefc5 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:42.427804 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91aa372-5521-4d0f-a5ab-61bdb91cefc5 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:42.428086 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91aa372-5521-4d0f-a5ab-61bdb91cefc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:42.453697 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-e91aa372-5521-4d0f-a5ab-61bdb91cefc5 None None] MFA Rules not processed for user `e8dfc8e331664933992e8adcd1fd222a`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:35:42.454934 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-e91aa372-5521-4d0f-a5ab-61bdb91cefc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:42.521155 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1192/2382] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:35:42 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:35:46.951040 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7de792-4501-4fd1-96e4-e8e6dcd28900 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:46.951871 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7de792-4501-4fd1-96e4-e8e6dcd28900 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:46.952354 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7de792-4501-4fd1-96e4-e8e6dcd28900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:46.980247 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-aa7de792-4501-4fd1-96e4-e8e6dcd28900 None None] MFA Rules not processed for user `abc393885c6c4cf6bd4dd52f698fc38c`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:35:46.981551 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-aa7de792-4501-4fd1-96e4-e8e6dcd28900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:47.037625 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1191/2383] 10.222.0.62 () {58 vars in 1009 bytes} [Tue Nov 23 19:35:46 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:35:47.086379 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91aa372-5521-4d0f-a5ab-61bdb91cefc5 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:47.087907 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-e91aa372-5521-4d0f-a5ab-61bdb91cefc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:47.157329 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91aa372-5521-4d0f-a5ab-61bdb91cefc5 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:47.162725 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66eceb8-d070-4303-b493-6486c3ccd45b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87b6ed93587a4c87ad5002fc80b985c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:47.163496 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66eceb8-d070-4303-b493-6486c3ccd45b service swift] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:47.163788 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66eceb8-d070-4303-b493-6486c3ccd45b service swift] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:47.164098 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66eceb8-d070-4303-b493-6486c3ccd45b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:47.172568 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66eceb8-d070-4303-b493-6486c3ccd45b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:47.174738 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66eceb8-d070-4303-b493-6486c3ccd45b service swift] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:35:47.183512 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1193/2384] 10.222.0.62 () {60 vars in 1384 bytes} [Tue Nov 23 19:35:47 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 23 19:35:59.820698 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7de792-4501-4fd1-96e4-e8e6dcd28900 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:35:59.822178 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-aa7de792-4501-4fd1-96e4-e8e6dcd28900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:35:59.955848 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7de792-4501-4fd1-96e4-e8e6dcd28900 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:35:59.961657 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb56ca3-0b82-4e37-a1cd-3c3164bae525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:35:59.962578 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb56ca3-0b82-4e37-a1cd-3c3164bae525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:35:59.962861 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb56ca3-0b82-4e37-a1cd-3c3164bae525 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:35:59.963135 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb56ca3-0b82-4e37-a1cd-3c3164bae525 admin admin] PATH_INFO: `/v3/users/d2f46a3429944972925e8c753afad683` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:35:59.964381 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb56ca3-0b82-4e37-a1cd-3c3164bae525 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2f46a3429944972925e8c753afad683)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:35:59.966314 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb56ca3-0b82-4e37-a1cd-3c3164bae525 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:00.137559 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-0fb56ca3-0b82-4e37-a1cd-3c3164bae525 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2f46a3429944972925e8c753afad683'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:00.141160 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-0fb56ca3-0b82-4e37-a1cd-3c3164bae525 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2f46a3429944972925e8c753afad683'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:00.147081 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-0fb56ca3-0b82-4e37-a1cd-3c3164bae525 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2f46a3429944972925e8c753afad683'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:00.147518 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-0fb56ca3-0b82-4e37-a1cd-3c3164bae525 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2f46a3429944972925e8c753afad683'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:00.162215 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-0fb56ca3-0b82-4e37-a1cd-3c3164bae525 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2f46a3429944972925e8c753afad683'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:00.270596 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1192/2385] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:35:59 2021] DELETE /identity/v3/users/d2f46a3429944972925e8c753afad683 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:36:00.275276 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ee1dc-e041-4c8f-87aa-5e6984250960 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:00.275834 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ee1dc-e041-4c8f-87aa-5e6984250960 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:00.275959 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ee1dc-e041-4c8f-87aa-5e6984250960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:00.306767 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-1e9ee1dc-e041-4c8f-87aa-5e6984250960 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:00.308177 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-1e9ee1dc-e041-4c8f-87aa-5e6984250960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:00.370544 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1194/2386] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:36:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:36:00.391901 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb56ca3-0b82-4e37-a1cd-3c3164bae525 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:00.393587 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-0fb56ca3-0b82-4e37-a1cd-3c3164bae525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:00.495566 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb56ca3-0b82-4e37-a1cd-3c3164bae525 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:00.499303 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ca287-0c7a-4854-8445-60d78248bca1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:00.500124 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ca287-0c7a-4854-8445-60d78248bca1 service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:00.500369 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ca287-0c7a-4854-8445-60d78248bca1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:00.500646 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ca287-0c7a-4854-8445-60d78248bca1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:00.511764 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ca287-0c7a-4854-8445-60d78248bca1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:00.513320 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ca287-0c7a-4854-8445-60d78248bca1 service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:00.525303 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1193/2387] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:36:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:36:00.968919 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ee1dc-e041-4c8f-87aa-5e6984250960 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:00.970400 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-1e9ee1dc-e041-4c8f-87aa-5e6984250960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:00.984326 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ee1dc-e041-4c8f-87aa-5e6984250960 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:00.989965 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c2a40-8a42-417b-8ec6-c85763e2d650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:00.990585 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c2a40-8a42-417b-8ec6-c85763e2d650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:00.993289 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c2a40-8a42-417b-8ec6-c85763e2d650 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:00.993289 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c2a40-8a42-417b-8ec6-c85763e2d650 admin admin] PATH_INFO: `/v3/projects/f548fe5f7dee419498ca7d7e9531af8b` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:00.993289 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c2a40-8a42-417b-8ec6-c85763e2d650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f548fe5f7dee419498ca7d7e9531af8b)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:00.994404 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c2a40-8a42-417b-8ec6-c85763e2d650 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:01.132895 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-0b9c2a40-8a42-417b-8ec6-c85763e2d650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f548fe5f7dee419498ca7d7e9531af8b', 'request_id': 'req-0b9c2a40-8a42-417b-8ec6-c85763e2d650'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:01.138210 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-0b9c2a40-8a42-417b-8ec6-c85763e2d650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f548fe5f7dee419498ca7d7e9531af8b', 'request_id': 'req-0b9c2a40-8a42-417b-8ec6-c85763e2d650'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:01.144256 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-0b9c2a40-8a42-417b-8ec6-c85763e2d650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f548fe5f7dee419498ca7d7e9531af8b', 'request_id': 'req-0b9c2a40-8a42-417b-8ec6-c85763e2d650'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:01.218142 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-0b9c2a40-8a42-417b-8ec6-c85763e2d650 admin admin] The token cache is being invalidate because project f548fe5f7dee419498ca7d7e9531af8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:36:01.218435 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-0b9c2a40-8a42-417b-8ec6-c85763e2d650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:01.219072 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-0b9c2a40-8a42-417b-8ec6-c85763e2d650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:01.220848 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1195/2388] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:36:00 2021] DELETE /identity/v3/projects/f548fe5f7dee419498ca7d7e9531af8b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:36:01.227276 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ca287-0c7a-4854-8445-60d78248bca1 service neutron] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:01.237034 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ca287-0c7a-4854-8445-60d78248bca1 service neutron] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:01.304850 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c77a9-1f2a-4244-b109-468fd4d35c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:01.305799 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c77a9-1f2a-4244-b109-468fd4d35c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:01.306095 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c77a9-1f2a-4244-b109-468fd4d35c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:01.306360 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c77a9-1f2a-4244-b109-468fd4d35c8d admin admin] PATH_INFO: `/v3/users/f76265a313374b68821498e318ddc086` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:01.308059 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c77a9-1f2a-4244-b109-468fd4d35c8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f76265a313374b68821498e318ddc086)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:01.310011 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c77a9-1f2a-4244-b109-468fd4d35c8d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:01.478455 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-529c77a9-1f2a-4244-b109-468fd4d35c8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f76265a313374b68821498e318ddc086'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:01.479200 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-529c77a9-1f2a-4244-b109-468fd4d35c8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f76265a313374b68821498e318ddc086'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:01.486323 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-529c77a9-1f2a-4244-b109-468fd4d35c8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f76265a313374b68821498e318ddc086'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:01.486979 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-529c77a9-1f2a-4244-b109-468fd4d35c8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f76265a313374b68821498e318ddc086'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:01.498993 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-529c77a9-1f2a-4244-b109-468fd4d35c8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f76265a313374b68821498e318ddc086'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:01.591156 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1194/2389] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:36:01 2021] DELETE /identity/v3/users/f76265a313374b68821498e318ddc086 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:36:01.998550 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c2a40-8a42-417b-8ec6-c85763e2d650 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:02.000020 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-0b9c2a40-8a42-417b-8ec6-c85763e2d650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:02.014746 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c2a40-8a42-417b-8ec6-c85763e2d650 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:02.073281 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad90072-24b9-4027-92e8-4bd3d85a5970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:02.074176 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad90072-24b9-4027-92e8-4bd3d85a5970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:02.074459 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad90072-24b9-4027-92e8-4bd3d85a5970 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:02.074735 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad90072-24b9-4027-92e8-4bd3d85a5970 admin admin] PATH_INFO: `/v3/projects/6e9a24d7eeed4e93b4e6b3f1eef8fa8c` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:02.075933 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad90072-24b9-4027-92e8-4bd3d85a5970 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e9a24d7eeed4e93b4e6b3f1eef8fa8c)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:02.077841 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad90072-24b9-4027-92e8-4bd3d85a5970 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:02.162241 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4ad90072-24b9-4027-92e8-4bd3d85a5970 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e9a24d7eeed4e93b4e6b3f1eef8fa8c', 'request_id': 'req-4ad90072-24b9-4027-92e8-4bd3d85a5970'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:02.168330 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4ad90072-24b9-4027-92e8-4bd3d85a5970 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e9a24d7eeed4e93b4e6b3f1eef8fa8c', 'request_id': 'req-4ad90072-24b9-4027-92e8-4bd3d85a5970'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:02.174846 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4ad90072-24b9-4027-92e8-4bd3d85a5970 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e9a24d7eeed4e93b4e6b3f1eef8fa8c', 'request_id': 'req-4ad90072-24b9-4027-92e8-4bd3d85a5970'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:02.247036 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4ad90072-24b9-4027-92e8-4bd3d85a5970 admin admin] The token cache is being invalidate because project 6e9a24d7eeed4e93b4e6b3f1eef8fa8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:36:02.247470 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4ad90072-24b9-4027-92e8-4bd3d85a5970 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:02.248291 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4ad90072-24b9-4027-92e8-4bd3d85a5970 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:02.249792 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1196/2390] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:36:01 2021] DELETE /identity/v3/projects/6e9a24d7eeed4e93b4e6b3f1eef8fa8c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:36:02.255899 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40405a-1e8e-40dc-b3a7-d0c3fa3cb60b None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:02.256402 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40405a-1e8e-40dc-b3a7-d0c3fa3cb60b None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:02.256516 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40405a-1e8e-40dc-b3a7-d0c3fa3cb60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:02.293611 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-cc40405a-1e8e-40dc-b3a7-d0c3fa3cb60b None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:02.294802 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-cc40405a-1e8e-40dc-b3a7-d0c3fa3cb60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:02.351422 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1195/2391] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:36:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:36:02.359535 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae342ba-922c-4310-862b-9626e52b62e7 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:02.359830 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae342ba-922c-4310-862b-9626e52b62e7 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:02.360110 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae342ba-922c-4310-862b-9626e52b62e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:02.378502 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-2ae342ba-922c-4310-862b-9626e52b62e7 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:02.380026 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-2ae342ba-922c-4310-862b-9626e52b62e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:02.388830 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1197/2392] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:36:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:36:02.393105 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40405a-1e8e-40dc-b3a7-d0c3fa3cb60b None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:02.403749 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40405a-1e8e-40dc-b3a7-d0c3fa3cb60b None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:02.408299 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e96e92-b357-470a-8625-fbdbcfbdc2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:02.408948 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e96e92-b357-470a-8625-fbdbcfbdc2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:02.409232 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e96e92-b357-470a-8625-fbdbcfbdc2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:02.409543 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e96e92-b357-470a-8625-fbdbcfbdc2a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:02.410896 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e96e92-b357-470a-8625-fbdbcfbdc2a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:36:02.411387 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e96e92-b357-470a-8625-fbdbcfbdc2a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:02.413026 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e96e92-b357-470a-8625-fbdbcfbdc2a9 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:02.424880 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1196/2393] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:36:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:36:02.428918 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae342ba-922c-4310-862b-9626e52b62e7 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:02.438247 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae342ba-922c-4310-862b-9626e52b62e7 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:02.445167 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e44164-fadc-46a3-b6cc-332f5cc1e28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:02.445917 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e44164-fadc-46a3-b6cc-332f5cc1e28e admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:02.446209 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e44164-fadc-46a3-b6cc-332f5cc1e28e admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:02.446486 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e44164-fadc-46a3-b6cc-332f5cc1e28e admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:02.447387 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e44164-fadc-46a3-b6cc-332f5cc1e28e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:02.449114 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e44164-fadc-46a3-b6cc-332f5cc1e28e admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:02.523225 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1198/2394] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:36:02 2021] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:36:02.527368 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e96e92-b357-470a-8625-fbdbcfbdc2a9 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:02.539472 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e96e92-b357-470a-8625-fbdbcfbdc2a9 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:02.593647 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb5425-b9c9-468c-b10f-789978d6c3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:02.594321 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb5425-b9c9-468c-b10f-789978d6c3e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:02.594605 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb5425-b9c9-468c-b10f-789978d6c3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:02.594882 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb5425-b9c9-468c-b10f-789978d6c3e6 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:02.595626 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb5425-b9c9-468c-b10f-789978d6c3e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:02.597551 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb5425-b9c9-468c-b10f-789978d6c3e6 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:02.665425 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1197/2395] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:36:02 2021] POST /identity/v3/users => generated 283 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:36:02.671067 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e44164-fadc-46a3-b6cc-332f5cc1e28e admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:02.683546 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e44164-fadc-46a3-b6cc-332f5cc1e28e admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:02.688653 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242af3f-2771-473c-89ce-03c0636f730d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:02.689324 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242af3f-2771-473c-89ce-03c0636f730d admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:02.689645 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242af3f-2771-473c-89ce-03c0636f730d admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:02.689950 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242af3f-2771-473c-89ce-03c0636f730d admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:02.690715 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a242af3f-2771-473c-89ce-03c0636f730d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:02.692664 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a242af3f-2771-473c-89ce-03c0636f730d admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:02.705060 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1199/2396] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:36:02 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:36:02.708987 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb5425-b9c9-468c-b10f-789978d6c3e6 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:02.718987 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb5425-b9c9-468c-b10f-789978d6c3e6 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:02.724640 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf109ff1-b692-494d-b983-da04cf46ec7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:02.725303 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf109ff1-b692-494d-b983-da04cf46ec7a admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:02.725624 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf109ff1-b692-494d-b983-da04cf46ec7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:02.725961 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf109ff1-b692-494d-b983-da04cf46ec7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:02.726709 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf109ff1-b692-494d-b983-da04cf46ec7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:02.728281 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf109ff1-b692-494d-b983-da04cf46ec7a admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:02.739662 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1198/2397] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:36:02 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:36:02.743866 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242af3f-2771-473c-89ce-03c0636f730d admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:02.753998 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242af3f-2771-473c-89ce-03c0636f730d admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:02.759060 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57317b70-e947-41cb-9544-930289fd70c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:02.760017 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57317b70-e947-41cb-9544-930289fd70c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:02.760374 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57317b70-e947-41cb-9544-930289fd70c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:02.760742 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57317b70-e947-41cb-9544-930289fd70c2 admin admin] PATH_INFO: `/v3/projects/a404bda9699446c1875c13fbed3d8b54/users/3ca2c04d21e44cebb6182e69a0b8366f/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:02.781176 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57317b70-e947-41cb-9544-930289fd70c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a404bda9699446c1875c13fbed3d8b54, user_id=3ca2c04d21e44cebb6182e69a0b8366f, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:02.783939 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57317b70-e947-41cb-9544-930289fd70c2 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:02.899581 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1200/2398] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:36:02 2021] PUT /identity/v3/projects/a404bda9699446c1875c13fbed3d8b54/users/3ca2c04d21e44cebb6182e69a0b8366f/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:36:02.911269 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459834f6-ec24-4f7c-b8c1-3f7e4a2841c7 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:02.911568 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459834f6-ec24-4f7c-b8c1-3f7e4a2841c7 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:02.911851 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459834f6-ec24-4f7c-b8c1-3f7e4a2841c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:02.942560 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-459834f6-ec24-4f7c-b8c1-3f7e4a2841c7 None None] MFA Rules not processed for user `3ca2c04d21e44cebb6182e69a0b8366f`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:02.943770 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-459834f6-ec24-4f7c-b8c1-3f7e4a2841c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:03.028175 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1199/2399] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:36:02 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:36:03.032617 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57317b70-e947-41cb-9544-930289fd70c2 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:03.103710 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57317b70-e947-41cb-9544-930289fd70c2 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:03.111445 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40e74a-0c6f-45af-90b6-4fd7ae4399ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:03.112108 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40e74a-0c6f-45af-90b6-4fd7ae4399ba admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:03.112409 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40e74a-0c6f-45af-90b6-4fd7ae4399ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:03.112688 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40e74a-0c6f-45af-90b6-4fd7ae4399ba admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:03.113445 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40e74a-0c6f-45af-90b6-4fd7ae4399ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:03.115356 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40e74a-0c6f-45af-90b6-4fd7ae4399ba admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:03.217379 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1201/2400] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:36:03 2021] POST /identity/v3/projects => generated 361 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:36:03.226950 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459834f6-ec24-4f7c-b8c1-3f7e4a2841c7 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:03.237782 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459834f6-ec24-4f7c-b8c1-3f7e4a2841c7 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:03.301789 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d70cc-3666-4250-8143-2ed8d68b3c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:03.302651 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d70cc-3666-4250-8143-2ed8d68b3c24 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:03.302941 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d70cc-3666-4250-8143-2ed8d68b3c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:03.303214 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d70cc-3666-4250-8143-2ed8d68b3c24 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:03.303928 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d70cc-3666-4250-8143-2ed8d68b3c24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:03.312033 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d70cc-3666-4250-8143-2ed8d68b3c24 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:03.399695 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1200/2401] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:36:03 2021] POST /identity/v3/users => generated 287 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:36:03.404569 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40e74a-0c6f-45af-90b6-4fd7ae4399ba admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:03.416338 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40e74a-0c6f-45af-90b6-4fd7ae4399ba admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:03.422444 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35810d-c485-4d99-a54b-56dd08e5bcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:03.423432 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35810d-c485-4d99-a54b-56dd08e5bcfc admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:03.424530 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35810d-c485-4d99-a54b-56dd08e5bcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:03.424530 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35810d-c485-4d99-a54b-56dd08e5bcfc admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:03.425223 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b35810d-c485-4d99-a54b-56dd08e5bcfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:03.427574 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b35810d-c485-4d99-a54b-56dd08e5bcfc admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:03.448112 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1202/2402] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:36:03 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:36:03.452675 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d70cc-3666-4250-8143-2ed8d68b3c24 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:03.465166 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d70cc-3666-4250-8143-2ed8d68b3c24 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:03.470164 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d10c27-c27f-4d89-8fb1-4a1eb38ad0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:03.471054 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d10c27-c27f-4d89-8fb1-4a1eb38ad0ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:03.471341 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d10c27-c27f-4d89-8fb1-4a1eb38ad0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:03.471615 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d10c27-c27f-4d89-8fb1-4a1eb38ad0ca admin admin] PATH_INFO: `/v3/projects/07254d56db8e4c49bbc9402ab0fe78d6/users/9eb93ea593a14a99addb842d7f986224/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:03.497550 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d10c27-c27f-4d89-8fb1-4a1eb38ad0ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=07254d56db8e4c49bbc9402ab0fe78d6, user_id=9eb93ea593a14a99addb842d7f986224, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:03.500167 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d10c27-c27f-4d89-8fb1-4a1eb38ad0ca admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:03.596572 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1201/2403] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:36:03 2021] PUT /identity/v3/projects/07254d56db8e4c49bbc9402ab0fe78d6/users/9eb93ea593a14a99addb842d7f986224/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:36:03.601112 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35810d-c485-4d99-a54b-56dd08e5bcfc admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:03.612924 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35810d-c485-4d99-a54b-56dd08e5bcfc admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:03.681989 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b1029-72a6-41e6-b8c7-856b4f37b399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:03.682720 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b1029-72a6-41e6-b8c7-856b4f37b399 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:03.683008 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b1029-72a6-41e6-b8c7-856b4f37b399 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:03.683285 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b1029-72a6-41e6-b8c7-856b4f37b399 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:03.684105 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b1029-72a6-41e6-b8c7-856b4f37b399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:03.685721 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b1029-72a6-41e6-b8c7-856b4f37b399 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:03.703464 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1203/2404] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:36:03 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:36:03.705626 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d10c27-c27f-4d89-8fb1-4a1eb38ad0ca admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:03.717437 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d10c27-c27f-4d89-8fb1-4a1eb38ad0ca admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:03.722262 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279bac14-5af0-414d-a8c1-d6f8cad4ed9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:03.723409 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bac14-5af0-414d-a8c1-d6f8cad4ed9e admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:03.723821 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bac14-5af0-414d-a8c1-d6f8cad4ed9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:03.724132 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bac14-5af0-414d-a8c1-d6f8cad4ed9e admin admin] PATH_INFO: `/v3/projects/07254d56db8e4c49bbc9402ab0fe78d6/users/9eb93ea593a14a99addb842d7f986224/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:03.726987 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279bac14-5af0-414d-a8c1-d6f8cad4ed9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=07254d56db8e4c49bbc9402ab0fe78d6, user_id=9eb93ea593a14a99addb842d7f986224, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:03.729660 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279bac14-5af0-414d-a8c1-d6f8cad4ed9e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:03.742578 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1202/2405] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:36:03 2021] PUT /identity/v3/projects/07254d56db8e4c49bbc9402ab0fe78d6/users/9eb93ea593a14a99addb842d7f986224/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:36:03.752350 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938eba6-8314-4c7f-816d-e7d76350f8ba None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:03.752662 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938eba6-8314-4c7f-816d-e7d76350f8ba None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:03.752926 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938eba6-8314-4c7f-816d-e7d76350f8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:03.780334 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-c938eba6-8314-4c7f-816d-e7d76350f8ba None None] MFA Rules not processed for user `9eb93ea593a14a99addb842d7f986224`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:03.781584 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-c938eba6-8314-4c7f-816d-e7d76350f8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:03.854751 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1204/2406] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:36:03 2021] POST /identity/v3/auth/tokens => generated 3295 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:36:03.865792 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279bac14-5af0-414d-a8c1-d6f8cad4ed9e admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:03.867538 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-279bac14-5af0-414d-a8c1-d6f8cad4ed9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:03.935222 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279bac14-5af0-414d-a8c1-d6f8cad4ed9e admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:03.939298 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60144f95-e180-435a-b536-ab539f4a8138 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:03.939948 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60144f95-e180-435a-b536-ab539f4a8138 service cinder] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:03.940231 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60144f95-e180-435a-b536-ab539f4a8138 service cinder] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:03.940507 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60144f95-e180-435a-b536-ab539f4a8138 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:03.950479 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60144f95-e180-435a-b536-ab539f4a8138 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:03.951942 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60144f95-e180-435a-b536-ab539f4a8138 service cinder] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:03.962903 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1203/2407] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:36:03 2021] GET /identity/v3/auth/tokens => generated 3295 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:36:04.337918 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938eba6-8314-4c7f-816d-e7d76350f8ba None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:04.410041 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938eba6-8314-4c7f-816d-e7d76350f8ba None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:04.416803 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db8fba-355b-43c4-9a7b-22a2c7b5bdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:04.417744 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db8fba-355b-43c4-9a7b-22a2c7b5bdf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:04.418030 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db8fba-355b-43c4-9a7b-22a2c7b5bdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:04.418310 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db8fba-355b-43c4-9a7b-22a2c7b5bdf1 admin admin] PATH_INFO: `/v3/users/3ca2c04d21e44cebb6182e69a0b8366f` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:04.419669 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db8fba-355b-43c4-9a7b-22a2c7b5bdf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ca2c04d21e44cebb6182e69a0b8366f)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:04.421765 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db8fba-355b-43c4-9a7b-22a2c7b5bdf1 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:04.635015 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-27db8fba-355b-43c4-9a7b-22a2c7b5bdf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ca2c04d21e44cebb6182e69a0b8366f'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:04.638736 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-27db8fba-355b-43c4-9a7b-22a2c7b5bdf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ca2c04d21e44cebb6182e69a0b8366f'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:04.710753 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-27db8fba-355b-43c4-9a7b-22a2c7b5bdf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ca2c04d21e44cebb6182e69a0b8366f'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:04.711567 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-27db8fba-355b-43c4-9a7b-22a2c7b5bdf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ca2c04d21e44cebb6182e69a0b8366f'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:04.728159 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-27db8fba-355b-43c4-9a7b-22a2c7b5bdf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ca2c04d21e44cebb6182e69a0b8366f'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:04.742789 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1205/2408] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:36:04 2021] DELETE /identity/v3/users/3ca2c04d21e44cebb6182e69a0b8366f => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:36:04.747280 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91ae90-b6bd-4a4f-87e3-cae39b91d085 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:04.748753 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91ae90-b6bd-4a4f-87e3-cae39b91d085 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:04.748753 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91ae90-b6bd-4a4f-87e3-cae39b91d085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:04.775066 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-ff91ae90-b6bd-4a4f-87e3-cae39b91d085 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:04.778007 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-ff91ae90-b6bd-4a4f-87e3-cae39b91d085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:04.862233 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1204/2409] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:36:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:36:04.892610 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db8fba-355b-43c4-9a7b-22a2c7b5bdf1 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:04.894322 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-27db8fba-355b-43c4-9a7b-22a2c7b5bdf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:04.971368 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db8fba-355b-43c4-9a7b-22a2c7b5bdf1 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:04.975615 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6ea5e-e217-44d9-95d9-efce2b470f65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:04.976264 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6ea5e-e217-44d9-95d9-efce2b470f65 service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:04.976838 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6ea5e-e217-44d9-95d9-efce2b470f65 service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:04.976838 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6ea5e-e217-44d9-95d9-efce2b470f65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:04.992199 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6ea5e-e217-44d9-95d9-efce2b470f65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:04.993817 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6ea5e-e217-44d9-95d9-efce2b470f65 service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:05.005849 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1206/2410] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:36:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:36:05.697189 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91ae90-b6bd-4a4f-87e3-cae39b91d085 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:05.698901 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-ff91ae90-b6bd-4a4f-87e3-cae39b91d085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:05.716786 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91ae90-b6bd-4a4f-87e3-cae39b91d085 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:05.729897 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbaf394-a4bb-4825-b2b7-43f4abd6b78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:05.730765 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbaf394-a4bb-4825-b2b7-43f4abd6b78d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:05.731054 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbaf394-a4bb-4825-b2b7-43f4abd6b78d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:05.731351 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbaf394-a4bb-4825-b2b7-43f4abd6b78d admin admin] PATH_INFO: `/v3/projects/a404bda9699446c1875c13fbed3d8b54` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:05.732666 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbaf394-a4bb-4825-b2b7-43f4abd6b78d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a404bda9699446c1875c13fbed3d8b54)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:05.734583 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbaf394-a4bb-4825-b2b7-43f4abd6b78d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:05.821352 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-0cbaf394-a4bb-4825-b2b7-43f4abd6b78d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a404bda9699446c1875c13fbed3d8b54', 'request_id': 'req-0cbaf394-a4bb-4825-b2b7-43f4abd6b78d'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:05.828536 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-0cbaf394-a4bb-4825-b2b7-43f4abd6b78d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a404bda9699446c1875c13fbed3d8b54', 'request_id': 'req-0cbaf394-a4bb-4825-b2b7-43f4abd6b78d'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:05.834081 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-0cbaf394-a4bb-4825-b2b7-43f4abd6b78d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a404bda9699446c1875c13fbed3d8b54', 'request_id': 'req-0cbaf394-a4bb-4825-b2b7-43f4abd6b78d'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:05.909149 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-0cbaf394-a4bb-4825-b2b7-43f4abd6b78d admin admin] The token cache is being invalidate because project a404bda9699446c1875c13fbed3d8b54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:36:05.909464 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-0cbaf394-a4bb-4825-b2b7-43f4abd6b78d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:05.912615 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-0cbaf394-a4bb-4825-b2b7-43f4abd6b78d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:05.912615 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1205/2411] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:36:05 2021] DELETE /identity/v3/projects/a404bda9699446c1875c13fbed3d8b54 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:36:05.915500 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6ea5e-e217-44d9-95d9-efce2b470f65 service neutron] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:05.936523 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6ea5e-e217-44d9-95d9-efce2b470f65 service neutron] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:06.001727 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563cd0a4-ea31-4f6f-ab29-8c325be7df63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:06.002630 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563cd0a4-ea31-4f6f-ab29-8c325be7df63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:06.002915 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563cd0a4-ea31-4f6f-ab29-8c325be7df63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:06.003194 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563cd0a4-ea31-4f6f-ab29-8c325be7df63 admin admin] PATH_INFO: `/v3/users/9eb93ea593a14a99addb842d7f986224` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:06.005011 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563cd0a4-ea31-4f6f-ab29-8c325be7df63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eb93ea593a14a99addb842d7f986224)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:06.008155 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563cd0a4-ea31-4f6f-ab29-8c325be7df63 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:06.174404 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-563cd0a4-ea31-4f6f-ab29-8c325be7df63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eb93ea593a14a99addb842d7f986224'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:06.175163 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-563cd0a4-ea31-4f6f-ab29-8c325be7df63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eb93ea593a14a99addb842d7f986224'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:06.235558 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-563cd0a4-ea31-4f6f-ab29-8c325be7df63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eb93ea593a14a99addb842d7f986224'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:06.236200 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-563cd0a4-ea31-4f6f-ab29-8c325be7df63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eb93ea593a14a99addb842d7f986224'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:06.248724 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-563cd0a4-ea31-4f6f-ab29-8c325be7df63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eb93ea593a14a99addb842d7f986224'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:06.261492 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1207/2412] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:36:05 2021] DELETE /identity/v3/users/9eb93ea593a14a99addb842d7f986224 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:36:06.678736 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbaf394-a4bb-4825-b2b7-43f4abd6b78d admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:06.680448 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-0cbaf394-a4bb-4825-b2b7-43f4abd6b78d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:06.696313 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbaf394-a4bb-4825-b2b7-43f4abd6b78d admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:06.756411 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c7007-5886-43ae-b1ad-52743f6c7485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:06.757273 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c7007-5886-43ae-b1ad-52743f6c7485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:06.757588 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c7007-5886-43ae-b1ad-52743f6c7485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:06.757862 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c7007-5886-43ae-b1ad-52743f6c7485 admin admin] PATH_INFO: `/v3/projects/07254d56db8e4c49bbc9402ab0fe78d6` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:06.759069 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c7007-5886-43ae-b1ad-52743f6c7485 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07254d56db8e4c49bbc9402ab0fe78d6)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:06.760939 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c7007-5886-43ae-b1ad-52743f6c7485 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:06.764997 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614715d4-ffab-4447-ba2a-d5b1fb28ec04 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:06.765286 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614715d4-ffab-4447-ba2a-d5b1fb28ec04 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:06.765590 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614715d4-ffab-4447-ba2a-d5b1fb28ec04 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:06.767358 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1208/2413] 10.222.0.62 () {54 vars in 921 bytes} [Tue Nov 23 19:36:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 19:36:06.773443 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11fbb7-01a7-482c-905a-a5467d46fc27 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:06.773857 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11fbb7-01a7-482c-905a-a5467d46fc27 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:06.774231 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11fbb7-01a7-482c-905a-a5467d46fc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:06.820411 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-5e11fbb7-01a7-482c-905a-a5467d46fc27 None None] MFA Rules not processed for user `6d91fe7f996b48b0bc28e1eadc4f8869`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:06.821630 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-5e11fbb7-01a7-482c-905a-a5467d46fc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:06.882295 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-8b5c7007-5886-43ae-b1ad-52743f6c7485 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07254d56db8e4c49bbc9402ab0fe78d6', 'request_id': 'req-8b5c7007-5886-43ae-b1ad-52743f6c7485'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:06.888277 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-8b5c7007-5886-43ae-b1ad-52743f6c7485 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07254d56db8e4c49bbc9402ab0fe78d6', 'request_id': 'req-8b5c7007-5886-43ae-b1ad-52743f6c7485'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:06.893566 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-8b5c7007-5886-43ae-b1ad-52743f6c7485 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07254d56db8e4c49bbc9402ab0fe78d6', 'request_id': 'req-8b5c7007-5886-43ae-b1ad-52743f6c7485'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:06.893731 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1209/2414] 10.222.0.62 () {58 vars in 1018 bytes} [Tue Nov 23 19:36:06 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:36:06.907002 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11fbb7-01a7-482c-905a-a5467d46fc27 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:06.908396 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-5e11fbb7-01a7-482c-905a-a5467d46fc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:06.966778 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-8b5c7007-5886-43ae-b1ad-52743f6c7485 admin admin] The token cache is being invalidate because project 07254d56db8e4c49bbc9402ab0fe78d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:36:06.967115 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-8b5c7007-5886-43ae-b1ad-52743f6c7485 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:06.967460 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11fbb7-01a7-482c-905a-a5467d46fc27 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:06.973180 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-8b5c7007-5886-43ae-b1ad-52743f6c7485 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:06.973180 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1206/2415] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:36:06 2021] DELETE /identity/v3/projects/07254d56db8e4c49bbc9402ab0fe78d6 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:36:06.984195 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cbdcc-99d2-4ab7-90b4-acccfc9fd4d9 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:06.984568 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cbdcc-99d2-4ab7-90b4-acccfc9fd4d9 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:06.984921 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cbdcc-99d2-4ab7-90b4-acccfc9fd4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:07.006200 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-2f9cbdcc-99d2-4ab7-90b4-acccfc9fd4d9 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:07.007326 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-2f9cbdcc-99d2-4ab7-90b4-acccfc9fd4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:07.028625 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4d508-017e-4a9f-9f08-c9de337a7414 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '544443ed44ef41bcaa86af52926bfd14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:07.029208 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4d508-017e-4a9f-9f08-c9de337a7414 service glance] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:07.029526 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4d508-017e-4a9f-9f08-c9de337a7414 service glance] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:07.029855 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4d508-017e-4a9f-9f08-c9de337a7414 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:07.031716 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-37a4d508-017e-4a9f-9f08-c9de337a7414 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:07.070745 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1207/2416] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:36:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:36:07.079013 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4581ce6-11e8-4895-b8ea-c76ba987a9b2 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:07.079301 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4581ce6-11e8-4895-b8ea-c76ba987a9b2 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:07.079611 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4581ce6-11e8-4895-b8ea-c76ba987a9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:07.098503 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-c4581ce6-11e8-4895-b8ea-c76ba987a9b2 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:07.099699 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-c4581ce6-11e8-4895-b8ea-c76ba987a9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:07.107836 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1208/2417] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:36:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:36:07.112323 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4581ce6-11e8-4895-b8ea-c76ba987a9b2 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:07.114657 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a4d508-017e-4a9f-9f08-c9de337a7414 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:07.116127 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a4d508-017e-4a9f-9f08-c9de337a7414 service glance] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:07.122284 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4581ce6-11e8-4895-b8ea-c76ba987a9b2 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:07.127792 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed08ce-8550-4d5a-b2f3-2ffe85bd7225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:07.128339 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1210/2418] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:36:06 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:36:07.128698 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed08ce-8550-4d5a-b2f3-2ffe85bd7225 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:07.129599 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed08ce-8550-4d5a-b2f3-2ffe85bd7225 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:07.129975 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed08ce-8550-4d5a-b2f3-2ffe85bd7225 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:07.130734 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed08ce-8550-4d5a-b2f3-2ffe85bd7225 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:36:07.131043 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed08ce-8550-4d5a-b2f3-2ffe85bd7225 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:07.132766 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed08ce-8550-4d5a-b2f3-2ffe85bd7225 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:07.146814 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1209/2419] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:36:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:36:07.151548 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4d508-017e-4a9f-9f08-c9de337a7414 service glance] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:07.163633 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4d508-017e-4a9f-9f08-c9de337a7414 service glance] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:07.168922 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8310ae-b119-4a29-a211-707c5c3d8627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:07.169833 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8310ae-b119-4a29-a211-707c5c3d8627 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:07.170198 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8310ae-b119-4a29-a211-707c5c3d8627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:07.170541 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8310ae-b119-4a29-a211-707c5c3d8627 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:07.171334 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8310ae-b119-4a29-a211-707c5c3d8627 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:07.173330 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8310ae-b119-4a29-a211-707c5c3d8627 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:07.289194 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1211/2420] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:36:07 2021] POST /identity/v3/projects => generated 353 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:36:07.293500 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed08ce-8550-4d5a-b2f3-2ffe85bd7225 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:07.303333 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed08ce-8550-4d5a-b2f3-2ffe85bd7225 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:07.343271 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede9f7f-e1cc-46bd-8215-f80db3b4cfe7 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:07.343605 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede9f7f-e1cc-46bd-8215-f80db3b4cfe7 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:07.343820 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede9f7f-e1cc-46bd-8215-f80db3b4cfe7 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:07.345871 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1212/2421] 10.222.0.62 () {54 vars in 921 bytes} [Tue Nov 23 19:36:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:36:07.354218 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8e513-caac-4663-a898-48a775f5c3ce None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:07.354705 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8e513-caac-4663-a898-48a775f5c3ce None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:07.355097 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8e513-caac-4663-a898-48a775f5c3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:07.380014 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0aaec5-11d2-441f-9506-0c0c95b4b580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:07.383248 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0aaec5-11d2-441f-9506-0c0c95b4b580 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:07.383248 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0aaec5-11d2-441f-9506-0c0c95b4b580 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:07.383248 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0aaec5-11d2-441f-9506-0c0c95b4b580 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:07.383248 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0aaec5-11d2-441f-9506-0c0c95b4b580 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:07.385857 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0aaec5-11d2-441f-9506-0c0c95b4b580 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:07.401239 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-cdc8e513-caac-4663-a898-48a775f5c3ce None None] MFA Rules not processed for user `f1ef2ac0a788451eb50fa80f559f808f`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:07.402537 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-cdc8e513-caac-4663-a898-48a775f5c3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:07.470714 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1213/2422] 10.222.0.62 () {58 vars in 1018 bytes} [Tue Nov 23 19:36:07 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:36:07.483988 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8e513-caac-4663-a898-48a775f5c3ce None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:07.485383 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-cdc8e513-caac-4663-a898-48a775f5c3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:07.489571 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1210/2423] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:36:07 2021] POST /identity/v3/users => generated 277 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:36:07.494335 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0aaec5-11d2-441f-9506-0c0c95b4b580 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:07.500394 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8e513-caac-4663-a898-48a775f5c3ce None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:07.504365 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbbd437-cc08-4bb0-827c-3730d60b80cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:07.504786 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0aaec5-11d2-441f-9506-0c0c95b4b580 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:07.505017 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbd437-cc08-4bb0-827c-3730d60b80cf service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:07.505295 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbd437-cc08-4bb0-827c-3730d60b80cf service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:07.505600 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbd437-cc08-4bb0-827c-3730d60b80cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:07.513287 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbbd437-cc08-4bb0-827c-3730d60b80cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:07.523839 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbbd437-cc08-4bb0-827c-3730d60b80cf service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:07.524181 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be5507-37f7-46e0-b3de-eea84bcff5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:07.524181 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be5507-37f7-46e0-b3de-eea84bcff5ce admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:07.524181 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be5507-37f7-46e0-b3de-eea84bcff5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:07.524181 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be5507-37f7-46e0-b3de-eea84bcff5ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:07.524540 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be5507-37f7-46e0-b3de-eea84bcff5ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:07.524540 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be5507-37f7-46e0-b3de-eea84bcff5ce admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:07.524704 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1214/2424] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:36:07 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:36:07.530949 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1211/2425] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:36:07 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:36:07.535692 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbbd437-cc08-4bb0-827c-3730d60b80cf service neutron] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:07.547160 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbbd437-cc08-4bb0-827c-3730d60b80cf service neutron] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:07.552152 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef56615-a45e-4ba4-91b5-96f7476d69bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:07.554923 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef56615-a45e-4ba4-91b5-96f7476d69bd admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:07.554923 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef56615-a45e-4ba4-91b5-96f7476d69bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:07.554923 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef56615-a45e-4ba4-91b5-96f7476d69bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:07.554923 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef56615-a45e-4ba4-91b5-96f7476d69bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:07.556067 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef56615-a45e-4ba4-91b5-96f7476d69bd admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:07.567173 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1215/2426] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:36:07 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:36:07.571508 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be5507-37f7-46e0-b3de-eea84bcff5ce admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:07.582837 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be5507-37f7-46e0-b3de-eea84bcff5ce admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:07.587646 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ab8d9-1c1f-4083-8d77-cd46f5fde8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:07.588580 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ab8d9-1c1f-4083-8d77-cd46f5fde8f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:07.588817 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ab8d9-1c1f-4083-8d77-cd46f5fde8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:07.589095 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ab8d9-1c1f-4083-8d77-cd46f5fde8f9 admin admin] PATH_INFO: `/v3/projects/6f2dc20a04f84a6bb4543b3d69cf0abc/users/65cfe9b99f7a4b7f93d15cd1116e6c32/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:07.622995 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ab8d9-1c1f-4083-8d77-cd46f5fde8f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f2dc20a04f84a6bb4543b3d69cf0abc, user_id=65cfe9b99f7a4b7f93d15cd1116e6c32, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:07.626049 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ab8d9-1c1f-4083-8d77-cd46f5fde8f9 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:07.721534 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1212/2427] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:36:07 2021] PUT /identity/v3/projects/6f2dc20a04f84a6bb4543b3d69cf0abc/users/65cfe9b99f7a4b7f93d15cd1116e6c32/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:36:07.732880 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e17c90-657b-437f-b41a-e4cd93642bfa None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:07.733216 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e17c90-657b-437f-b41a-e4cd93642bfa None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:07.733542 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e17c90-657b-437f-b41a-e4cd93642bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:07.766784 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-69e17c90-657b-437f-b41a-e4cd93642bfa None None] MFA Rules not processed for user `65cfe9b99f7a4b7f93d15cd1116e6c32`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:07.768105 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-69e17c90-657b-437f-b41a-e4cd93642bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:07.840076 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1216/2428] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:36:07 2021] POST /identity/v3/auth/tokens => generated 3220 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:36:07.844410 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ab8d9-1c1f-4083-8d77-cd46f5fde8f9 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:07.915371 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ab8d9-1c1f-4083-8d77-cd46f5fde8f9 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:07.920963 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11789c59-d5cf-4382-8e26-cba1cfe3402a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:07.927679 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11789c59-d5cf-4382-8e26-cba1cfe3402a admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:07.931865 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11789c59-d5cf-4382-8e26-cba1cfe3402a admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:07.931865 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11789c59-d5cf-4382-8e26-cba1cfe3402a admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:07.931865 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11789c59-d5cf-4382-8e26-cba1cfe3402a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:07.931865 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11789c59-d5cf-4382-8e26-cba1cfe3402a admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:08.023551 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1213/2429] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:36:07 2021] POST /identity/v3/projects => generated 357 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:36:08.028377 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e17c90-657b-437f-b41a-e4cd93642bfa None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:08.044419 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e17c90-657b-437f-b41a-e4cd93642bfa None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:08.107680 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b40f08-5df4-4b0b-9a26-bc56719e39ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:08.107680 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b40f08-5df4-4b0b-9a26-bc56719e39ac admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:08.107680 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b40f08-5df4-4b0b-9a26-bc56719e39ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:08.107680 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b40f08-5df4-4b0b-9a26-bc56719e39ac admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:08.108196 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b40f08-5df4-4b0b-9a26-bc56719e39ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:08.109698 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b40f08-5df4-4b0b-9a26-bc56719e39ac admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:08.232888 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1217/2430] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:36:08 2021] POST /identity/v3/users => generated 285 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:36:08.236791 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11789c59-d5cf-4382-8e26-cba1cfe3402a admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:08.248647 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11789c59-d5cf-4382-8e26-cba1cfe3402a admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:08.253271 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5661d0-8b05-4bd9-a848-c52a1141be1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:08.254074 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5661d0-8b05-4bd9-a848-c52a1141be1c admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:08.254567 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5661d0-8b05-4bd9-a848-c52a1141be1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:08.254876 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5661d0-8b05-4bd9-a848-c52a1141be1c admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:08.255959 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5661d0-8b05-4bd9-a848-c52a1141be1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:08.257741 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5661d0-8b05-4bd9-a848-c52a1141be1c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:08.271754 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1214/2431] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:36:08 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:36:08.273905 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b40f08-5df4-4b0b-9a26-bc56719e39ac admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:08.283812 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b40f08-5df4-4b0b-9a26-bc56719e39ac admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:08.290294 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009af03-3838-494f-9291-93dc967c5c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:08.291188 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009af03-3838-494f-9291-93dc967c5c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:08.291467 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009af03-3838-494f-9291-93dc967c5c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:08.291741 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009af03-3838-494f-9291-93dc967c5c63 admin admin] PATH_INFO: `/v3/projects/cae52e582b74423fbb911fe613e0abd6/users/4bb8e82258f64997af6699ed7a54df27/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:08.308026 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009af03-3838-494f-9291-93dc967c5c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cae52e582b74423fbb911fe613e0abd6, user_id=4bb8e82258f64997af6699ed7a54df27, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:08.310770 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009af03-3838-494f-9291-93dc967c5c63 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:08.428587 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1218/2432] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:36:08 2021] PUT /identity/v3/projects/cae52e582b74423fbb911fe613e0abd6/users/4bb8e82258f64997af6699ed7a54df27/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:36:08.432731 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5661d0-8b05-4bd9-a848-c52a1141be1c admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:08.450657 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5661d0-8b05-4bd9-a848-c52a1141be1c admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:08.508123 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241b681-cd66-4365-8982-75d2579e59ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:08.508745 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241b681-cd66-4365-8982-75d2579e59ab admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:08.509143 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241b681-cd66-4365-8982-75d2579e59ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:08.509451 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241b681-cd66-4365-8982-75d2579e59ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:08.510175 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241b681-cd66-4365-8982-75d2579e59ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:08.511727 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241b681-cd66-4365-8982-75d2579e59ab admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:08.522286 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1215/2433] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:36:08 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:36:08.526580 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009af03-3838-494f-9291-93dc967c5c63 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:08.538318 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009af03-3838-494f-9291-93dc967c5c63 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:08.543811 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a307e-61b9-4ccf-8ff8-379986e26b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:08.544704 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a307e-61b9-4ccf-8ff8-379986e26b46 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:08.544988 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a307e-61b9-4ccf-8ff8-379986e26b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:08.545263 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a307e-61b9-4ccf-8ff8-379986e26b46 admin admin] PATH_INFO: `/v3/projects/cae52e582b74423fbb911fe613e0abd6/users/4bb8e82258f64997af6699ed7a54df27/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:08.547566 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a307e-61b9-4ccf-8ff8-379986e26b46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cae52e582b74423fbb911fe613e0abd6, user_id=4bb8e82258f64997af6699ed7a54df27, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:08.550706 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a307e-61b9-4ccf-8ff8-379986e26b46 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:08.563529 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1219/2434] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:36:08 2021] PUT /identity/v3/projects/cae52e582b74423fbb911fe613e0abd6/users/4bb8e82258f64997af6699ed7a54df27/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:36:08.575348 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef4d2b-0f2f-4906-be99-cbfa6da3a425 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:08.576519 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef4d2b-0f2f-4906-be99-cbfa6da3a425 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:08.577458 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef4d2b-0f2f-4906-be99-cbfa6da3a425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:08.626225 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-98ef4d2b-0f2f-4906-be99-cbfa6da3a425 None None] MFA Rules not processed for user `4bb8e82258f64997af6699ed7a54df27`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:08.627448 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-98ef4d2b-0f2f-4906-be99-cbfa6da3a425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:08.696183 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1216/2435] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:36:08 2021] POST /identity/v3/auth/tokens => generated 3291 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:36:08.707723 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a307e-61b9-4ccf-8ff8-379986e26b46 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:08.709596 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-a74a307e-61b9-4ccf-8ff8-379986e26b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:08.767264 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a307e-61b9-4ccf-8ff8-379986e26b46 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:08.771440 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a497cf-1fd5-4910-a255-15b201d9f662 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:08.772076 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a497cf-1fd5-4910-a255-15b201d9f662 service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:08.772429 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a497cf-1fd5-4910-a255-15b201d9f662 service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:08.772609 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a497cf-1fd5-4910-a255-15b201d9f662 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:08.781842 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a497cf-1fd5-4910-a255-15b201d9f662 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:08.783263 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a497cf-1fd5-4910-a255-15b201d9f662 service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:08.793659 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1220/2436] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:36:08 2021] GET /identity/v3/auth/tokens => generated 3291 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:36:09.066983 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef4d2b-0f2f-4906-be99-cbfa6da3a425 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:09.077001 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef4d2b-0f2f-4906-be99-cbfa6da3a425 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:09.083180 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f5d5e-e614-4d70-8b3d-422dc579b205 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:09.084087 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f5d5e-e614-4d70-8b3d-422dc579b205 service cinder] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:09.084524 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f5d5e-e614-4d70-8b3d-422dc579b205 service cinder] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:09.084954 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f5d5e-e614-4d70-8b3d-422dc579b205 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:09.145832 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f5d5e-e614-4d70-8b3d-422dc579b205 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:09.146566 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f5d5e-e614-4d70-8b3d-422dc579b205 service cinder] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:09.158783 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1217/2437] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:36:09 2021] GET /identity/v3/auth/tokens => generated 3220 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:36:13.568309 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107d4f7-246c-498d-9659-6077474cf9f3 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:13.568805 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107d4f7-246c-498d-9659-6077474cf9f3 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:13.568991 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107d4f7-246c-498d-9659-6077474cf9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:13.590208 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-3107d4f7-246c-498d-9659-6077474cf9f3 None None] MFA Rules not processed for user `abc393885c6c4cf6bd4dd52f698fc38c`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:13.591447 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-3107d4f7-246c-498d-9659-6077474cf9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:13.647659 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1221/2438] 10.222.0.62 () {58 vars in 1009 bytes} [Tue Nov 23 19:36:13 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:36:13.661140 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f5d5e-e614-4d70-8b3d-422dc579b205 service cinder] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:13.671540 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-683f5d5e-e614-4d70-8b3d-422dc579b205 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:13.741220 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f5d5e-e614-4d70-8b3d-422dc579b205 service cinder] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:13.747476 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5913f75-8307-43dd-92e5-f7d7a796f11e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87b6ed93587a4c87ad5002fc80b985c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:13.748293 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5913f75-8307-43dd-92e5-f7d7a796f11e service swift] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:13.748585 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5913f75-8307-43dd-92e5-f7d7a796f11e service swift] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:13.748861 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5913f75-8307-43dd-92e5-f7d7a796f11e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:13.763833 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5913f75-8307-43dd-92e5-f7d7a796f11e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:13.763833 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5913f75-8307-43dd-92e5-f7d7a796f11e service swift] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:13.776285 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1218/2439] 10.222.0.62 () {60 vars in 1384 bytes} [Tue Nov 23 19:36:13 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:36:15.537819 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6e8fb-c3bd-4c3e-b978-6c206f7c5435 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:15.538689 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6e8fb-c3bd-4c3e-b978-6c206f7c5435 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:15.539149 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6e8fb-c3bd-4c3e-b978-6c206f7c5435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:15.572757 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-21a6e8fb-c3bd-4c3e-b978-6c206f7c5435 None None] MFA Rules not processed for user `ecaf914ba335477182e4e1153d0d3f71`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:15.574260 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-21a6e8fb-c3bd-4c3e-b978-6c206f7c5435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:15.650187 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1222/2440] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:36:15 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:36:20.860339 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6418a-851d-411b-b24c-a505969e6d64 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:20.861299 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6418a-851d-411b-b24c-a505969e6d64 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:20.861769 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6418a-851d-411b-b24c-a505969e6d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:20.883214 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-ddc6418a-851d-411b-b24c-a505969e6d64 None None] MFA Rules not processed for user `abc393885c6c4cf6bd4dd52f698fc38c`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:20.884749 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-ddc6418a-851d-411b-b24c-a505969e6d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:20.901791 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1219/2441] 10.222.0.62 () {58 vars in 1009 bytes} [Tue Nov 23 19:36:20 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:36:20.919261 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6e8fb-c3bd-4c3e-b978-6c206f7c5435 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:20.943008 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6e8fb-c3bd-4c3e-b978-6c206f7c5435 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:20.949868 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b1239-fa35-4db2-96ba-b41a353d9671 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87b6ed93587a4c87ad5002fc80b985c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:20.951627 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b1239-fa35-4db2-96ba-b41a353d9671 service swift] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:20.952395 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b1239-fa35-4db2-96ba-b41a353d9671 service swift] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:20.952886 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b1239-fa35-4db2-96ba-b41a353d9671 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:20.979348 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b1239-fa35-4db2-96ba-b41a353d9671 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:20.984256 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b1239-fa35-4db2-96ba-b41a353d9671 service swift] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:20.998982 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1223/2442] 10.222.0.62 () {60 vars in 1384 bytes} [Tue Nov 23 19:36:20 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:36:37.946241 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc6418a-851d-411b-b24c-a505969e6d64 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:37.950308 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-ddc6418a-851d-411b-b24c-a505969e6d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:38.016215 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc616d4d-0d97-4675-a500-50baa643af33 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:38.016843 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc616d4d-0d97-4675-a500-50baa643af33 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:38.016843 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc616d4d-0d97-4675-a500-50baa643af33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:38.041096 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-cc616d4d-0d97-4675-a500-50baa643af33 None None] MFA Rules not processed for user `abc393885c6c4cf6bd4dd52f698fc38c`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:38.042849 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-cc616d4d-0d97-4675-a500-50baa643af33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:38.052991 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1224/2443] 10.222.0.62 () {58 vars in 967 bytes} [Tue Nov 23 19:36:38 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:36:38.070912 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc616d4d-0d97-4675-a500-50baa643af33 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:38.089578 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc616d4d-0d97-4675-a500-50baa643af33 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:38.103522 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59f723-1888-4ece-af17-dbdf0d2a51ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87b6ed93587a4c87ad5002fc80b985c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:38.104134 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59f723-1888-4ece-af17-dbdf0d2a51ef service swift] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:38.104419 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59f723-1888-4ece-af17-dbdf0d2a51ef service swift] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:38.104698 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59f723-1888-4ece-af17-dbdf0d2a51ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:38.131588 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb59f723-1888-4ece-af17-dbdf0d2a51ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:38.133177 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb59f723-1888-4ece-af17-dbdf0d2a51ef service swift] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:38.135530 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc6418a-851d-411b-b24c-a505969e6d64 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:38.142701 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1225/2444] 10.222.0.62 () {60 vars in 1384 bytes} [Tue Nov 23 19:36:38 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:36:38.145896 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c96c9-86f4-4adb-a023-87f0addcd98a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd100a378f1ff441080555bfc2ff4d6ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:38.146458 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c96c9-86f4-4adb-a023-87f0addcd98a service placement] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:38.146796 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c96c9-86f4-4adb-a023-87f0addcd98a service placement] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:38.147180 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c96c9-86f4-4adb-a023-87f0addcd98a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:38.149348 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-f61c96c9-86f4-4adb-a023-87f0addcd98a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:38.181553 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c96c9-86f4-4adb-a023-87f0addcd98a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:38.184917 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c96c9-86f4-4adb-a023-87f0addcd98a service placement] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:38.213726 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1220/2445] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:36:37 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:36:39.987967 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59f723-1888-4ece-af17-dbdf0d2a51ef service swift] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:40.051567 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59f723-1888-4ece-af17-dbdf0d2a51ef service swift] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:40.053042 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e9c7a-dca8-42c5-9f84-bc5a84d738ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:40.053949 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e9c7a-dca8-42c5-9f84-bc5a84d738ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:40.054233 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e9c7a-dca8-42c5-9f84-bc5a84d738ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:40.054547 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e9c7a-dca8-42c5-9f84-bc5a84d738ef admin admin] PATH_INFO: `/v3/users/65cfe9b99f7a4b7f93d15cd1116e6c32` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:40.055788 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e9c7a-dca8-42c5-9f84-bc5a84d738ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=65cfe9b99f7a4b7f93d15cd1116e6c32)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:40.057740 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e9c7a-dca8-42c5-9f84-bc5a84d738ef admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:40.212246 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-7b6e9c7a-dca8-42c5-9f84-bc5a84d738ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65cfe9b99f7a4b7f93d15cd1116e6c32'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:40.213004 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-7b6e9c7a-dca8-42c5-9f84-bc5a84d738ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65cfe9b99f7a4b7f93d15cd1116e6c32'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:40.267664 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-7b6e9c7a-dca8-42c5-9f84-bc5a84d738ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65cfe9b99f7a4b7f93d15cd1116e6c32'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:40.268338 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-7b6e9c7a-dca8-42c5-9f84-bc5a84d738ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65cfe9b99f7a4b7f93d15cd1116e6c32'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:40.280120 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-7b6e9c7a-dca8-42c5-9f84-bc5a84d738ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65cfe9b99f7a4b7f93d15cd1116e6c32'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:40.292415 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1226/2446] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:36:39 2021] DELETE /identity/v3/users/65cfe9b99f7a4b7f93d15cd1116e6c32 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:36:40.296849 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5f2c7-0ec8-4d08-a973-1e6343a15243 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:40.297320 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5f2c7-0ec8-4d08-a973-1e6343a15243 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:40.297438 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5f2c7-0ec8-4d08-a973-1e6343a15243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:40.314662 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-09d5f2c7-0ec8-4d08-a973-1e6343a15243 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:40.315868 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-09d5f2c7-0ec8-4d08-a973-1e6343a15243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:40.372890 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1221/2447] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:36:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:36:40.383215 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e9c7a-dca8-42c5-9f84-bc5a84d738ef admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:40.384597 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-7b6e9c7a-dca8-42c5-9f84-bc5a84d738ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:40.442392 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e9c7a-dca8-42c5-9f84-bc5a84d738ef admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:40.450069 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727656d-0a68-4652-b255-08809e5226c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:40.451022 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727656d-0a68-4652-b255-08809e5226c8 service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:40.451322 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727656d-0a68-4652-b255-08809e5226c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:40.451652 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727656d-0a68-4652-b255-08809e5226c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:40.461589 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727656d-0a68-4652-b255-08809e5226c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:40.463017 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727656d-0a68-4652-b255-08809e5226c8 service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:40.473727 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1227/2448] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:36:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:36:41.216139 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5f2c7-0ec8-4d08-a973-1e6343a15243 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:41.217833 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-09d5f2c7-0ec8-4d08-a973-1e6343a15243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:41.231156 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5f2c7-0ec8-4d08-a973-1e6343a15243 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:41.237772 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b40384-ed1a-4ddc-9349-e8443c2ec34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:41.238746 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b40384-ed1a-4ddc-9349-e8443c2ec34e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:41.239132 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b40384-ed1a-4ddc-9349-e8443c2ec34e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:41.239508 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b40384-ed1a-4ddc-9349-e8443c2ec34e admin admin] PATH_INFO: `/v3/projects/6f2dc20a04f84a6bb4543b3d69cf0abc` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:41.240840 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b40384-ed1a-4ddc-9349-e8443c2ec34e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f2dc20a04f84a6bb4543b3d69cf0abc)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:41.242855 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b40384-ed1a-4ddc-9349-e8443c2ec34e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:41.350485 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-91b40384-ed1a-4ddc-9349-e8443c2ec34e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f2dc20a04f84a6bb4543b3d69cf0abc', 'request_id': 'req-91b40384-ed1a-4ddc-9349-e8443c2ec34e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:41.356698 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-91b40384-ed1a-4ddc-9349-e8443c2ec34e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f2dc20a04f84a6bb4543b3d69cf0abc', 'request_id': 'req-91b40384-ed1a-4ddc-9349-e8443c2ec34e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:41.363608 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-91b40384-ed1a-4ddc-9349-e8443c2ec34e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f2dc20a04f84a6bb4543b3d69cf0abc', 'request_id': 'req-91b40384-ed1a-4ddc-9349-e8443c2ec34e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:41.432560 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-91b40384-ed1a-4ddc-9349-e8443c2ec34e admin admin] The token cache is being invalidate because project 6f2dc20a04f84a6bb4543b3d69cf0abc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:36:41.432883 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-91b40384-ed1a-4ddc-9349-e8443c2ec34e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:41.433466 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-91b40384-ed1a-4ddc-9349-e8443c2ec34e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:41.435006 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1222/2449] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:36:41 2021] DELETE /identity/v3/projects/6f2dc20a04f84a6bb4543b3d69cf0abc => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:36:41.439649 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727656d-0a68-4652-b255-08809e5226c8 service neutron] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:41.449480 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727656d-0a68-4652-b255-08809e5226c8 service neutron] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:41.505681 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0d107-4bad-4a35-b4b8-8ae942c389ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:41.506473 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0d107-4bad-4a35-b4b8-8ae942c389ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:41.506754 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0d107-4bad-4a35-b4b8-8ae942c389ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:41.507014 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0d107-4bad-4a35-b4b8-8ae942c389ae admin admin] PATH_INFO: `/v3/users/4bb8e82258f64997af6699ed7a54df27` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:41.508210 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b0d107-4bad-4a35-b4b8-8ae942c389ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bb8e82258f64997af6699ed7a54df27)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:41.510107 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b0d107-4bad-4a35-b4b8-8ae942c389ae admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:41.611367 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b40384-ed1a-4ddc-9349-e8443c2ec34e admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:41.613400 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-91b40384-ed1a-4ddc-9349-e8443c2ec34e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:41.633621 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b40384-ed1a-4ddc-9349-e8443c2ec34e admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:41.658035 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e509b-fc61-4330-bbde-92d4f5437757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:41.659193 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e509b-fc61-4330-bbde-92d4f5437757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:41.659479 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e509b-fc61-4330-bbde-92d4f5437757 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:41.659801 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e509b-fc61-4330-bbde-92d4f5437757 admin admin] PATH_INFO: `/v3/users/e8dfc8e331664933992e8adcd1fd222a` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:41.666880 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e509b-fc61-4330-bbde-92d4f5437757 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8dfc8e331664933992e8adcd1fd222a)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:41.669026 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e509b-fc61-4330-bbde-92d4f5437757 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:41.708920 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-96b0d107-4bad-4a35-b4b8-8ae942c389ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bb8e82258f64997af6699ed7a54df27'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:41.708920 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-96b0d107-4bad-4a35-b4b8-8ae942c389ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bb8e82258f64997af6699ed7a54df27'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:41.804224 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-96b0d107-4bad-4a35-b4b8-8ae942c389ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bb8e82258f64997af6699ed7a54df27'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:41.804856 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-96b0d107-4bad-4a35-b4b8-8ae942c389ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bb8e82258f64997af6699ed7a54df27'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:41.817699 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-96b0d107-4bad-4a35-b4b8-8ae942c389ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bb8e82258f64997af6699ed7a54df27'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:41.833034 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1228/2450] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:36:41 2021] DELETE /identity/v3/users/4bb8e82258f64997af6699ed7a54df27 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:36:41.930830 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-ce4e509b-fc61-4330-bbde-92d4f5437757 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8dfc8e331664933992e8adcd1fd222a'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:41.931482 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-ce4e509b-fc61-4330-bbde-92d4f5437757 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8dfc8e331664933992e8adcd1fd222a'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:41.938409 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-ce4e509b-fc61-4330-bbde-92d4f5437757 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8dfc8e331664933992e8adcd1fd222a'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:41.939124 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-ce4e509b-fc61-4330-bbde-92d4f5437757 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8dfc8e331664933992e8adcd1fd222a'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:41.950329 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-ce4e509b-fc61-4330-bbde-92d4f5437757 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8dfc8e331664933992e8adcd1fd222a'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:42.058177 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1223/2451] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:36:41 2021] DELETE /identity/v3/users/e8dfc8e331664933992e8adcd1fd222a => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:36:42.387106 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0d107-4bad-4a35-b4b8-8ae942c389ae admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:42.388564 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-96b0d107-4bad-4a35-b4b8-8ae942c389ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:42.439617 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e509b-fc61-4330-bbde-92d4f5437757 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:42.441163 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-ce4e509b-fc61-4330-bbde-92d4f5437757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:42.480666 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0d107-4bad-4a35-b4b8-8ae942c389ae admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:42.522053 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e509b-fc61-4330-bbde-92d4f5437757 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:42.529118 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ac80e-9d67-478a-bb08-932d14a16abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:42.538235 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ac80e-9d67-478a-bb08-932d14a16abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:42.538529 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ac80e-9d67-478a-bb08-932d14a16abd admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:42.538814 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ac80e-9d67-478a-bb08-932d14a16abd admin admin] PATH_INFO: `/v3/projects/893242e83e2b490a98fcd7fafca0a833` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:42.540739 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ac80e-9d67-478a-bb08-932d14a16abd admin admin] RBAC: Authorizing `identity:delete_project(project_id=893242e83e2b490a98fcd7fafca0a833)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:42.542108 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ac80e-9d67-478a-bb08-932d14a16abd admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:42.544259 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c92c4f-32f1-41f8-99cf-89fa72955460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:42.545135 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c92c4f-32f1-41f8-99cf-89fa72955460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:42.545444 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c92c4f-32f1-41f8-99cf-89fa72955460 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:42.550621 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c92c4f-32f1-41f8-99cf-89fa72955460 admin admin] PATH_INFO: `/v3/projects/cae52e582b74423fbb911fe613e0abd6` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:42.550621 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c92c4f-32f1-41f8-99cf-89fa72955460 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cae52e582b74423fbb911fe613e0abd6)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:42.550621 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c92c4f-32f1-41f8-99cf-89fa72955460 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:42.693892 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-f8c92c4f-32f1-41f8-99cf-89fa72955460 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cae52e582b74423fbb911fe613e0abd6', 'request_id': 'req-f8c92c4f-32f1-41f8-99cf-89fa72955460'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:42.699444 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-f8c92c4f-32f1-41f8-99cf-89fa72955460 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cae52e582b74423fbb911fe613e0abd6', 'request_id': 'req-f8c92c4f-32f1-41f8-99cf-89fa72955460'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:42.708331 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-e10ac80e-9d67-478a-bb08-932d14a16abd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '893242e83e2b490a98fcd7fafca0a833', 'request_id': 'req-e10ac80e-9d67-478a-bb08-932d14a16abd'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:42.708556 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-f8c92c4f-32f1-41f8-99cf-89fa72955460 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cae52e582b74423fbb911fe613e0abd6', 'request_id': 'req-f8c92c4f-32f1-41f8-99cf-89fa72955460'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:42.718160 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-e10ac80e-9d67-478a-bb08-932d14a16abd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '893242e83e2b490a98fcd7fafca0a833', 'request_id': 'req-e10ac80e-9d67-478a-bb08-932d14a16abd'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:42.725880 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-e10ac80e-9d67-478a-bb08-932d14a16abd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '893242e83e2b490a98fcd7fafca0a833', 'request_id': 'req-e10ac80e-9d67-478a-bb08-932d14a16abd'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:42.810113 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-f8c92c4f-32f1-41f8-99cf-89fa72955460 admin admin] The token cache is being invalidate because project cae52e582b74423fbb911fe613e0abd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:36:42.810411 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-f8c92c4f-32f1-41f8-99cf-89fa72955460 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:42.811054 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-f8c92c4f-32f1-41f8-99cf-89fa72955460 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:42.812584 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1229/2452] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:36:42 2021] DELETE /identity/v3/projects/cae52e582b74423fbb911fe613e0abd6 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:36:42.818477 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7c500-c08e-454e-9082-28e38e3246f2 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:42.818840 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7c500-c08e-454e-9082-28e38e3246f2 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:42.819295 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7c500-c08e-454e-9082-28e38e3246f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:42.838830 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-18f7c500-c08e-454e-9082-28e38e3246f2 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:42.840029 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-18f7c500-c08e-454e-9082-28e38e3246f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:42.867514 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-e10ac80e-9d67-478a-bb08-932d14a16abd admin admin] The token cache is being invalidate because project 893242e83e2b490a98fcd7fafca0a833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:36:42.868063 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-e10ac80e-9d67-478a-bb08-932d14a16abd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:42.869463 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-e10ac80e-9d67-478a-bb08-932d14a16abd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:42.872124 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1224/2453] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:36:42 2021] DELETE /identity/v3/projects/893242e83e2b490a98fcd7fafca0a833 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:36:42.878491 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3883fed-12cd-442b-8dea-b6b7ef2a8acb None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:42.879069 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3883fed-12cd-442b-8dea-b6b7ef2a8acb None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:42.879425 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3883fed-12cd-442b-8dea-b6b7ef2a8acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:42.898512 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-f3883fed-12cd-442b-8dea-b6b7ef2a8acb None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:42.899634 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-f3883fed-12cd-442b-8dea-b6b7ef2a8acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:42.908574 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1225/2454] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:36:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:36:42.921091 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1230/2455] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:36:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:36:42.921091 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd8f5e-9f41-41e9-80ab-7abd258dde8d None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:42.921091 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd8f5e-9f41-41e9-80ab-7abd258dde8d None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:42.921091 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd8f5e-9f41-41e9-80ab-7abd258dde8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:42.924484 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829061cb-2bb1-47f1-a727-8ab9e07e0b69 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:42.924953 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829061cb-2bb1-47f1-a727-8ab9e07e0b69 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:42.925228 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829061cb-2bb1-47f1-a727-8ab9e07e0b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:42.944016 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-829061cb-2bb1-47f1-a727-8ab9e07e0b69 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:42.945158 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-829061cb-2bb1-47f1-a727-8ab9e07e0b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:42.945647 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-70bd8f5e-9f41-41e9-80ab-7abd258dde8d None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:42.947620 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-70bd8f5e-9f41-41e9-80ab-7abd258dde8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:42.957398 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1231/2456] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:36:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:36:42.958367 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd8f5e-9f41-41e9-80ab-7abd258dde8d None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:42.961101 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1226/2457] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:36:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:36:42.962129 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829061cb-2bb1-47f1-a727-8ab9e07e0b69 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:42.969171 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd8f5e-9f41-41e9-80ab-7abd258dde8d None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:42.975655 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef44f0-3797-4c9c-82f5-9a8e9cc5f66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:42.976474 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef44f0-3797-4c9c-82f5-9a8e9cc5f66c admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:42.976763 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef44f0-3797-4c9c-82f5-9a8e9cc5f66c admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:42.977044 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef44f0-3797-4c9c-82f5-9a8e9cc5f66c admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:42.977824 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef44f0-3797-4c9c-82f5-9a8e9cc5f66c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:36:42.978137 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef44f0-3797-4c9c-82f5-9a8e9cc5f66c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:42.978426 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829061cb-2bb1-47f1-a727-8ab9e07e0b69 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:42.979818 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef44f0-3797-4c9c-82f5-9a8e9cc5f66c admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:42.984918 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4409f-6228-4ebd-9078-81204d7a9801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:42.986579 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4409f-6228-4ebd-9078-81204d7a9801 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:42.986933 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4409f-6228-4ebd-9078-81204d7a9801 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:42.987212 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4409f-6228-4ebd-9078-81204d7a9801 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:42.987975 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c4409f-6228-4ebd-9078-81204d7a9801 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:36:42.988662 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c4409f-6228-4ebd-9078-81204d7a9801 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:42.989881 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c4409f-6228-4ebd-9078-81204d7a9801 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:42.993679 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1232/2458] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:36:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:36:42.998159 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef44f0-3797-4c9c-82f5-9a8e9cc5f66c admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:43.006619 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1227/2459] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:36:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:36:43.007788 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4409f-6228-4ebd-9078-81204d7a9801 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:43.009136 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef44f0-3797-4c9c-82f5-9a8e9cc5f66c admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:43.014269 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e11494-27ee-48e5-a3eb-aca5aa062e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:43.018459 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e11494-27ee-48e5-a3eb-aca5aa062e93 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:43.018459 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e11494-27ee-48e5-a3eb-aca5aa062e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:43.018459 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e11494-27ee-48e5-a3eb-aca5aa062e93 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:43.018459 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e11494-27ee-48e5-a3eb-aca5aa062e93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:43.018459 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e11494-27ee-48e5-a3eb-aca5aa062e93 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:43.018878 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4409f-6228-4ebd-9078-81204d7a9801 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:43.023523 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6360d1-bd74-4916-8e10-4e3619a2abfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:43.024163 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6360d1-bd74-4916-8e10-4e3619a2abfc admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:43.024442 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6360d1-bd74-4916-8e10-4e3619a2abfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:43.024716 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6360d1-bd74-4916-8e10-4e3619a2abfc admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:43.025425 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6360d1-bd74-4916-8e10-4e3619a2abfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:43.027347 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6360d1-bd74-4916-8e10-4e3619a2abfc admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:43.093483 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1233/2460] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:36:42 2021] POST /identity/v3/projects => generated 367 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:36:43.095961 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e11494-27ee-48e5-a3eb-aca5aa062e93 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:43.152529 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1228/2461] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:36:43 2021] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:36:43.153526 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6360d1-bd74-4916-8e10-4e3619a2abfc admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:43.156650 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e11494-27ee-48e5-a3eb-aca5aa062e93 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:43.213215 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e12c03-e15d-4525-ba4b-44b025ff7db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:43.213946 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e12c03-e15d-4525-ba4b-44b025ff7db9 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:43.214229 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e12c03-e15d-4525-ba4b-44b025ff7db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:43.214502 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e12c03-e15d-4525-ba4b-44b025ff7db9 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:43.214882 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6360d1-bd74-4916-8e10-4e3619a2abfc admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:43.215329 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e12c03-e15d-4525-ba4b-44b025ff7db9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:43.217251 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e12c03-e15d-4525-ba4b-44b025ff7db9 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:43.219572 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f83e3a-5993-436c-a7d0-6fbbd42c8ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:43.220756 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f83e3a-5993-436c-a7d0-6fbbd42c8ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:43.221127 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f83e3a-5993-436c-a7d0-6fbbd42c8ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:43.221457 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f83e3a-5993-436c-a7d0-6fbbd42c8ba2 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:43.222157 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f83e3a-5993-436c-a7d0-6fbbd42c8ba2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:43.224086 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f83e3a-5993-436c-a7d0-6fbbd42c8ba2 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:43.307094 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1234/2462] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:36:43 2021] POST /identity/v3/users => generated 284 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:36:43.307373 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1229/2463] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:36:43 2021] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:36:43.311011 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f83e3a-5993-436c-a7d0-6fbbd42c8ba2 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:43.313971 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e12c03-e15d-4525-ba4b-44b025ff7db9 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:43.321049 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f83e3a-5993-436c-a7d0-6fbbd42c8ba2 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:43.323868 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e12c03-e15d-4525-ba4b-44b025ff7db9 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:43.326253 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b317639-65fc-4cef-ba7a-8fc235645f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:43.326897 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b317639-65fc-4cef-ba7a-8fc235645f2d admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:43.327177 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b317639-65fc-4cef-ba7a-8fc235645f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:43.327446 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b317639-65fc-4cef-ba7a-8fc235645f2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:43.328178 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b317639-65fc-4cef-ba7a-8fc235645f2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:43.330418 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b317639-65fc-4cef-ba7a-8fc235645f2d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:43.335237 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84a13a-1a4f-4619-887c-ff0486c5e12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:43.335237 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84a13a-1a4f-4619-887c-ff0486c5e12f admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:43.335237 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84a13a-1a4f-4619-887c-ff0486c5e12f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:43.335237 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84a13a-1a4f-4619-887c-ff0486c5e12f admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:43.335697 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84a13a-1a4f-4619-887c-ff0486c5e12f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:43.335697 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84a13a-1a4f-4619-887c-ff0486c5e12f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:43.341358 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1230/2464] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:36:43 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:36:43.346931 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b317639-65fc-4cef-ba7a-8fc235645f2d admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:43.350527 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1235/2465] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:36:43 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:36:43.351437 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84a13a-1a4f-4619-887c-ff0486c5e12f admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:43.359067 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b317639-65fc-4cef-ba7a-8fc235645f2d admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:43.363900 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84a13a-1a4f-4619-887c-ff0486c5e12f admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:43.365478 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3454a0-a3e4-49f0-9ab1-5585eb064c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:43.366169 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3454a0-a3e4-49f0-9ab1-5585eb064c54 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:43.366300 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fcb50-4b51-4350-a03a-dafb0274c429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:43.366516 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3454a0-a3e4-49f0-9ab1-5585eb064c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:43.366863 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fcb50-4b51-4350-a03a-dafb0274c429 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:43.367150 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fcb50-4b51-4350-a03a-dafb0274c429 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:43.367258 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3454a0-a3e4-49f0-9ab1-5585eb064c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:43.367432 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fcb50-4b51-4350-a03a-dafb0274c429 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:43.368007 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3454a0-a3e4-49f0-9ab1-5585eb064c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:43.368169 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4fcb50-4b51-4350-a03a-dafb0274c429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:43.369668 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3454a0-a3e4-49f0-9ab1-5585eb064c54 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:43.369818 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4fcb50-4b51-4350-a03a-dafb0274c429 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:43.386934 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1236/2466] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:36:43 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:36:43.387174 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1231/2467] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:36:43 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:36:43.387926 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3454a0-a3e4-49f0-9ab1-5585eb064c54 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:43.388421 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fcb50-4b51-4350-a03a-dafb0274c429 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:43.400306 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3454a0-a3e4-49f0-9ab1-5585eb064c54 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:43.409990 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fcb50-4b51-4350-a03a-dafb0274c429 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:43.414933 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad7f18-a084-460c-912c-fbb776a4470b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:43.415831 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad7f18-a084-460c-912c-fbb776a4470b admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:43.416103 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad7f18-a084-460c-912c-fbb776a4470b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:43.416368 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad7f18-a084-460c-912c-fbb776a4470b admin admin] PATH_INFO: `/v3/projects/1634fa93f89c45b594dc79dd6c08734b/users/962fbcf33a0241d69015a54a4f17b54f/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:43.417271 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474df1af-0a04-4d40-ad4a-2b2f5b53e0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:43.418227 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474df1af-0a04-4d40-ad4a-2b2f5b53e0f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:43.418516 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474df1af-0a04-4d40-ad4a-2b2f5b53e0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:43.418795 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474df1af-0a04-4d40-ad4a-2b2f5b53e0f7 admin admin] PATH_INFO: `/v3/projects/c52c093db38c40a383ef38ffbc4083a5/users/7f3f6733a4bd43fd98958792d1afd15a/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:43.434766 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad7f18-a084-460c-912c-fbb776a4470b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1634fa93f89c45b594dc79dd6c08734b, user_id=962fbcf33a0241d69015a54a4f17b54f, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:43.435384 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474df1af-0a04-4d40-ad4a-2b2f5b53e0f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c52c093db38c40a383ef38ffbc4083a5, user_id=7f3f6733a4bd43fd98958792d1afd15a, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:43.437930 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad7f18-a084-460c-912c-fbb776a4470b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:43.438076 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474df1af-0a04-4d40-ad4a-2b2f5b53e0f7 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:43.548421 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1232/2468] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:36:43 2021] PUT /identity/v3/projects/c52c093db38c40a383ef38ffbc4083a5/users/7f3f6733a4bd43fd98958792d1afd15a/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:36:43.558352 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e098c-8150-4c8c-bfed-91d04409bf08 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:43.558642 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e098c-8150-4c8c-bfed-91d04409bf08 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:43.558955 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e098c-8150-4c8c-bfed-91d04409bf08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:43.570723 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1237/2469] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:36:43 2021] PUT /identity/v3/projects/1634fa93f89c45b594dc79dd6c08734b/users/962fbcf33a0241d69015a54a4f17b54f/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:36:43.581467 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690df27-9af1-4591-8615-666f182d00cc None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:43.581895 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690df27-9af1-4591-8615-666f182d00cc None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:43.582361 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690df27-9af1-4591-8615-666f182d00cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:43.595803 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-d62e098c-8150-4c8c-bfed-91d04409bf08 None None] MFA Rules not processed for user `7f3f6733a4bd43fd98958792d1afd15a`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:43.597116 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-d62e098c-8150-4c8c-bfed-91d04409bf08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:43.613277 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-e690df27-9af1-4591-8615-666f182d00cc None None] MFA Rules not processed for user `962fbcf33a0241d69015a54a4f17b54f`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:43.614599 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-e690df27-9af1-4591-8615-666f182d00cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:43.665650 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1233/2470] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:36:43 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:36:43.675535 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e098c-8150-4c8c-bfed-91d04409bf08 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:43.676884 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-d62e098c-8150-4c8c-bfed-91d04409bf08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:43.682308 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1238/2471] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:36:43 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:36:43.686673 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690df27-9af1-4591-8615-666f182d00cc None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:43.750310 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690df27-9af1-4591-8615-666f182d00cc None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:43.756878 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e098c-8150-4c8c-bfed-91d04409bf08 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:43.762596 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4e645-11dd-4c6a-9339-23cf29141c41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:43.763255 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4e645-11dd-4c6a-9339-23cf29141c41 service cinder] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:43.763530 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4e645-11dd-4c6a-9339-23cf29141c41 service cinder] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:43.763860 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4e645-11dd-4c6a-9339-23cf29141c41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:43.767617 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599de96b-4d25-4b35-bd99-7e51e8b9d5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:43.768533 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599de96b-4d25-4b35-bd99-7e51e8b9d5b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:43.774009 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599de96b-4d25-4b35-bd99-7e51e8b9d5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:43.774009 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599de96b-4d25-4b35-bd99-7e51e8b9d5b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:43.774009 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599de96b-4d25-4b35-bd99-7e51e8b9d5b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:43.774009 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599de96b-4d25-4b35-bd99-7e51e8b9d5b9 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:43.776721 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d4e645-11dd-4c6a-9339-23cf29141c41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:43.778205 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d4e645-11dd-4c6a-9339-23cf29141c41 service cinder] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:43.789644 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1234/2472] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:36:43 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:36:43.885710 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1239/2473] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:36:43 2021] POST /identity/v3/projects => generated 367 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:36:43.886407 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4e645-11dd-4c6a-9339-23cf29141c41 service cinder] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:43.905654 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4e645-11dd-4c6a-9339-23cf29141c41 service cinder] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:43.963827 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b279e2b8-0da4-4db8-b6b8-3cc8926e3cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:43.964495 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279e2b8-0da4-4db8-b6b8-3cc8926e3cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:43.964774 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279e2b8-0da4-4db8-b6b8-3cc8926e3cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:43.965049 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279e2b8-0da4-4db8-b6b8-3cc8926e3cb2 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:43.965779 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b279e2b8-0da4-4db8-b6b8-3cc8926e3cb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:43.967662 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b279e2b8-0da4-4db8-b6b8-3cc8926e3cb2 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:44.073716 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1235/2474] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:36:43 2021] POST /identity/v3/users => generated 290 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:36:44.078014 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599de96b-4d25-4b35-bd99-7e51e8b9d5b9 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:44.089474 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599de96b-4d25-4b35-bd99-7e51e8b9d5b9 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:44.094267 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbc948-66ed-4f5e-a21b-ebc3f7f17f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:44.096740 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbc948-66ed-4f5e-a21b-ebc3f7f17f9c admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:44.096740 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbc948-66ed-4f5e-a21b-ebc3f7f17f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:44.096740 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbc948-66ed-4f5e-a21b-ebc3f7f17f9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:44.097083 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbc948-66ed-4f5e-a21b-ebc3f7f17f9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:44.098726 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbc948-66ed-4f5e-a21b-ebc3f7f17f9c admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:44.111324 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1240/2475] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:36:44 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:36:44.115748 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b279e2b8-0da4-4db8-b6b8-3cc8926e3cb2 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:44.126449 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b279e2b8-0da4-4db8-b6b8-3cc8926e3cb2 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:44.131609 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2ee12-08bf-4796-9046-cf85d284b5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:44.132574 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2ee12-08bf-4796-9046-cf85d284b5ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:44.137050 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2ee12-08bf-4796-9046-cf85d284b5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:44.137050 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2ee12-08bf-4796-9046-cf85d284b5ee admin admin] PATH_INFO: `/v3/projects/0548732c41f54e88b694f6fd9074ba3c/users/5f32e6feb55b49e196adf60e59edeb9e/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:44.150973 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2ee12-08bf-4796-9046-cf85d284b5ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=0548732c41f54e88b694f6fd9074ba3c, user_id=5f32e6feb55b49e196adf60e59edeb9e, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:44.153729 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2ee12-08bf-4796-9046-cf85d284b5ee admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:44.211926 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1236/2476] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:36:44 2021] PUT /identity/v3/projects/0548732c41f54e88b694f6fd9074ba3c/users/5f32e6feb55b49e196adf60e59edeb9e/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:36:44.216059 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbc948-66ed-4f5e-a21b-ebc3f7f17f9c admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:44.227640 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbc948-66ed-4f5e-a21b-ebc3f7f17f9c admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:44.282280 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ee021-7fab-4fcd-932c-19b63076d407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:44.282980 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ee021-7fab-4fcd-932c-19b63076d407 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:44.283275 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ee021-7fab-4fcd-932c-19b63076d407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:44.283550 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ee021-7fab-4fcd-932c-19b63076d407 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:44.284282 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ee021-7fab-4fcd-932c-19b63076d407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:44.285873 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ee021-7fab-4fcd-932c-19b63076d407 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:44.295765 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1241/2477] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:36:44 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:36:44.300724 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2ee12-08bf-4796-9046-cf85d284b5ee admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:44.311186 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2ee12-08bf-4796-9046-cf85d284b5ee admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:44.316828 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8a44e-5daf-42c2-80c1-72f090ab3cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:44.317733 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8a44e-5daf-42c2-80c1-72f090ab3cc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:44.318016 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8a44e-5daf-42c2-80c1-72f090ab3cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:44.318292 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8a44e-5daf-42c2-80c1-72f090ab3cc0 admin admin] PATH_INFO: `/v3/projects/0548732c41f54e88b694f6fd9074ba3c/users/5f32e6feb55b49e196adf60e59edeb9e/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:44.320276 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8a44e-5daf-42c2-80c1-72f090ab3cc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0548732c41f54e88b694f6fd9074ba3c, user_id=5f32e6feb55b49e196adf60e59edeb9e, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:44.322979 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8a44e-5daf-42c2-80c1-72f090ab3cc0 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:44.333457 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1237/2478] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:36:44 2021] PUT /identity/v3/projects/0548732c41f54e88b694f6fd9074ba3c/users/5f32e6feb55b49e196adf60e59edeb9e/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:36:44.347340 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d97220-95ac-4428-ad89-ac6dd1609dfa None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:44.347705 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d97220-95ac-4428-ad89-ac6dd1609dfa None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:44.348129 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d97220-95ac-4428-ad89-ac6dd1609dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:44.375552 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-97d97220-95ac-4428-ad89-ac6dd1609dfa None None] MFA Rules not processed for user `5f32e6feb55b49e196adf60e59edeb9e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:44.377382 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-97d97220-95ac-4428-ad89-ac6dd1609dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:44.446084 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1242/2479] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:36:44 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:36:44.456399 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8a44e-5daf-42c2-80c1-72f090ab3cc0 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:44.509270 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8a44e-5daf-42c2-80c1-72f090ab3cc0 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:44.512847 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d01c4e-305f-484c-9736-f9359a9ca8b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:44.513509 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d01c4e-305f-484c-9736-f9359a9ca8b7 service cinder] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:44.513794 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d01c4e-305f-484c-9736-f9359a9ca8b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:44.514070 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d01c4e-305f-484c-9736-f9359a9ca8b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:44.523711 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d01c4e-305f-484c-9736-f9359a9ca8b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:44.525155 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d01c4e-305f-484c-9736-f9359a9ca8b7 service cinder] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:44.535482 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1238/2480] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:36:44 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:36:45.476031 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234ecae-3343-4d28-b83f-16e83c10eeef None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:45.476031 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234ecae-3343-4d28-b83f-16e83c10eeef None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:45.476031 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234ecae-3343-4d28-b83f-16e83c10eeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:45.477899 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-e234ecae-3343-4d28-b83f-16e83c10eeef None None] MFA Rules not processed for user `7f3f6733a4bd43fd98958792d1afd15a`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:45.479244 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-e234ecae-3343-4d28-b83f-16e83c10eeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:45.533162 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1243/2481] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:36:45 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:36:47.270946 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d01c4e-305f-484c-9736-f9359a9ca8b7 service cinder] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:47.333200 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d01c4e-305f-484c-9736-f9359a9ca8b7 service cinder] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:47.338159 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428893b-1de7-4f98-bc48-028bcb82e521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:47.339016 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428893b-1de7-4f98-bc48-028bcb82e521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:47.339296 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428893b-1de7-4f98-bc48-028bcb82e521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:47.339616 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428893b-1de7-4f98-bc48-028bcb82e521 admin admin] PATH_INFO: `/v3/users/962fbcf33a0241d69015a54a4f17b54f` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:47.340917 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428893b-1de7-4f98-bc48-028bcb82e521 admin admin] RBAC: Authorizing `identity:delete_user(user_id=962fbcf33a0241d69015a54a4f17b54f)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:47.342903 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428893b-1de7-4f98-bc48-028bcb82e521 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:47.485279 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-8428893b-1de7-4f98-bc48-028bcb82e521 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '962fbcf33a0241d69015a54a4f17b54f'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:47.486048 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-8428893b-1de7-4f98-bc48-028bcb82e521 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '962fbcf33a0241d69015a54a4f17b54f'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:47.492909 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-8428893b-1de7-4f98-bc48-028bcb82e521 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '962fbcf33a0241d69015a54a4f17b54f'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:47.493670 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-8428893b-1de7-4f98-bc48-028bcb82e521 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '962fbcf33a0241d69015a54a4f17b54f'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:47.506729 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-8428893b-1de7-4f98-bc48-028bcb82e521 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '962fbcf33a0241d69015a54a4f17b54f'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:47.570102 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1239/2482] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:36:47 2021] DELETE /identity/v3/users/962fbcf33a0241d69015a54a4f17b54f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:36:47.574603 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e950d6d-21d0-40d0-9b6d-15b8c00b00fe None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:47.575075 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e950d6d-21d0-40d0-9b6d-15b8c00b00fe None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:47.575432 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e950d6d-21d0-40d0-9b6d-15b8c00b00fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:47.593742 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-1e950d6d-21d0-40d0-9b6d-15b8c00b00fe None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:47.595002 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-1e950d6d-21d0-40d0-9b6d-15b8c00b00fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:47.653733 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1244/2483] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:36:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:36:47.664451 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428893b-1de7-4f98-bc48-028bcb82e521 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:47.665952 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-8428893b-1de7-4f98-bc48-028bcb82e521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:47.725847 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428893b-1de7-4f98-bc48-028bcb82e521 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:47.729627 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bca96-bd78-41db-9e35-2a6be9bba0a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:47.730267 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bca96-bd78-41db-9e35-2a6be9bba0a1 service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:47.732042 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bca96-bd78-41db-9e35-2a6be9bba0a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:47.732042 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bca96-bd78-41db-9e35-2a6be9bba0a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:47.740746 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7bca96-bd78-41db-9e35-2a6be9bba0a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:47.742158 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7bca96-bd78-41db-9e35-2a6be9bba0a1 service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:47.752702 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1240/2484] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:36:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:36:48.149132 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e950d6d-21d0-40d0-9b6d-15b8c00b00fe None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:48.150616 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-1e950d6d-21d0-40d0-9b6d-15b8c00b00fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:48.170655 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e950d6d-21d0-40d0-9b6d-15b8c00b00fe None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:48.184547 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1575c-c2cb-4993-8ed9-273cc2263c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:48.185522 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1575c-c2cb-4993-8ed9-273cc2263c53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:48.185827 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1575c-c2cb-4993-8ed9-273cc2263c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:48.186101 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1575c-c2cb-4993-8ed9-273cc2263c53 admin admin] PATH_INFO: `/v3/projects/1634fa93f89c45b594dc79dd6c08734b` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:48.187299 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1575c-c2cb-4993-8ed9-273cc2263c53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1634fa93f89c45b594dc79dd6c08734b)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:48.189764 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1575c-c2cb-4993-8ed9-273cc2263c53 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:48.268971 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-dcf1575c-c2cb-4993-8ed9-273cc2263c53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1634fa93f89c45b594dc79dd6c08734b', 'request_id': 'req-dcf1575c-c2cb-4993-8ed9-273cc2263c53'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:48.275461 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-dcf1575c-c2cb-4993-8ed9-273cc2263c53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1634fa93f89c45b594dc79dd6c08734b', 'request_id': 'req-dcf1575c-c2cb-4993-8ed9-273cc2263c53'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:48.283441 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-dcf1575c-c2cb-4993-8ed9-273cc2263c53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1634fa93f89c45b594dc79dd6c08734b', 'request_id': 'req-dcf1575c-c2cb-4993-8ed9-273cc2263c53'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:48.365297 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-dcf1575c-c2cb-4993-8ed9-273cc2263c53 admin admin] The token cache is being invalidate because project 1634fa93f89c45b594dc79dd6c08734b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:36:48.365627 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-dcf1575c-c2cb-4993-8ed9-273cc2263c53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:48.366265 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-dcf1575c-c2cb-4993-8ed9-273cc2263c53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:48.368296 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1245/2485] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:36:48 2021] DELETE /identity/v3/projects/1634fa93f89c45b594dc79dd6c08734b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:36:48.371917 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bca96-bd78-41db-9e35-2a6be9bba0a1 service neutron] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:48.382198 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bca96-bd78-41db-9e35-2a6be9bba0a1 service neutron] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:48.436278 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a982e-101b-4971-95a9-6c511248637e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:48.437131 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a982e-101b-4971-95a9-6c511248637e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:48.437431 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a982e-101b-4971-95a9-6c511248637e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:48.437718 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a982e-101b-4971-95a9-6c511248637e admin admin] PATH_INFO: `/v3/users/5f32e6feb55b49e196adf60e59edeb9e` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:48.439495 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a982e-101b-4971-95a9-6c511248637e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f32e6feb55b49e196adf60e59edeb9e)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:48.441394 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a982e-101b-4971-95a9-6c511248637e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:48.667945 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-1e8a982e-101b-4971-95a9-6c511248637e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f32e6feb55b49e196adf60e59edeb9e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:48.668514 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-1e8a982e-101b-4971-95a9-6c511248637e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f32e6feb55b49e196adf60e59edeb9e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:48.676227 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-1e8a982e-101b-4971-95a9-6c511248637e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f32e6feb55b49e196adf60e59edeb9e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:48.676910 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-1e8a982e-101b-4971-95a9-6c511248637e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f32e6feb55b49e196adf60e59edeb9e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:48.688164 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-1e8a982e-101b-4971-95a9-6c511248637e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f32e6feb55b49e196adf60e59edeb9e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:48.776849 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1241/2486] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:36:48 2021] DELETE /identity/v3/users/5f32e6feb55b49e196adf60e59edeb9e => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:36:49.182332 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1575c-c2cb-4993-8ed9-273cc2263c53 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:49.184056 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-dcf1575c-c2cb-4993-8ed9-273cc2263c53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:49.202162 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1575c-c2cb-4993-8ed9-273cc2263c53 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:49.259597 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3e65d-483d-4b8c-b5b5-a99b970da787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:49.260464 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3e65d-483d-4b8c-b5b5-a99b970da787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:49.260775 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3e65d-483d-4b8c-b5b5-a99b970da787 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:49.261047 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3e65d-483d-4b8c-b5b5-a99b970da787 admin admin] PATH_INFO: `/v3/projects/0548732c41f54e88b694f6fd9074ba3c` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:49.262283 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b3e65d-483d-4b8c-b5b5-a99b970da787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0548732c41f54e88b694f6fd9074ba3c)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:49.264150 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b3e65d-483d-4b8c-b5b5-a99b970da787 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:49.404007 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-84b3e65d-483d-4b8c-b5b5-a99b970da787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0548732c41f54e88b694f6fd9074ba3c', 'request_id': 'req-84b3e65d-483d-4b8c-b5b5-a99b970da787'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:49.410652 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-84b3e65d-483d-4b8c-b5b5-a99b970da787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0548732c41f54e88b694f6fd9074ba3c', 'request_id': 'req-84b3e65d-483d-4b8c-b5b5-a99b970da787'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:49.431436 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-84b3e65d-483d-4b8c-b5b5-a99b970da787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0548732c41f54e88b694f6fd9074ba3c', 'request_id': 'req-84b3e65d-483d-4b8c-b5b5-a99b970da787'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:49.517788 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-84b3e65d-483d-4b8c-b5b5-a99b970da787 admin admin] The token cache is being invalidate because project 0548732c41f54e88b694f6fd9074ba3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:36:49.518229 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-84b3e65d-483d-4b8c-b5b5-a99b970da787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:49.518894 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-84b3e65d-483d-4b8c-b5b5-a99b970da787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:49.520497 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1246/2487] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:36:49 2021] DELETE /identity/v3/projects/0548732c41f54e88b694f6fd9074ba3c => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:36:49.526220 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5d130-90a2-4ac9-ac11-2473a6b28f5c None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:49.526701 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5d130-90a2-4ac9-ac11-2473a6b28f5c None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:49.526813 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5d130-90a2-4ac9-ac11-2473a6b28f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:49.545055 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-50b5d130-90a2-4ac9-ac11-2473a6b28f5c None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:49.546462 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-50b5d130-90a2-4ac9-ac11-2473a6b28f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:49.606437 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1242/2488] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:36:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:36:49.621163 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cb45b-0526-469d-87c5-cc0986dab3e2 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:49.621586 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cb45b-0526-469d-87c5-cc0986dab3e2 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:49.621924 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cb45b-0526-469d-87c5-cc0986dab3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:49.645421 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-934cb45b-0526-469d-87c5-cc0986dab3e2 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:49.645421 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-934cb45b-0526-469d-87c5-cc0986dab3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:49.652204 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1247/2489] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:36:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:36:49.656408 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5d130-90a2-4ac9-ac11-2473a6b28f5c None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:49.672289 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5d130-90a2-4ac9-ac11-2473a6b28f5c None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:49.672289 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415f39a-017b-4365-b72e-6760fe47be6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:49.672289 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415f39a-017b-4365-b72e-6760fe47be6b admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:49.672289 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415f39a-017b-4365-b72e-6760fe47be6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:49.673725 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415f39a-017b-4365-b72e-6760fe47be6b admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:49.673999 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415f39a-017b-4365-b72e-6760fe47be6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:36:49.674339 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415f39a-017b-4365-b72e-6760fe47be6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:49.675898 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415f39a-017b-4365-b72e-6760fe47be6b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:49.687817 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1243/2490] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:36:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:36:49.692499 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934cb45b-0526-469d-87c5-cc0986dab3e2 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:49.702085 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934cb45b-0526-469d-87c5-cc0986dab3e2 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:49.706932 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48dede8-f17f-43c0-8dae-d4f035bf38eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:49.707782 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dede8-f17f-43c0-8dae-d4f035bf38eb admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:49.708072 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dede8-f17f-43c0-8dae-d4f035bf38eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:49.708352 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dede8-f17f-43c0-8dae-d4f035bf38eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:49.709052 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48dede8-f17f-43c0-8dae-d4f035bf38eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:49.711055 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48dede8-f17f-43c0-8dae-d4f035bf38eb admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:49.817813 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1248/2491] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:36:49 2021] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:36:49.823403 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415f39a-017b-4365-b72e-6760fe47be6b admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:49.834231 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415f39a-017b-4365-b72e-6760fe47be6b admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:49.896117 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9546d-b1fa-4223-9cd3-5cec499ea70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:49.896790 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9546d-b1fa-4223-9cd3-5cec499ea70b admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:49.897196 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9546d-b1fa-4223-9cd3-5cec499ea70b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:49.897668 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9546d-b1fa-4223-9cd3-5cec499ea70b admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:49.898465 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9546d-b1fa-4223-9cd3-5cec499ea70b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:49.900876 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9546d-b1fa-4223-9cd3-5cec499ea70b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:50.008423 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1244/2492] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:36:49 2021] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:36:50.010845 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48dede8-f17f-43c0-8dae-d4f035bf38eb admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:50.023267 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48dede8-f17f-43c0-8dae-d4f035bf38eb admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:50.028065 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860fb4c-049c-43a2-8095-73618d5b60d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:50.028864 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860fb4c-049c-43a2-8095-73618d5b60d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:50.029330 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860fb4c-049c-43a2-8095-73618d5b60d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:50.029646 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860fb4c-049c-43a2-8095-73618d5b60d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:50.036158 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860fb4c-049c-43a2-8095-73618d5b60d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:50.037835 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860fb4c-049c-43a2-8095-73618d5b60d1 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:50.052978 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1249/2493] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:36:50 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:36:50.054584 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9546d-b1fa-4223-9cd3-5cec499ea70b admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:50.065812 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9546d-b1fa-4223-9cd3-5cec499ea70b admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:50.071483 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f25540-a874-4eef-89e6-d98fc3b75045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:50.072365 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f25540-a874-4eef-89e6-d98fc3b75045 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:50.072669 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f25540-a874-4eef-89e6-d98fc3b75045 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:50.072944 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f25540-a874-4eef-89e6-d98fc3b75045 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:50.073767 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f25540-a874-4eef-89e6-d98fc3b75045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:50.075760 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f25540-a874-4eef-89e6-d98fc3b75045 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:50.086863 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1245/2494] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:36:50 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:36:50.091270 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860fb4c-049c-43a2-8095-73618d5b60d1 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:50.101503 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860fb4c-049c-43a2-8095-73618d5b60d1 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:50.106621 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152f66f-139b-41ba-b1e9-946e3cec6ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:50.107542 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152f66f-139b-41ba-b1e9-946e3cec6ef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:50.107827 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152f66f-139b-41ba-b1e9-946e3cec6ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:50.108107 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c152f66f-139b-41ba-b1e9-946e3cec6ef7 admin admin] PATH_INFO: `/v3/projects/f32661d310034ab6ac396f51ae72a846/users/f65761ac1f4c4aacba5d74a8ac0d431b/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:50.124980 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152f66f-139b-41ba-b1e9-946e3cec6ef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f32661d310034ab6ac396f51ae72a846, user_id=f65761ac1f4c4aacba5d74a8ac0d431b, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:50.128331 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c152f66f-139b-41ba-b1e9-946e3cec6ef7 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:50.205269 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1250/2495] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:36:50 2021] PUT /identity/v3/projects/f32661d310034ab6ac396f51ae72a846/users/f65761ac1f4c4aacba5d74a8ac0d431b/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:36:50.215970 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfc39d-25a7-4883-8567-f0652ff37e78 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:50.216352 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfc39d-25a7-4883-8567-f0652ff37e78 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:50.216634 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfc39d-25a7-4883-8567-f0652ff37e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:50.245361 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-a0bfc39d-25a7-4883-8567-f0652ff37e78 None None] MFA Rules not processed for user `f65761ac1f4c4aacba5d74a8ac0d431b`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:50.246610 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-a0bfc39d-25a7-4883-8567-f0652ff37e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:50.312411 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1246/2496] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:36:50 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:36:50.316645 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152f66f-139b-41ba-b1e9-946e3cec6ef7 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:50.379496 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c152f66f-139b-41ba-b1e9-946e3cec6ef7 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:50.384427 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa4942-a287-43bd-8742-d5021959cdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:50.385085 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa4942-a287-43bd-8742-d5021959cdbd admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:50.385374 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa4942-a287-43bd-8742-d5021959cdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:50.385681 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa4942-a287-43bd-8742-d5021959cdbd admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:50.386400 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa4942-a287-43bd-8742-d5021959cdbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:50.388280 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa4942-a287-43bd-8742-d5021959cdbd admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:50.510617 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1251/2497] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:36:50 2021] POST /identity/v3/projects => generated 379 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:36:50.514250 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfc39d-25a7-4883-8567-f0652ff37e78 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:50.527028 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfc39d-25a7-4883-8567-f0652ff37e78 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:50.593524 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b302e-3b0a-456a-8ce1-6c5452a27fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:50.594782 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b302e-3b0a-456a-8ce1-6c5452a27fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:50.595204 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b302e-3b0a-456a-8ce1-6c5452a27fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:50.596000 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b302e-3b0a-456a-8ce1-6c5452a27fd8 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:50.596943 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b302e-3b0a-456a-8ce1-6c5452a27fd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:50.600034 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b302e-3b0a-456a-8ce1-6c5452a27fd8 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:50.710772 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1247/2498] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:36:50 2021] POST /identity/v3/users => generated 296 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:36:50.712031 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa4942-a287-43bd-8742-d5021959cdbd admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:50.724848 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa4942-a287-43bd-8742-d5021959cdbd admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:50.730842 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e7e2a-1eff-4890-be42-2d1a2525818c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:50.731540 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e7e2a-1eff-4890-be42-2d1a2525818c admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:50.731807 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e7e2a-1eff-4890-be42-2d1a2525818c admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:50.732081 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e7e2a-1eff-4890-be42-2d1a2525818c admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:50.732974 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e7e2a-1eff-4890-be42-2d1a2525818c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:50.734717 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e7e2a-1eff-4890-be42-2d1a2525818c admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:50.750447 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1252/2499] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:36:50 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:36:50.752040 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b302e-3b0a-456a-8ce1-6c5452a27fd8 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:50.775789 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b302e-3b0a-456a-8ce1-6c5452a27fd8 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:50.781681 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70a23d-a486-4a0a-964a-ee66573221e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:50.783589 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70a23d-a486-4a0a-964a-ee66573221e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:50.783977 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70a23d-a486-4a0a-964a-ee66573221e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:50.785442 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70a23d-a486-4a0a-964a-ee66573221e7 admin admin] PATH_INFO: `/v3/projects/66a72591d9e14ca484f656947135606a/users/765c187c0eea4a8cbe00901b007cfec5/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:50.816098 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70a23d-a486-4a0a-964a-ee66573221e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66a72591d9e14ca484f656947135606a, user_id=765c187c0eea4a8cbe00901b007cfec5, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:50.819122 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70a23d-a486-4a0a-964a-ee66573221e7 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:50.925503 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1248/2500] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:36:50 2021] PUT /identity/v3/projects/66a72591d9e14ca484f656947135606a/users/765c187c0eea4a8cbe00901b007cfec5/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:36:50.929212 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e7e2a-1eff-4890-be42-2d1a2525818c admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:50.939523 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e7e2a-1eff-4890-be42-2d1a2525818c admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:51.021535 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209f8bf-eaf9-409a-8203-04e9fffb1f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:51.023367 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209f8bf-eaf9-409a-8203-04e9fffb1f2f admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:51.023869 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209f8bf-eaf9-409a-8203-04e9fffb1f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:51.033640 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209f8bf-eaf9-409a-8203-04e9fffb1f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:51.035285 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c209f8bf-eaf9-409a-8203-04e9fffb1f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:51.042354 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c209f8bf-eaf9-409a-8203-04e9fffb1f2f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:51.051385 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1253/2501] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:36:50 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:36:51.055905 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70a23d-a486-4a0a-964a-ee66573221e7 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:51.080287 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70a23d-a486-4a0a-964a-ee66573221e7 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:51.085215 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc34af-e826-4928-897c-a3cc1cf0c132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:51.086299 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc34af-e826-4928-897c-a3cc1cf0c132 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:51.086584 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc34af-e826-4928-897c-a3cc1cf0c132 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:51.086863 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc34af-e826-4928-897c-a3cc1cf0c132 admin admin] PATH_INFO: `/v3/projects/66a72591d9e14ca484f656947135606a/users/765c187c0eea4a8cbe00901b007cfec5/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:51.092054 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc34af-e826-4928-897c-a3cc1cf0c132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66a72591d9e14ca484f656947135606a, user_id=765c187c0eea4a8cbe00901b007cfec5, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:51.094949 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc34af-e826-4928-897c-a3cc1cf0c132 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:51.114431 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1249/2502] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:36:51 2021] PUT /identity/v3/projects/66a72591d9e14ca484f656947135606a/users/765c187c0eea4a8cbe00901b007cfec5/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:36:51.126506 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1cb28-c949-4cb6-9468-53d5d193ff97 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:51.132202 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1cb28-c949-4cb6-9468-53d5d193ff97 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:51.132202 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1cb28-c949-4cb6-9468-53d5d193ff97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:51.163275 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-75f1cb28-c949-4cb6-9468-53d5d193ff97 None None] MFA Rules not processed for user `765c187c0eea4a8cbe00901b007cfec5`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:51.164113 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-75f1cb28-c949-4cb6-9468-53d5d193ff97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:51.299258 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1254/2503] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:36:51 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:36:51.316788 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc34af-e826-4928-897c-a3cc1cf0c132 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:51.321941 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-01fc34af-e826-4928-897c-a3cc1cf0c132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:51.404212 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc34af-e826-4928-897c-a3cc1cf0c132 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:51.408953 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f58ad-f0d2-4f76-96bf-06781815c455 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:51.409920 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f58ad-f0d2-4f76-96bf-06781815c455 service cinder] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:51.410271 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f58ad-f0d2-4f76-96bf-06781815c455 service cinder] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:51.410616 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f58ad-f0d2-4f76-96bf-06781815c455 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:51.441772 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f58ad-f0d2-4f76-96bf-06781815c455 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:51.444064 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f58ad-f0d2-4f76-96bf-06781815c455 service cinder] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:51.467184 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1250/2504] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:36:51 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:36:52.534159 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1cb28-c949-4cb6-9468-53d5d193ff97 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:52.550394 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1cb28-c949-4cb6-9468-53d5d193ff97 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:52.561301 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454801c-3580-46bd-9818-fe405993c2eb tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765c187c0eea4a8cbe00901b007cfec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66a72591d9e14ca484f656947135606a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:52.561301 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454801c-3580-46bd-9818-fe405993c2eb tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:52.561301 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454801c-3580-46bd-9818-fe405993c2eb tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:52.561564 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454801c-3580-46bd-9818-fe405993c2eb tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:52.561564 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454801c-3580-46bd-9818-fe405993c2eb tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:36:52.561564 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454801c-3580-46bd-9818-fe405993c2eb tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:52.561564 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454801c-3580-46bd-9818-fe405993c2eb tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:52.576231 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1255/2505] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:36:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:36:52.581552 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f58ad-f0d2-4f76-96bf-06781815c455 service cinder] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:52.594796 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f58ad-f0d2-4f76-96bf-06781815c455 service cinder] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:52.600371 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c39707-511f-4f26-9020-4c6362f09d49 tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765c187c0eea4a8cbe00901b007cfec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66a72591d9e14ca484f656947135606a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:52.600996 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c39707-511f-4f26-9020-4c6362f09d49 tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:52.601300 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c39707-511f-4f26-9020-4c6362f09d49 tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:52.601765 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c39707-511f-4f26-9020-4c6362f09d49 tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:52.602525 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c39707-511f-4f26-9020-4c6362f09d49 tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:52.604544 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c39707-511f-4f26-9020-4c6362f09d49 tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:52.711536 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1251/2506] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:36:52 2021] POST /identity/v3/projects => generated 354 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:36:52.713366 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454801c-3580-46bd-9818-fe405993c2eb tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:52.723593 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454801c-3580-46bd-9818-fe405993c2eb tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:52.779006 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad9412-2bbe-4c4e-8391-003ef73ae498 tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765c187c0eea4a8cbe00901b007cfec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66a72591d9e14ca484f656947135606a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:52.779657 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad9412-2bbe-4c4e-8391-003ef73ae498 tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:52.779944 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad9412-2bbe-4c4e-8391-003ef73ae498 tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:52.780246 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad9412-2bbe-4c4e-8391-003ef73ae498 tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:52.780970 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ad9412-2bbe-4c4e-8391-003ef73ae498 tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:36:52.781278 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ad9412-2bbe-4c4e-8391-003ef73ae498 tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:52.783399 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ad9412-2bbe-4c4e-8391-003ef73ae498 tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:52.796323 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1256/2507] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:36:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:36:52.833583 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c39707-511f-4f26-9020-4c6362f09d49 tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:52.843628 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c39707-511f-4f26-9020-4c6362f09d49 tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:52.848374 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560270dd-d405-4529-b8c7-1a0f7271f33e tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '765c187c0eea4a8cbe00901b007cfec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66a72591d9e14ca484f656947135606a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:52.849239 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560270dd-d405-4529-b8c7-1a0f7271f33e tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:52.849563 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560270dd-d405-4529-b8c7-1a0f7271f33e tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:52.849845 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560270dd-d405-4529-b8c7-1a0f7271f33e tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] PATH_INFO: `/v3/projects/07fe1ca9207e4419a9707f6e47329833` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:52.851098 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560270dd-d405-4529-b8c7-1a0f7271f33e tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] RBAC: Authorizing `identity:delete_project(project_id=07fe1ca9207e4419a9707f6e47329833)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:52.852906 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560270dd-d405-4529-b8c7-1a0f7271f33e tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:52.958529 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-560270dd-d405-4529-b8c7-1a0f7271f33e tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07fe1ca9207e4419a9707f6e47329833', 'request_id': 'req-560270dd-d405-4529-b8c7-1a0f7271f33e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:52.964887 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-560270dd-d405-4529-b8c7-1a0f7271f33e tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07fe1ca9207e4419a9707f6e47329833', 'request_id': 'req-560270dd-d405-4529-b8c7-1a0f7271f33e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:52.970327 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-560270dd-d405-4529-b8c7-1a0f7271f33e tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07fe1ca9207e4419a9707f6e47329833', 'request_id': 'req-560270dd-d405-4529-b8c7-1a0f7271f33e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:53.088886 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-560270dd-d405-4529-b8c7-1a0f7271f33e tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] The token cache is being invalidate because project 07fe1ca9207e4419a9707f6e47329833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:36:53.089179 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-560270dd-d405-4529-b8c7-1a0f7271f33e tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:53.089847 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-560270dd-d405-4529-b8c7-1a0f7271f33e tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:53.091410 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1252/2508] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:36:52 2021] DELETE /identity/v3/projects/07fe1ca9207e4419a9707f6e47329833 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:36:53.701774 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad9412-2bbe-4c4e-8391-003ef73ae498 tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:53.704146 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-85ad9412-2bbe-4c4e-8391-003ef73ae498 tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:53.765559 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad9412-2bbe-4c4e-8391-003ef73ae498 tempest-VolumeQuotaClassesTest-179462762 tempest-VolumeQuotaClassesTest-179462762-project-admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:53.819688 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb60b1-fb78-454a-9255-cba75e4c2ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:53.820557 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb60b1-fb78-454a-9255-cba75e4c2ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:53.820840 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb60b1-fb78-454a-9255-cba75e4c2ced admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:53.821116 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb60b1-fb78-454a-9255-cba75e4c2ced admin admin] PATH_INFO: `/v3/users/f65761ac1f4c4aacba5d74a8ac0d431b` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:53.822397 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb60b1-fb78-454a-9255-cba75e4c2ced admin admin] RBAC: Authorizing `identity:delete_user(user_id=f65761ac1f4c4aacba5d74a8ac0d431b)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:53.824225 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb60b1-fb78-454a-9255-cba75e4c2ced admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:54.001704 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-1dfb60b1-fb78-454a-9255-cba75e4c2ced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f65761ac1f4c4aacba5d74a8ac0d431b'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:54.002432 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-1dfb60b1-fb78-454a-9255-cba75e4c2ced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f65761ac1f4c4aacba5d74a8ac0d431b'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:54.071904 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-1dfb60b1-fb78-454a-9255-cba75e4c2ced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f65761ac1f4c4aacba5d74a8ac0d431b'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:54.072580 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-1dfb60b1-fb78-454a-9255-cba75e4c2ced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f65761ac1f4c4aacba5d74a8ac0d431b'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:54.085425 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-1dfb60b1-fb78-454a-9255-cba75e4c2ced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f65761ac1f4c4aacba5d74a8ac0d431b'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:54.097828 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1257/2509] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:36:53 2021] DELETE /identity/v3/users/f65761ac1f4c4aacba5d74a8ac0d431b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:36:54.102569 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127405a-1adb-45a3-afdd-cbf7e97c4546 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:54.103027 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127405a-1adb-45a3-afdd-cbf7e97c4546 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:54.105104 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127405a-1adb-45a3-afdd-cbf7e97c4546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:54.119538 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-a127405a-1adb-45a3-afdd-cbf7e97c4546 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:54.120714 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-a127405a-1adb-45a3-afdd-cbf7e97c4546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:54.179771 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1253/2510] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:36:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:36:54.190473 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb60b1-fb78-454a-9255-cba75e4c2ced admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:54.191889 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-1dfb60b1-fb78-454a-9255-cba75e4c2ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:54.249312 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb60b1-fb78-454a-9255-cba75e4c2ced admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:54.253781 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e643ac-e460-4d86-98c0-ff2a618ef1b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:54.254540 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e643ac-e460-4d86-98c0-ff2a618ef1b8 service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:54.254702 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e643ac-e460-4d86-98c0-ff2a618ef1b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:54.254981 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e643ac-e460-4d86-98c0-ff2a618ef1b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:54.264537 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e643ac-e460-4d86-98c0-ff2a618ef1b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:54.266851 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e643ac-e460-4d86-98c0-ff2a618ef1b8 service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:54.277192 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1258/2511] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:36:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:36:54.754596 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127405a-1adb-45a3-afdd-cbf7e97c4546 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:54.756264 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-a127405a-1adb-45a3-afdd-cbf7e97c4546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:54.770077 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127405a-1adb-45a3-afdd-cbf7e97c4546 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:54.774875 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2a454-3e9b-46e6-be16-692d0165ab76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:54.775736 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2a454-3e9b-46e6-be16-692d0165ab76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:54.776024 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2a454-3e9b-46e6-be16-692d0165ab76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:54.776830 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2a454-3e9b-46e6-be16-692d0165ab76 admin admin] PATH_INFO: `/v3/projects/f32661d310034ab6ac396f51ae72a846` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:54.778527 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2a454-3e9b-46e6-be16-692d0165ab76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f32661d310034ab6ac396f51ae72a846)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:54.780401 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2a454-3e9b-46e6-be16-692d0165ab76 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:54.884055 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-e2a2a454-3e9b-46e6-be16-692d0165ab76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f32661d310034ab6ac396f51ae72a846', 'request_id': 'req-e2a2a454-3e9b-46e6-be16-692d0165ab76'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:54.890366 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-e2a2a454-3e9b-46e6-be16-692d0165ab76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f32661d310034ab6ac396f51ae72a846', 'request_id': 'req-e2a2a454-3e9b-46e6-be16-692d0165ab76'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:54.895888 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-e2a2a454-3e9b-46e6-be16-692d0165ab76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f32661d310034ab6ac396f51ae72a846', 'request_id': 'req-e2a2a454-3e9b-46e6-be16-692d0165ab76'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:54.957454 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-e2a2a454-3e9b-46e6-be16-692d0165ab76 admin admin] The token cache is being invalidate because project f32661d310034ab6ac396f51ae72a846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:36:54.957869 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-e2a2a454-3e9b-46e6-be16-692d0165ab76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:54.958628 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-e2a2a454-3e9b-46e6-be16-692d0165ab76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:54.960220 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1254/2512] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:36:54 2021] DELETE /identity/v3/projects/f32661d310034ab6ac396f51ae72a846 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:36:54.964098 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e643ac-e460-4d86-98c0-ff2a618ef1b8 service neutron] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:54.974813 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e643ac-e460-4d86-98c0-ff2a618ef1b8 service neutron] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:55.030259 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361ac62-eb1a-4f58-bd8f-b7f276c4747f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:55.031212 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361ac62-eb1a-4f58-bd8f-b7f276c4747f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:55.032037 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361ac62-eb1a-4f58-bd8f-b7f276c4747f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:55.032873 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361ac62-eb1a-4f58-bd8f-b7f276c4747f admin admin] PATH_INFO: `/v3/users/765c187c0eea4a8cbe00901b007cfec5` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:55.034248 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361ac62-eb1a-4f58-bd8f-b7f276c4747f admin admin] RBAC: Authorizing `identity:delete_user(user_id=765c187c0eea4a8cbe00901b007cfec5)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:55.036362 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361ac62-eb1a-4f58-bd8f-b7f276c4747f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:55.196684 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-1361ac62-eb1a-4f58-bd8f-b7f276c4747f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '765c187c0eea4a8cbe00901b007cfec5'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:55.197630 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-1361ac62-eb1a-4f58-bd8f-b7f276c4747f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '765c187c0eea4a8cbe00901b007cfec5'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:55.284245 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-1361ac62-eb1a-4f58-bd8f-b7f276c4747f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '765c187c0eea4a8cbe00901b007cfec5'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:55.284943 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-1361ac62-eb1a-4f58-bd8f-b7f276c4747f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '765c187c0eea4a8cbe00901b007cfec5'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:55.297736 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-1361ac62-eb1a-4f58-bd8f-b7f276c4747f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '765c187c0eea4a8cbe00901b007cfec5'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:55.311036 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1259/2513] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:36:54 2021] DELETE /identity/v3/users/765c187c0eea4a8cbe00901b007cfec5 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:36:55.332819 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406c6b8-5fa9-4ccf-952b-afadf9a69461 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:55.333330 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406c6b8-5fa9-4ccf-952b-afadf9a69461 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:55.333453 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406c6b8-5fa9-4ccf-952b-afadf9a69461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:55.352379 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-e406c6b8-5fa9-4ccf-952b-afadf9a69461 None None] MFA Rules not processed for user `1c9eae7258ce43f0b7838a82396121d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:55.353645 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-e406c6b8-5fa9-4ccf-952b-afadf9a69461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:55.428727 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1255/2514] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:36:55 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:36:55.857923 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c7829-da59-4c79-b746-0a29ce8bf926 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:55.858423 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c7829-da59-4c79-b746-0a29ce8bf926 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:55.858701 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c7829-da59-4c79-b746-0a29ce8bf926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:55.916096 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-206c7829-da59-4c79-b746-0a29ce8bf926 None None] MFA Rules not processed for user `abc393885c6c4cf6bd4dd52f698fc38c`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:55.917385 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-206c7829-da59-4c79-b746-0a29ce8bf926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:55.932408 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406c6b8-5fa9-4ccf-952b-afadf9a69461 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:55.933902 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-e406c6b8-5fa9-4ccf-952b-afadf9a69461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:55.999470 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1260/2515] 10.222.0.62 () {58 vars in 967 bytes} [Tue Nov 23 19:36:55 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:36:56.025512 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406c6b8-5fa9-4ccf-952b-afadf9a69461 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:56.029188 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c7829-da59-4c79-b746-0a29ce8bf926 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:56.030666 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b7d6c-2594-49b2-9f3c-5ca7ae028b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:56.030945 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-206c7829-da59-4c79-b746-0a29ce8bf926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:56.031779 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b7d6c-2594-49b2-9f3c-5ca7ae028b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:56.032078 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b7d6c-2594-49b2-9f3c-5ca7ae028b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:56.032487 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b7d6c-2594-49b2-9f3c-5ca7ae028b98 admin admin] PATH_INFO: `/v3/projects/66a72591d9e14ca484f656947135606a` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:56.033798 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b7d6c-2594-49b2-9f3c-5ca7ae028b98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66a72591d9e14ca484f656947135606a)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:56.036897 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b7d6c-2594-49b2-9f3c-5ca7ae028b98 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:56.120881 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c7829-da59-4c79-b746-0a29ce8bf926 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:56.127254 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adaca8e-47e2-4141-b9a0-851f8d177f90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87b6ed93587a4c87ad5002fc80b985c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:56.127894 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adaca8e-47e2-4141-b9a0-851f8d177f90 service swift] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:56.128170 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adaca8e-47e2-4141-b9a0-851f8d177f90 service swift] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:56.128441 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adaca8e-47e2-4141-b9a0-851f8d177f90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:56.136368 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adaca8e-47e2-4141-b9a0-851f8d177f90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:56.137950 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adaca8e-47e2-4141-b9a0-851f8d177f90 service swift] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:56.146147 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1261/2516] 10.222.0.62 () {60 vars in 1384 bytes} [Tue Nov 23 19:36:56 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 23 19:36:56.158989 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-6a0b7d6c-2594-49b2-9f3c-5ca7ae028b98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66a72591d9e14ca484f656947135606a', 'request_id': 'req-6a0b7d6c-2594-49b2-9f3c-5ca7ae028b98'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:56.165629 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-6a0b7d6c-2594-49b2-9f3c-5ca7ae028b98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66a72591d9e14ca484f656947135606a', 'request_id': 'req-6a0b7d6c-2594-49b2-9f3c-5ca7ae028b98'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:56.171138 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-6a0b7d6c-2594-49b2-9f3c-5ca7ae028b98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66a72591d9e14ca484f656947135606a', 'request_id': 'req-6a0b7d6c-2594-49b2-9f3c-5ca7ae028b98'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:56.263434 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-6a0b7d6c-2594-49b2-9f3c-5ca7ae028b98 admin admin] The token cache is being invalidate because project 66a72591d9e14ca484f656947135606a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:36:56.263879 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-6a0b7d6c-2594-49b2-9f3c-5ca7ae028b98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:56.264641 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-6a0b7d6c-2594-49b2-9f3c-5ca7ae028b98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:36:56.273941 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d32871-1459-4822-86fc-91c48adfb979 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:56.274376 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d32871-1459-4822-86fc-91c48adfb979 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:56.274753 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d32871-1459-4822-86fc-91c48adfb979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:56.286738 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1256/2517] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:36:55 2021] DELETE /identity/v3/projects/66a72591d9e14ca484f656947135606a => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:36:56.297904 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-31d32871-1459-4822-86fc-91c48adfb979 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:56.299541 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-31d32871-1459-4822-86fc-91c48adfb979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:56.387484 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1262/2518] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:36:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:36:56.395910 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12be1d6-3682-40d3-88dd-8f8a39dd87da None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:56.396429 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12be1d6-3682-40d3-88dd-8f8a39dd87da None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:56.396527 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12be1d6-3682-40d3-88dd-8f8a39dd87da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:56.434738 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-d12be1d6-3682-40d3-88dd-8f8a39dd87da None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:56.436163 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-d12be1d6-3682-40d3-88dd-8f8a39dd87da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:56.445233 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1257/2519] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:36:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:36:56.449450 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d32871-1459-4822-86fc-91c48adfb979 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:56.460642 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d32871-1459-4822-86fc-91c48adfb979 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:56.465539 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d3223-2257-42e8-b52a-0edae2643102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:56.466199 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d3223-2257-42e8-b52a-0edae2643102 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:56.467530 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d3223-2257-42e8-b52a-0edae2643102 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:56.467530 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d3223-2257-42e8-b52a-0edae2643102 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:56.467530 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d3223-2257-42e8-b52a-0edae2643102 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:36:56.467864 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d3223-2257-42e8-b52a-0edae2643102 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:56.469862 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d3223-2257-42e8-b52a-0edae2643102 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:56.481440 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1263/2520] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:36:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:36:56.487079 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12be1d6-3682-40d3-88dd-8f8a39dd87da None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:56.497729 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12be1d6-3682-40d3-88dd-8f8a39dd87da None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:56.506466 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37107db-7a83-45c5-893a-294a5632a5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:56.507153 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37107db-7a83-45c5-893a-294a5632a5f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:56.507430 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37107db-7a83-45c5-893a-294a5632a5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:56.508236 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37107db-7a83-45c5-893a-294a5632a5f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:56.509023 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37107db-7a83-45c5-893a-294a5632a5f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:56.511191 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37107db-7a83-45c5-893a-294a5632a5f3 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:56.654353 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1258/2521] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:36:56 2021] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:36:56.658684 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d3223-2257-42e8-b52a-0edae2643102 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:56.670536 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d3223-2257-42e8-b52a-0edae2643102 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:56.824974 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671bbef9-0a16-4d2d-aab6-d89d36e9de22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:56.825654 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bbef9-0a16-4d2d-aab6-d89d36e9de22 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:56.825996 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bbef9-0a16-4d2d-aab6-d89d36e9de22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:56.826218 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bbef9-0a16-4d2d-aab6-d89d36e9de22 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:56.829789 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671bbef9-0a16-4d2d-aab6-d89d36e9de22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:56.833228 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671bbef9-0a16-4d2d-aab6-d89d36e9de22 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:56.987353 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1264/2522] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:36:56 2021] POST /identity/v3/users => generated 293 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:36:56.988425 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37107db-7a83-45c5-893a-294a5632a5f3 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:56.999022 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37107db-7a83-45c5-893a-294a5632a5f3 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:57.011818 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac1317-192d-4c44-ad3b-48510ccc0686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:57.012501 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac1317-192d-4c44-ad3b-48510ccc0686 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:57.012788 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac1317-192d-4c44-ad3b-48510ccc0686 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:57.013067 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac1317-192d-4c44-ad3b-48510ccc0686 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:57.020123 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac1317-192d-4c44-ad3b-48510ccc0686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:57.021849 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac1317-192d-4c44-ad3b-48510ccc0686 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:57.034062 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1259/2523] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:36:56 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:36:57.038278 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671bbef9-0a16-4d2d-aab6-d89d36e9de22 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:57.049636 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671bbef9-0a16-4d2d-aab6-d89d36e9de22 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:57.054268 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84602490-d286-43de-a1d3-20f6a6501282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:57.054930 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84602490-d286-43de-a1d3-20f6a6501282 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:57.055213 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84602490-d286-43de-a1d3-20f6a6501282 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:57.055489 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84602490-d286-43de-a1d3-20f6a6501282 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:57.056226 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84602490-d286-43de-a1d3-20f6a6501282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:57.057832 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84602490-d286-43de-a1d3-20f6a6501282 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:57.069441 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1265/2524] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:36:57 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:36:57.077909 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac1317-192d-4c44-ad3b-48510ccc0686 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:57.092108 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac1317-192d-4c44-ad3b-48510ccc0686 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:57.098362 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6eaf64-cb6a-435d-b56f-4681912417de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:57.100681 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6eaf64-cb6a-435d-b56f-4681912417de admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:57.101198 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6eaf64-cb6a-435d-b56f-4681912417de admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:57.101728 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6eaf64-cb6a-435d-b56f-4681912417de admin admin] PATH_INFO: `/v3/projects/181e7185ccb14524ac255699a5b5d007/users/9ddfb00f737a4382907f83d761b2294e/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:57.134785 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6eaf64-cb6a-435d-b56f-4681912417de admin admin] RBAC: Authorizing `identity:create_grant(project_id=181e7185ccb14524ac255699a5b5d007, user_id=9ddfb00f737a4382907f83d761b2294e, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:57.138379 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6eaf64-cb6a-435d-b56f-4681912417de admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:57.202111 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1260/2525] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:36:57 2021] PUT /identity/v3/projects/181e7185ccb14524ac255699a5b5d007/users/9ddfb00f737a4382907f83d761b2294e/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:36:57.214231 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83594c5f-c025-4edf-8718-7cee9a6f8952 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:57.214543 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83594c5f-c025-4edf-8718-7cee9a6f8952 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:57.214813 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83594c5f-c025-4edf-8718-7cee9a6f8952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:57.242272 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-83594c5f-c025-4edf-8718-7cee9a6f8952 None None] MFA Rules not processed for user `9ddfb00f737a4382907f83d761b2294e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:57.243554 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-83594c5f-c025-4edf-8718-7cee9a6f8952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:57.319070 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1266/2526] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:36:57 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:36:57.319996 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6eaf64-cb6a-435d-b56f-4681912417de admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:57.388807 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6eaf64-cb6a-435d-b56f-4681912417de admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:57.394338 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc2b15-fd24-4e72-b6dd-bdb1e9d1bfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:57.395093 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc2b15-fd24-4e72-b6dd-bdb1e9d1bfab admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:57.395532 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc2b15-fd24-4e72-b6dd-bdb1e9d1bfab admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:57.396122 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc2b15-fd24-4e72-b6dd-bdb1e9d1bfab admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:57.396994 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbc2b15-fd24-4e72-b6dd-bdb1e9d1bfab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:57.399114 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbc2b15-fd24-4e72-b6dd-bdb1e9d1bfab admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:57.478004 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1261/2527] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:36:57 2021] POST /identity/v3/projects => generated 381 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:36:57.479319 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83594c5f-c025-4edf-8718-7cee9a6f8952 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:57.492404 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83594c5f-c025-4edf-8718-7cee9a6f8952 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:57.557680 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cae0de-1549-4594-be6d-789ed3e3ba8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:57.558261 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cae0de-1549-4594-be6d-789ed3e3ba8a admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:57.558546 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cae0de-1549-4594-be6d-789ed3e3ba8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:57.558831 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cae0de-1549-4594-be6d-789ed3e3ba8a admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:57.559547 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cae0de-1549-4594-be6d-789ed3e3ba8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:57.561673 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cae0de-1549-4594-be6d-789ed3e3ba8a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:57.706878 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1267/2528] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:36:57 2021] POST /identity/v3/users => generated 297 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:36:57.711774 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc2b15-fd24-4e72-b6dd-bdb1e9d1bfab admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:57.724171 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc2b15-fd24-4e72-b6dd-bdb1e9d1bfab admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:57.730782 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c8050-ef93-44bd-be98-d501699061e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:57.731464 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c8050-ef93-44bd-be98-d501699061e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:57.731750 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c8050-ef93-44bd-be98-d501699061e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:57.732025 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c8050-ef93-44bd-be98-d501699061e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:57.733049 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c8050-ef93-44bd-be98-d501699061e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:57.735223 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c8050-ef93-44bd-be98-d501699061e2 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:57.760078 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1262/2529] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:36:57 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:36:57.761475 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cae0de-1549-4594-be6d-789ed3e3ba8a admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:57.773987 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cae0de-1549-4594-be6d-789ed3e3ba8a admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:57.779565 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4edf1a-36d0-423a-b36b-a5fbeba2d0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:57.780836 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4edf1a-36d0-423a-b36b-a5fbeba2d0d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:57.781013 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4edf1a-36d0-423a-b36b-a5fbeba2d0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:57.782282 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4edf1a-36d0-423a-b36b-a5fbeba2d0d3 admin admin] PATH_INFO: `/v3/projects/3487b5a8b47f470e9d61ce3010d4b62f/users/46f92f5e406b40da96c6ef7865406aa4/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:57.800252 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4edf1a-36d0-423a-b36b-a5fbeba2d0d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3487b5a8b47f470e9d61ce3010d4b62f, user_id=46f92f5e406b40da96c6ef7865406aa4, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:57.821685 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4edf1a-36d0-423a-b36b-a5fbeba2d0d3 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:57.914715 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1268/2530] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:36:57 2021] PUT /identity/v3/projects/3487b5a8b47f470e9d61ce3010d4b62f/users/46f92f5e406b40da96c6ef7865406aa4/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:36:57.916979 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c8050-ef93-44bd-be98-d501699061e2 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:57.927101 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c8050-ef93-44bd-be98-d501699061e2 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:57.988623 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d38f1-e8b0-42f4-92e1-17676999143d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:57.989533 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d38f1-e8b0-42f4-92e1-17676999143d admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:57.989819 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d38f1-e8b0-42f4-92e1-17676999143d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:57.990089 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d38f1-e8b0-42f4-92e1-17676999143d admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:57.991399 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d38f1-e8b0-42f4-92e1-17676999143d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:57.993050 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d38f1-e8b0-42f4-92e1-17676999143d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:58.006683 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1263/2531] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:36:57 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:36:58.010677 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4edf1a-36d0-423a-b36b-a5fbeba2d0d3 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:58.027950 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4edf1a-36d0-423a-b36b-a5fbeba2d0d3 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:58.033714 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22e0b0-8f78-4166-bb54-6bc32dc7114f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:58.034610 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22e0b0-8f78-4166-bb54-6bc32dc7114f admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:58.034894 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22e0b0-8f78-4166-bb54-6bc32dc7114f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:58.035227 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22e0b0-8f78-4166-bb54-6bc32dc7114f admin admin] PATH_INFO: `/v3/projects/3487b5a8b47f470e9d61ce3010d4b62f/users/46f92f5e406b40da96c6ef7865406aa4/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:58.037338 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22e0b0-8f78-4166-bb54-6bc32dc7114f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3487b5a8b47f470e9d61ce3010d4b62f, user_id=46f92f5e406b40da96c6ef7865406aa4, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:58.040061 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22e0b0-8f78-4166-bb54-6bc32dc7114f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:58.069628 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1269/2532] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:36:58 2021] PUT /identity/v3/projects/3487b5a8b47f470e9d61ce3010d4b62f/users/46f92f5e406b40da96c6ef7865406aa4/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:36:58.082312 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135be479-b105-4c38-aa4c-c1d36c9dff0a None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:58.082623 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135be479-b105-4c38-aa4c-c1d36c9dff0a None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:58.082883 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135be479-b105-4c38-aa4c-c1d36c9dff0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:58.112449 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-135be479-b105-4c38-aa4c-c1d36c9dff0a None None] MFA Rules not processed for user `46f92f5e406b40da96c6ef7865406aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:36:58.116018 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-135be479-b105-4c38-aa4c-c1d36c9dff0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:58.183038 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1264/2533] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:36:58 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:36:58.194013 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22e0b0-8f78-4166-bb54-6bc32dc7114f admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:58.195774 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-6e22e0b0-8f78-4166-bb54-6bc32dc7114f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:58.260841 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22e0b0-8f78-4166-bb54-6bc32dc7114f admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:58.265173 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a6080-0d35-4c65-8a42-fe2a7777c56d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:58.266642 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a6080-0d35-4c65-8a42-fe2a7777c56d service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:58.266924 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a6080-0d35-4c65-8a42-fe2a7777c56d service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:58.267197 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a6080-0d35-4c65-8a42-fe2a7777c56d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:58.326102 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a6080-0d35-4c65-8a42-fe2a7777c56d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:58.327670 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a6080-0d35-4c65-8a42-fe2a7777c56d service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:58.337863 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1270/2534] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:36:58 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:36:59.564641 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135be479-b105-4c38-aa4c-c1d36c9dff0a None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:36:59.566363 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-135be479-b105-4c38-aa4c-c1d36c9dff0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:59.632513 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135be479-b105-4c38-aa4c-c1d36c9dff0a None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:36:59.637495 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335f5c4-4f57-4f1b-8a14-7072acf0824b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:36:59.638390 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335f5c4-4f57-4f1b-8a14-7072acf0824b service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:36:59.638942 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335f5c4-4f57-4f1b-8a14-7072acf0824b service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:36:59.639224 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335f5c4-4f57-4f1b-8a14-7072acf0824b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:36:59.641657 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-7335f5c4-4f57-4f1b-8a14-7072acf0824b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:36:59.717642 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335f5c4-4f57-4f1b-8a14-7072acf0824b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:36:59.720207 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335f5c4-4f57-4f1b-8a14-7072acf0824b service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:36:59.737342 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1265/2535] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:36:59 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:37:02.352877 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a6080-0d35-4c65-8a42-fe2a7777c56d service cinder] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:02.356749 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-493a6080-0d35-4c65-8a42-fe2a7777c56d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:02.440070 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a6080-0d35-4c65-8a42-fe2a7777c56d service cinder] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:02.444979 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907eb11-8b59-42bd-a335-49cda4b04da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:02.445903 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907eb11-8b59-42bd-a335-49cda4b04da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:02.446401 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907eb11-8b59-42bd-a335-49cda4b04da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:02.446846 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907eb11-8b59-42bd-a335-49cda4b04da7 admin admin] PATH_INFO: `/v3/users/4638e688aedc44e6b55166a9276a4c80` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:02.448547 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907eb11-8b59-42bd-a335-49cda4b04da7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4638e688aedc44e6b55166a9276a4c80)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:02.450743 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907eb11-8b59-42bd-a335-49cda4b04da7 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:02.771944 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4907eb11-8b59-42bd-a335-49cda4b04da7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4638e688aedc44e6b55166a9276a4c80'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:02.772768 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4907eb11-8b59-42bd-a335-49cda4b04da7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4638e688aedc44e6b55166a9276a4c80'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:02.831701 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4907eb11-8b59-42bd-a335-49cda4b04da7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4638e688aedc44e6b55166a9276a4c80'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:02.832280 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4907eb11-8b59-42bd-a335-49cda4b04da7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4638e688aedc44e6b55166a9276a4c80'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:02.845532 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4907eb11-8b59-42bd-a335-49cda4b04da7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4638e688aedc44e6b55166a9276a4c80'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:02.860634 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1271/2536] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:37:02 2021] DELETE /identity/v3/users/4638e688aedc44e6b55166a9276a4c80 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:37:03.085083 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335f5c4-4f57-4f1b-8a14-7072acf0824b service neutron] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:03.099564 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335f5c4-4f57-4f1b-8a14-7072acf0824b service neutron] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:03.164975 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eedf1c1-8ff8-441a-a4cc-37c17789cf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:03.164975 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedf1c1-8ff8-441a-a4cc-37c17789cf53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:03.164975 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedf1c1-8ff8-441a-a4cc-37c17789cf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:03.165329 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedf1c1-8ff8-441a-a4cc-37c17789cf53 admin admin] PATH_INFO: `/v3/projects/c15ab51e579448cfb7a4b3e4f8049687` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:03.166387 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eedf1c1-8ff8-441a-a4cc-37c17789cf53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c15ab51e579448cfb7a4b3e4f8049687)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:03.168537 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eedf1c1-8ff8-441a-a4cc-37c17789cf53 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:03.252859 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-3eedf1c1-8ff8-441a-a4cc-37c17789cf53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c15ab51e579448cfb7a4b3e4f8049687', 'request_id': 'req-3eedf1c1-8ff8-441a-a4cc-37c17789cf53'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:03.260204 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-3eedf1c1-8ff8-441a-a4cc-37c17789cf53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c15ab51e579448cfb7a4b3e4f8049687', 'request_id': 'req-3eedf1c1-8ff8-441a-a4cc-37c17789cf53'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:03.267310 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-3eedf1c1-8ff8-441a-a4cc-37c17789cf53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c15ab51e579448cfb7a4b3e4f8049687', 'request_id': 'req-3eedf1c1-8ff8-441a-a4cc-37c17789cf53'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:03.331459 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-3eedf1c1-8ff8-441a-a4cc-37c17789cf53 admin admin] The token cache is being invalidate because project c15ab51e579448cfb7a4b3e4f8049687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:37:03.331933 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-3eedf1c1-8ff8-441a-a4cc-37c17789cf53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:03.332763 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-3eedf1c1-8ff8-441a-a4cc-37c17789cf53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:03.335216 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1266/2537] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:37:03 2021] DELETE /identity/v3/projects/c15ab51e579448cfb7a4b3e4f8049687 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:37:03.342654 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34673a5-908c-4890-9339-79b704bb9f52 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:03.343103 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34673a5-908c-4890-9339-79b704bb9f52 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:03.344676 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34673a5-908c-4890-9339-79b704bb9f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:03.368013 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-f34673a5-908c-4890-9339-79b704bb9f52 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:37:03.371039 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-f34673a5-908c-4890-9339-79b704bb9f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:03.446275 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1272/2538] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:37:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:37:03.454483 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bea07-9546-441e-abdb-cca699556fce None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:03.455074 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bea07-9546-441e-abdb-cca699556fce None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:03.455462 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bea07-9546-441e-abdb-cca699556fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:03.485134 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-d65bea07-9546-441e-abdb-cca699556fce None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:37:03.486547 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-d65bea07-9546-441e-abdb-cca699556fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:03.498412 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1267/2539] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:37:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:37:03.502930 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34673a5-908c-4890-9339-79b704bb9f52 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:03.519137 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34673a5-908c-4890-9339-79b704bb9f52 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:03.526829 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e26cf-dbff-4ac8-97b2-609ec4503f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:03.527532 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e26cf-dbff-4ac8-97b2-609ec4503f94 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:03.527816 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e26cf-dbff-4ac8-97b2-609ec4503f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:03.528092 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e26cf-dbff-4ac8-97b2-609ec4503f94 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:03.528832 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e26cf-dbff-4ac8-97b2-609ec4503f94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:37:03.529138 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e26cf-dbff-4ac8-97b2-609ec4503f94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:03.530745 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e26cf-dbff-4ac8-97b2-609ec4503f94 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:03.546165 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1273/2540] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:37:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:37:03.550336 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65bea07-9546-441e-abdb-cca699556fce None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:03.559985 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65bea07-9546-441e-abdb-cca699556fce None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:03.568344 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f46f2-1f87-4ead-974c-7f204b92691a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:03.569024 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f46f2-1f87-4ead-974c-7f204b92691a admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:03.569328 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f46f2-1f87-4ead-974c-7f204b92691a admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:03.569621 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f46f2-1f87-4ead-974c-7f204b92691a admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:03.570393 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f46f2-1f87-4ead-974c-7f204b92691a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:03.572594 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f46f2-1f87-4ead-974c-7f204b92691a admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:03.681771 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1268/2541] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:37:03 2021] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:37:03.685582 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e26cf-dbff-4ac8-97b2-609ec4503f94 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:03.697543 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e26cf-dbff-4ac8-97b2-609ec4503f94 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:03.819183 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448cb61-dd43-40ab-8699-e6226b3c4200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:03.820115 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448cb61-dd43-40ab-8699-e6226b3c4200 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:03.820402 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448cb61-dd43-40ab-8699-e6226b3c4200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:03.820680 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448cb61-dd43-40ab-8699-e6226b3c4200 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:03.821453 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b448cb61-dd43-40ab-8699-e6226b3c4200 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:03.823510 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b448cb61-dd43-40ab-8699-e6226b3c4200 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:03.831709 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f46f2-1f87-4ead-974c-7f204b92691a admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:03.833783 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-a32f46f2-1f87-4ead-974c-7f204b92691a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:03.895894 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f46f2-1f87-4ead-974c-7f204b92691a admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:03.899922 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5d59d-3cfe-474c-9fb8-f6dbbdf52a8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:03.903696 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1274/2542] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:37:03 2021] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:37:03.906786 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5d59d-3cfe-474c-9fb8-f6dbbdf52a8f service cinder] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:03.906786 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5d59d-3cfe-474c-9fb8-f6dbbdf52a8f service cinder] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:03.906786 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5d59d-3cfe-474c-9fb8-f6dbbdf52a8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:03.906786 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-02f5d59d-3cfe-474c-9fb8-f6dbbdf52a8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:03.908368 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448cb61-dd43-40ab-8699-e6226b3c4200 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:03.919442 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448cb61-dd43-40ab-8699-e6226b3c4200 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:03.925308 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705a1ea-2c5b-4232-ab39-dcc72d3103b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:03.930336 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705a1ea-2c5b-4232-ab39-dcc72d3103b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:03.930336 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705a1ea-2c5b-4232-ab39-dcc72d3103b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:03.930336 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705a1ea-2c5b-4232-ab39-dcc72d3103b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:03.930336 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705a1ea-2c5b-4232-ab39-dcc72d3103b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:03.930336 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705a1ea-2c5b-4232-ab39-dcc72d3103b5 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:03.940445 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1275/2543] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:37:03 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:37:03.944506 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705a1ea-2c5b-4232-ab39-dcc72d3103b5 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:03.960882 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705a1ea-2c5b-4232-ab39-dcc72d3103b5 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:03.969204 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96726c2-6b4c-44a7-81a7-91183dc78917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:03.970395 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96726c2-6b4c-44a7-81a7-91183dc78917 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:03.970745 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96726c2-6b4c-44a7-81a7-91183dc78917 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:03.971088 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96726c2-6b4c-44a7-81a7-91183dc78917 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:03.971956 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96726c2-6b4c-44a7-81a7-91183dc78917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:03.974203 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96726c2-6b4c-44a7-81a7-91183dc78917 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:03.983106 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5d59d-3cfe-474c-9fb8-f6dbbdf52a8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:03.984774 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5d59d-3cfe-474c-9fb8-f6dbbdf52a8f service cinder] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:03.988332 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1276/2544] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:37:03 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:37:03.992274 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96726c2-6b4c-44a7-81a7-91183dc78917 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:03.999005 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1269/2545] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:37:03 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:37:04.014676 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96726c2-6b4c-44a7-81a7-91183dc78917 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:04.020728 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d949c7-500d-4787-b6af-f81592b89098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:04.021968 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d949c7-500d-4787-b6af-f81592b89098 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:04.022456 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d949c7-500d-4787-b6af-f81592b89098 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:04.022916 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d949c7-500d-4787-b6af-f81592b89098 admin admin] PATH_INFO: `/v3/projects/c9d53f0599374b679185cc73383b417c/users/97620b529cf8418da91d58596ef4c808/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:04.041560 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d949c7-500d-4787-b6af-f81592b89098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9d53f0599374b679185cc73383b417c, user_id=97620b529cf8418da91d58596ef4c808, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:04.046233 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d949c7-500d-4787-b6af-f81592b89098 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:04.107113 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1277/2546] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:37:03 2021] PUT /identity/v3/projects/c9d53f0599374b679185cc73383b417c/users/97620b529cf8418da91d58596ef4c808/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:37:04.107303 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3a0ff-f55b-4cfb-99b6-4199515849a2 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:04.107303 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3a0ff-f55b-4cfb-99b6-4199515849a2 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:04.107863 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3a0ff-f55b-4cfb-99b6-4199515849a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:04.134577 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-e8a3a0ff-f55b-4cfb-99b6-4199515849a2 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:37:04.135781 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-e8a3a0ff-f55b-4cfb-99b6-4199515849a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:04.200566 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1270/2547] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:37:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:37:04.211299 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d949c7-500d-4787-b6af-f81592b89098 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:04.217236 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-01d949c7-500d-4787-b6af-f81592b89098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:04.269601 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d949c7-500d-4787-b6af-f81592b89098 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:04.273252 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674033d4-dbf0-48ac-a14a-f48b26b4d9ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:04.273923 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674033d4-dbf0-48ac-a14a-f48b26b4d9ea service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:04.274203 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674033d4-dbf0-48ac-a14a-f48b26b4d9ea service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:04.274477 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674033d4-dbf0-48ac-a14a-f48b26b4d9ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:04.283470 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674033d4-dbf0-48ac-a14a-f48b26b4d9ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:04.284860 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674033d4-dbf0-48ac-a14a-f48b26b4d9ea service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:04.294008 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1278/2548] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:37:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:37:07.920945 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9ace2-2f20-4404-9979-824bb676eadc None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:07.929321 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9ace2-2f20-4404-9979-824bb676eadc None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:07.929321 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9ace2-2f20-4404-9979-824bb676eadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:07.943799 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-07d9ace2-2f20-4404-9979-824bb676eadc None None] MFA Rules not processed for user `abc393885c6c4cf6bd4dd52f698fc38c`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:37:07.945586 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-07d9ace2-2f20-4404-9979-824bb676eadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:08.041287 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1271/2549] 10.222.0.62 () {58 vars in 1009 bytes} [Tue Nov 23 19:37:07 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:37:08.055650 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674033d4-dbf0-48ac-a14a-f48b26b4d9ea service neutron] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:08.057295 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-674033d4-dbf0-48ac-a14a-f48b26b4d9ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:08.130529 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674033d4-dbf0-48ac-a14a-f48b26b4d9ea service neutron] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:08.135644 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ff1da-8219-4641-ab16-bdfa590c1fa7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87b6ed93587a4c87ad5002fc80b985c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:08.136317 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ff1da-8219-4641-ab16-bdfa590c1fa7 service swift] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:08.136730 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ff1da-8219-4641-ab16-bdfa590c1fa7 service swift] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:08.137011 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ff1da-8219-4641-ab16-bdfa590c1fa7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:08.147149 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ff1da-8219-4641-ab16-bdfa590c1fa7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:08.148739 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ff1da-8219-4641-ab16-bdfa590c1fa7 service swift] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:08.157251 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1279/2550] 10.222.0.62 () {60 vars in 1384 bytes} [Tue Nov 23 19:37:08 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:37:09.268633 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8dc9d-65b8-47ef-8e5f-6bacd80b84c6 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:09.269077 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8dc9d-65b8-47ef-8e5f-6bacd80b84c6 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:09.269174 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8dc9d-65b8-47ef-8e5f-6bacd80b84c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:09.289070 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-43f8dc9d-65b8-47ef-8e5f-6bacd80b84c6 None None] MFA Rules not processed for user `abc393885c6c4cf6bd4dd52f698fc38c`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:37:09.290319 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-43f8dc9d-65b8-47ef-8e5f-6bacd80b84c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:09.299381 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1272/2551] 10.222.0.62 () {58 vars in 967 bytes} [Tue Nov 23 19:37:09 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:37:09.315136 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ff1da-8219-4641-ab16-bdfa590c1fa7 service swift] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:09.327648 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ff1da-8219-4641-ab16-bdfa590c1fa7 service swift] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:09.333653 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c8c42-47b3-4911-b5c2-6d17c4d8c3d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87b6ed93587a4c87ad5002fc80b985c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:09.334532 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c8c42-47b3-4911-b5c2-6d17c4d8c3d8 service swift] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:09.335226 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c8c42-47b3-4911-b5c2-6d17c4d8c3d8 service swift] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:09.336378 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c8c42-47b3-4911-b5c2-6d17c4d8c3d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:09.346983 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c8c42-47b3-4911-b5c2-6d17c4d8c3d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:09.354709 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c8c42-47b3-4911-b5c2-6d17c4d8c3d8 service swift] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:09.358916 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1280/2552] 10.222.0.62 () {60 vars in 1384 bytes} [Tue Nov 23 19:37:09 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:37:09.759424 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8dc9d-65b8-47ef-8e5f-6bacd80b84c6 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:09.761866 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-43f8dc9d-65b8-47ef-8e5f-6bacd80b84c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:09.777729 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8dc9d-65b8-47ef-8e5f-6bacd80b84c6 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:09.783402 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268bb845-a6b7-4c91-be23-bbead13967dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:09.784567 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268bb845-a6b7-4c91-be23-bbead13967dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:09.785020 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268bb845-a6b7-4c91-be23-bbead13967dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:09.785636 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268bb845-a6b7-4c91-be23-bbead13967dc admin admin] PATH_INFO: `/v3/users/9ddfb00f737a4382907f83d761b2294e` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:09.790866 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268bb845-a6b7-4c91-be23-bbead13967dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ddfb00f737a4382907f83d761b2294e)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:09.793752 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268bb845-a6b7-4c91-be23-bbead13967dc admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:10.021286 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905e568-4388-43d2-9f99-554f397d4c4c None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:10.021963 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905e568-4388-43d2-9f99-554f397d4c4c None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:10.022588 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905e568-4388-43d2-9f99-554f397d4c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:10.041295 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-268bb845-a6b7-4c91-be23-bbead13967dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ddfb00f737a4382907f83d761b2294e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:10.044165 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-268bb845-a6b7-4c91-be23-bbead13967dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ddfb00f737a4382907f83d761b2294e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:10.067087 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-f905e568-4388-43d2-9f99-554f397d4c4c None None] MFA Rules not processed for user `abc393885c6c4cf6bd4dd52f698fc38c`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:37:10.069085 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-268bb845-a6b7-4c91-be23-bbead13967dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ddfb00f737a4382907f83d761b2294e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:10.069461 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-f905e568-4388-43d2-9f99-554f397d4c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:10.071780 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-268bb845-a6b7-4c91-be23-bbead13967dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ddfb00f737a4382907f83d761b2294e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:10.089231 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-268bb845-a6b7-4c91-be23-bbead13967dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ddfb00f737a4382907f83d761b2294e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:10.093127 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1281/2553] 10.222.0.62 () {58 vars in 1009 bytes} [Tue Nov 23 19:37:10 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:37:10.094124 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905e568-4388-43d2-9f99-554f397d4c4c None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:10.095783 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-f905e568-4388-43d2-9f99-554f397d4c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:10.112975 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905e568-4388-43d2-9f99-554f397d4c4c None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:10.120388 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f6744-b2ea-442f-8f0e-7e989008f517 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87b6ed93587a4c87ad5002fc80b985c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:10.121275 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f6744-b2ea-442f-8f0e-7e989008f517 service swift] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:10.121591 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f6744-b2ea-442f-8f0e-7e989008f517 service swift] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:10.121870 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f6744-b2ea-442f-8f0e-7e989008f517 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:10.134089 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f6744-b2ea-442f-8f0e-7e989008f517 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:10.135628 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f6744-b2ea-442f-8f0e-7e989008f517 service swift] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:10.145239 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1282/2554] 10.222.0.62 () {60 vars in 1384 bytes} [Tue Nov 23 19:37:10 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:37:10.180921 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1273/2555] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:37:09 2021] DELETE /identity/v3/users/9ddfb00f737a4382907f83d761b2294e => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:37:10.185714 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0868c-1fff-47ce-b56d-6b534bc3eaf4 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:10.186245 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0868c-1fff-47ce-b56d-6b534bc3eaf4 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:10.186589 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0868c-1fff-47ce-b56d-6b534bc3eaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:10.208209 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-dbf0868c-1fff-47ce-b56d-6b534bc3eaf4 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:37:10.209604 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-dbf0868c-1fff-47ce-b56d-6b534bc3eaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:10.234811 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a48bf-db11-4f18-8bfe-bf3029862b22 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:10.235940 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a48bf-db11-4f18-8bfe-bf3029862b22 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:10.236324 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a48bf-db11-4f18-8bfe-bf3029862b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:10.274656 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-580a48bf-db11-4f18-8bfe-bf3029862b22 None None] MFA Rules not processed for user `97620b529cf8418da91d58596ef4c808`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:37:10.274656 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-580a48bf-db11-4f18-8bfe-bf3029862b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:10.300567 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1283/2556] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:37:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:37:10.312949 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0868c-1fff-47ce-b56d-6b534bc3eaf4 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:10.315094 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-dbf0868c-1fff-47ce-b56d-6b534bc3eaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:10.349484 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1274/2557] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:37:10 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:37:10.363265 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a48bf-db11-4f18-8bfe-bf3029862b22 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:10.364676 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-580a48bf-db11-4f18-8bfe-bf3029862b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:10.381669 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0868c-1fff-47ce-b56d-6b534bc3eaf4 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:10.386200 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e3fb2-dd8f-493e-8237-a3dae225c3be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:10.386951 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e3fb2-dd8f-493e-8237-a3dae225c3be service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:10.387365 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e3fb2-dd8f-493e-8237-a3dae225c3be service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:10.387704 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e3fb2-dd8f-493e-8237-a3dae225c3be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:10.399719 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e3fb2-dd8f-493e-8237-a3dae225c3be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:10.401276 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e3fb2-dd8f-493e-8237-a3dae225c3be service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:10.412051 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1284/2558] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:37:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:37:10.480858 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a48bf-db11-4f18-8bfe-bf3029862b22 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:10.488493 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f295d1f-d7a6-4e1b-be16-3f31d32f6d2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:10.489373 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f295d1f-d7a6-4e1b-be16-3f31d32f6d2f service nova] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:10.489744 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f295d1f-d7a6-4e1b-be16-3f31d32f6d2f service nova] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:10.489969 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f295d1f-d7a6-4e1b-be16-3f31d32f6d2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:10.500049 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f295d1f-d7a6-4e1b-be16-3f31d32f6d2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:10.502047 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f295d1f-d7a6-4e1b-be16-3f31d32f6d2f service nova] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:10.514700 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1275/2559] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:37:10 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:37:10.890552 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e3fb2-dd8f-493e-8237-a3dae225c3be service neutron] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:10.892001 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-e45e3fb2-dd8f-493e-8237-a3dae225c3be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:10.919181 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e3fb2-dd8f-493e-8237-a3dae225c3be service neutron] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:10.939761 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a9a24-a95f-42be-806e-79f7c747ce54 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:10.940441 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a9a24-a95f-42be-806e-79f7c747ce54 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:10.940889 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a9a24-a95f-42be-806e-79f7c747ce54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:10.959381 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de862f1b-b657-42c6-95ad-2be92a584149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:10.961643 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de862f1b-b657-42c6-95ad-2be92a584149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:10.963292 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de862f1b-b657-42c6-95ad-2be92a584149 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:10.963578 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de862f1b-b657-42c6-95ad-2be92a584149 admin admin] PATH_INFO: `/v3/projects/181e7185ccb14524ac255699a5b5d007` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:10.966228 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de862f1b-b657-42c6-95ad-2be92a584149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=181e7185ccb14524ac255699a5b5d007)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:10.967720 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-a28a9a24-a95f-42be-806e-79f7c747ce54 None None] MFA Rules not processed for user `abc393885c6c4cf6bd4dd52f698fc38c`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:37:10.968834 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de862f1b-b657-42c6-95ad-2be92a584149 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:10.969010 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-a28a9a24-a95f-42be-806e-79f7c747ce54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:11.066717 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1276/2560] 10.222.0.62 () {58 vars in 967 bytes} [Tue Nov 23 19:37:10 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:37:11.070336 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-de862f1b-b657-42c6-95ad-2be92a584149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '181e7185ccb14524ac255699a5b5d007', 'request_id': 'req-de862f1b-b657-42c6-95ad-2be92a584149'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:11.076799 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-de862f1b-b657-42c6-95ad-2be92a584149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '181e7185ccb14524ac255699a5b5d007', 'request_id': 'req-de862f1b-b657-42c6-95ad-2be92a584149'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:11.083191 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a9a24-a95f-42be-806e-79f7c747ce54 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:11.084225 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-de862f1b-b657-42c6-95ad-2be92a584149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '181e7185ccb14524ac255699a5b5d007', 'request_id': 'req-de862f1b-b657-42c6-95ad-2be92a584149'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:11.163489 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-de862f1b-b657-42c6-95ad-2be92a584149 admin admin] The token cache is being invalidate because project 181e7185ccb14524ac255699a5b5d007 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:37:11.163848 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-de862f1b-b657-42c6-95ad-2be92a584149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:11.164562 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-de862f1b-b657-42c6-95ad-2be92a584149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:11.166808 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1285/2561] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:37:10 2021] DELETE /identity/v3/projects/181e7185ccb14524ac255699a5b5d007 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:37:11.170576 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a9a24-a95f-42be-806e-79f7c747ce54 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:11.174107 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de862f1b-b657-42c6-95ad-2be92a584149 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:11.175725 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-de862f1b-b657-42c6-95ad-2be92a584149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:11.247969 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef2abc-db84-43a4-b515-c0a5714da655 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87b6ed93587a4c87ad5002fc80b985c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:11.248776 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef2abc-db84-43a4-b515-c0a5714da655 service swift] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:11.253481 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de862f1b-b657-42c6-95ad-2be92a584149 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:11.258006 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef2abc-db84-43a4-b515-c0a5714da655 service swift] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:11.258006 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef2abc-db84-43a4-b515-c0a5714da655 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:11.258006 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-2bef2abc-db84-43a4-b515-c0a5714da655 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:11.260426 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df60b1-62a1-4a3b-82db-e5c7d5125419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:11.262029 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df60b1-62a1-4a3b-82db-e5c7d5125419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:11.262470 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df60b1-62a1-4a3b-82db-e5c7d5125419 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:11.263352 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df60b1-62a1-4a3b-82db-e5c7d5125419 admin admin] PATH_INFO: `/v3/users/46f92f5e406b40da96c6ef7865406aa4` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:11.265355 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df60b1-62a1-4a3b-82db-e5c7d5125419 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46f92f5e406b40da96c6ef7865406aa4)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:11.268615 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df60b1-62a1-4a3b-82db-e5c7d5125419 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:11.335034 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef2abc-db84-43a4-b515-c0a5714da655 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:11.336636 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef2abc-db84-43a4-b515-c0a5714da655 service swift] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:11.348058 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1277/2562] 10.222.0.62 () {60 vars in 1384 bytes} [Tue Nov 23 19:37:11 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:37:11.552611 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-27df60b1-62a1-4a3b-82db-e5c7d5125419 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46f92f5e406b40da96c6ef7865406aa4'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:11.553388 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-27df60b1-62a1-4a3b-82db-e5c7d5125419 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46f92f5e406b40da96c6ef7865406aa4'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:11.654042 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-27df60b1-62a1-4a3b-82db-e5c7d5125419 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46f92f5e406b40da96c6ef7865406aa4'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:11.654745 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-27df60b1-62a1-4a3b-82db-e5c7d5125419 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46f92f5e406b40da96c6ef7865406aa4'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:11.676335 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-27df60b1-62a1-4a3b-82db-e5c7d5125419 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46f92f5e406b40da96c6ef7865406aa4'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:11.692752 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1286/2563] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:37:11 2021] DELETE /identity/v3/users/46f92f5e406b40da96c6ef7865406aa4 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:37:12.318901 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef2abc-db84-43a4-b515-c0a5714da655 service swift] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:12.332901 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef2abc-db84-43a4-b515-c0a5714da655 service swift] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:12.417319 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90dd25-e4ba-434d-a3f9-fc3d3c8130d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:12.418344 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90dd25-e4ba-434d-a3f9-fc3d3c8130d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:12.418687 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90dd25-e4ba-434d-a3f9-fc3d3c8130d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:12.419552 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90dd25-e4ba-434d-a3f9-fc3d3c8130d5 admin admin] PATH_INFO: `/v3/projects/3487b5a8b47f470e9d61ce3010d4b62f` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:12.421586 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90dd25-e4ba-434d-a3f9-fc3d3c8130d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3487b5a8b47f470e9d61ce3010d4b62f)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:12.423947 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90dd25-e4ba-434d-a3f9-fc3d3c8130d5 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:12.575985 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-0e90dd25-e4ba-434d-a3f9-fc3d3c8130d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3487b5a8b47f470e9d61ce3010d4b62f', 'request_id': 'req-0e90dd25-e4ba-434d-a3f9-fc3d3c8130d5'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:12.582883 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-0e90dd25-e4ba-434d-a3f9-fc3d3c8130d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3487b5a8b47f470e9d61ce3010d4b62f', 'request_id': 'req-0e90dd25-e4ba-434d-a3f9-fc3d3c8130d5'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:12.588901 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-0e90dd25-e4ba-434d-a3f9-fc3d3c8130d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3487b5a8b47f470e9d61ce3010d4b62f', 'request_id': 'req-0e90dd25-e4ba-434d-a3f9-fc3d3c8130d5'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:12.681906 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-0e90dd25-e4ba-434d-a3f9-fc3d3c8130d5 admin admin] The token cache is being invalidate because project 3487b5a8b47f470e9d61ce3010d4b62f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:37:12.682193 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-0e90dd25-e4ba-434d-a3f9-fc3d3c8130d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:12.682818 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-0e90dd25-e4ba-434d-a3f9-fc3d3c8130d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:12.684392 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1278/2564] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:37:12 2021] DELETE /identity/v3/projects/3487b5a8b47f470e9d61ce3010d4b62f => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:37:12.692552 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398f18a-f0a5-4ab5-bf05-159210d7aaa0 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:12.693058 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398f18a-f0a5-4ab5-bf05-159210d7aaa0 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:12.693153 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398f18a-f0a5-4ab5-bf05-159210d7aaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:12.711962 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-8398f18a-f0a5-4ab5-bf05-159210d7aaa0 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:37:12.713160 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-8398f18a-f0a5-4ab5-bf05-159210d7aaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:12.778633 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1287/2565] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:37:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:37:12.793689 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcfa56-40a1-4441-a29e-2998ad16f72b None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:12.794078 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcfa56-40a1-4441-a29e-2998ad16f72b None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:12.794271 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcfa56-40a1-4441-a29e-2998ad16f72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:12.813793 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-d1dcfa56-40a1-4441-a29e-2998ad16f72b None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:37:12.815032 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-d1dcfa56-40a1-4441-a29e-2998ad16f72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:12.826574 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1279/2566] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:37:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:37:12.831604 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398f18a-f0a5-4ab5-bf05-159210d7aaa0 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:12.842627 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398f18a-f0a5-4ab5-bf05-159210d7aaa0 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:12.849186 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9781ef-2b7c-4448-8147-c873e8bbac91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:12.850162 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9781ef-2b7c-4448-8147-c873e8bbac91 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:12.850332 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9781ef-2b7c-4448-8147-c873e8bbac91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:12.850755 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9781ef-2b7c-4448-8147-c873e8bbac91 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:12.851895 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9781ef-2b7c-4448-8147-c873e8bbac91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:37:12.852391 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9781ef-2b7c-4448-8147-c873e8bbac91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:12.854213 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9781ef-2b7c-4448-8147-c873e8bbac91 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:12.868271 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1288/2567] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:37:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:37:12.872586 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcfa56-40a1-4441-a29e-2998ad16f72b None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:12.884284 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcfa56-40a1-4441-a29e-2998ad16f72b None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:12.891012 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8aeca9-bdac-41b3-a90d-451ef68008bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:12.892316 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8aeca9-bdac-41b3-a90d-451ef68008bd admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:12.892634 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8aeca9-bdac-41b3-a90d-451ef68008bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:12.892902 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8aeca9-bdac-41b3-a90d-451ef68008bd admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:12.893733 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8aeca9-bdac-41b3-a90d-451ef68008bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:12.895665 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8aeca9-bdac-41b3-a90d-451ef68008bd admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:12.991201 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9781ef-2b7c-4448-8147-c873e8bbac91 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:12.992471 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1280/2568] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:37:12 2021] POST /identity/v3/projects => generated 371 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:37:13.006990 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9781ef-2b7c-4448-8147-c873e8bbac91 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:13.081771 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc945e8-2e4e-4353-884f-be19524e76c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:13.082462 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc945e8-2e4e-4353-884f-be19524e76c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:13.082752 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc945e8-2e4e-4353-884f-be19524e76c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:13.083030 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc945e8-2e4e-4353-884f-be19524e76c7 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:13.083745 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc945e8-2e4e-4353-884f-be19524e76c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:13.086016 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc945e8-2e4e-4353-884f-be19524e76c7 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:13.180271 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1289/2569] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:37:12 2021] POST /identity/v3/users => generated 286 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:37:13.184604 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8aeca9-bdac-41b3-a90d-451ef68008bd admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:13.196872 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8aeca9-bdac-41b3-a90d-451ef68008bd admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:13.207100 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990895e-7ed8-487c-99d8-3ebabcdada29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:13.207100 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990895e-7ed8-487c-99d8-3ebabcdada29 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:13.207100 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990895e-7ed8-487c-99d8-3ebabcdada29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:13.207347 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990895e-7ed8-487c-99d8-3ebabcdada29 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:13.208130 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990895e-7ed8-487c-99d8-3ebabcdada29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:13.209845 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990895e-7ed8-487c-99d8-3ebabcdada29 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:13.222237 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1281/2570] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:37:13 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:37:13.226320 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc945e8-2e4e-4353-884f-be19524e76c7 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:13.236930 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc945e8-2e4e-4353-884f-be19524e76c7 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:13.241668 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85716efa-d57c-4fc6-b19b-82871e374f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:13.242337 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85716efa-d57c-4fc6-b19b-82871e374f82 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:13.242617 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85716efa-d57c-4fc6-b19b-82871e374f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:13.242894 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85716efa-d57c-4fc6-b19b-82871e374f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:13.243640 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85716efa-d57c-4fc6-b19b-82871e374f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:13.245205 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85716efa-d57c-4fc6-b19b-82871e374f82 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:13.265368 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1290/2571] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:37:13 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:37:13.269710 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990895e-7ed8-487c-99d8-3ebabcdada29 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:13.288476 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990895e-7ed8-487c-99d8-3ebabcdada29 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:13.296052 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dddb10-1846-41be-93e6-7fe7b9abe0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:13.298572 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dddb10-1846-41be-93e6-7fe7b9abe0e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:13.299463 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dddb10-1846-41be-93e6-7fe7b9abe0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:13.299965 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dddb10-1846-41be-93e6-7fe7b9abe0e4 admin admin] PATH_INFO: `/v3/projects/35f8a5017a27449084aabd12f27f5a8a/users/94f87b8e0ff64d1f91897c25139ad4cc/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:13.323974 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dddb10-1846-41be-93e6-7fe7b9abe0e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35f8a5017a27449084aabd12f27f5a8a, user_id=94f87b8e0ff64d1f91897c25139ad4cc, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:13.326963 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dddb10-1846-41be-93e6-7fe7b9abe0e4 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:13.412721 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1282/2572] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:37:13 2021] PUT /identity/v3/projects/35f8a5017a27449084aabd12f27f5a8a/users/94f87b8e0ff64d1f91897c25139ad4cc/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:37:13.414500 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771d30b-2f47-4b7f-a0f5-b9ac4cc85654 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:13.414807 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771d30b-2f47-4b7f-a0f5-b9ac4cc85654 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:13.415078 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771d30b-2f47-4b7f-a0f5-b9ac4cc85654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:13.434066 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-e771d30b-2f47-4b7f-a0f5-b9ac4cc85654 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:37:13.436931 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-e771d30b-2f47-4b7f-a0f5-b9ac4cc85654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:13.511455 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1291/2573] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:37:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:37:13.525167 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dddb10-1846-41be-93e6-7fe7b9abe0e4 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:13.526794 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-65dddb10-1846-41be-93e6-7fe7b9abe0e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:13.600379 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dddb10-1846-41be-93e6-7fe7b9abe0e4 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:13.604307 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2884955-22e9-4dc6-b845-bdd4d3504ed1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:13.605046 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2884955-22e9-4dc6-b845-bdd4d3504ed1 service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:13.605401 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2884955-22e9-4dc6-b845-bdd4d3504ed1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:13.605759 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2884955-22e9-4dc6-b845-bdd4d3504ed1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:13.616285 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2884955-22e9-4dc6-b845-bdd4d3504ed1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:13.620260 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2884955-22e9-4dc6-b845-bdd4d3504ed1 service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:13.627733 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1283/2574] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:37:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:37:13.679679 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39c48b-fc30-4499-bda4-ac3e49d6adbd None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:13.679968 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39c48b-fc30-4499-bda4-ac3e49d6adbd None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:13.680248 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39c48b-fc30-4499-bda4-ac3e49d6adbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:13.699149 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-dc39c48b-fc30-4499-bda4-ac3e49d6adbd None None] MFA Rules not processed for user `97620b529cf8418da91d58596ef4c808`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:37:13.700374 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-dc39c48b-fc30-4499-bda4-ac3e49d6adbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:13.756186 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1292/2575] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:37:13 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:37:14.345884 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2884955-22e9-4dc6-b845-bdd4d3504ed1 service neutron] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:14.354372 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-b2884955-22e9-4dc6-b845-bdd4d3504ed1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:14.381745 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2884955-22e9-4dc6-b845-bdd4d3504ed1 service neutron] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:14.385317 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2976b0-d04d-467b-948e-3ce6728fa361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:14.386446 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2976b0-d04d-467b-948e-3ce6728fa361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:14.386957 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2976b0-d04d-467b-948e-3ce6728fa361 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:14.387511 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2976b0-d04d-467b-948e-3ce6728fa361 admin admin] PATH_INFO: `/v3/users/7f3f6733a4bd43fd98958792d1afd15a` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:14.389151 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2976b0-d04d-467b-948e-3ce6728fa361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f3f6733a4bd43fd98958792d1afd15a)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:14.393273 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2976b0-d04d-467b-948e-3ce6728fa361 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:14.613132 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-8d2976b0-d04d-467b-948e-3ce6728fa361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f3f6733a4bd43fd98958792d1afd15a'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:14.614690 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-8d2976b0-d04d-467b-948e-3ce6728fa361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f3f6733a4bd43fd98958792d1afd15a'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:14.623065 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-8d2976b0-d04d-467b-948e-3ce6728fa361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f3f6733a4bd43fd98958792d1afd15a'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:14.624556 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-8d2976b0-d04d-467b-948e-3ce6728fa361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f3f6733a4bd43fd98958792d1afd15a'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:14.640410 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-8d2976b0-d04d-467b-948e-3ce6728fa361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f3f6733a4bd43fd98958792d1afd15a'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:14.751835 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1284/2576] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:37:14 2021] DELETE /identity/v3/users/7f3f6733a4bd43fd98958792d1afd15a => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:37:14.753937 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b9de0-4e07-480a-beca-8984c6ea27bc None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:14.762940 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b9de0-4e07-480a-beca-8984c6ea27bc None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:14.762940 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b9de0-4e07-480a-beca-8984c6ea27bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:14.796553 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-2f3b9de0-4e07-480a-beca-8984c6ea27bc None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:37:14.798920 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-2f3b9de0-4e07-480a-beca-8984c6ea27bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:14.902772 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1293/2577] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:37:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:37:14.912838 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2976b0-d04d-467b-948e-3ce6728fa361 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:14.914388 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-8d2976b0-d04d-467b-948e-3ce6728fa361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:14.980004 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2976b0-d04d-467b-948e-3ce6728fa361 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:14.983618 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac801e-dc13-4c69-bdb0-ffd7096a2f08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:14.984277 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac801e-dc13-4c69-bdb0-ffd7096a2f08 service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:14.984564 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac801e-dc13-4c69-bdb0-ffd7096a2f08 service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:14.984839 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac801e-dc13-4c69-bdb0-ffd7096a2f08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:14.996662 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac801e-dc13-4c69-bdb0-ffd7096a2f08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:14.998069 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac801e-dc13-4c69-bdb0-ffd7096a2f08 service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:15.011238 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1285/2578] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:37:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:37:15.312534 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b9de0-4e07-480a-beca-8984c6ea27bc None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:15.314586 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-2f3b9de0-4e07-480a-beca-8984c6ea27bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:15.327075 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b9de0-4e07-480a-beca-8984c6ea27bc None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:15.332298 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05deda-9953-4e5b-a398-5d614ebd7320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:15.333391 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05deda-9953-4e5b-a398-5d614ebd7320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:15.333911 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05deda-9953-4e5b-a398-5d614ebd7320 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:15.334402 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05deda-9953-4e5b-a398-5d614ebd7320 admin admin] PATH_INFO: `/v3/projects/c52c093db38c40a383ef38ffbc4083a5` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:15.335976 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05deda-9953-4e5b-a398-5d614ebd7320 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c52c093db38c40a383ef38ffbc4083a5)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:15.338746 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05deda-9953-4e5b-a398-5d614ebd7320 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:15.455566 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-da05deda-9953-4e5b-a398-5d614ebd7320 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c52c093db38c40a383ef38ffbc4083a5', 'request_id': 'req-da05deda-9953-4e5b-a398-5d614ebd7320'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:15.464606 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-da05deda-9953-4e5b-a398-5d614ebd7320 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c52c093db38c40a383ef38ffbc4083a5', 'request_id': 'req-da05deda-9953-4e5b-a398-5d614ebd7320'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:15.477509 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-da05deda-9953-4e5b-a398-5d614ebd7320 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c52c093db38c40a383ef38ffbc4083a5', 'request_id': 'req-da05deda-9953-4e5b-a398-5d614ebd7320'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:15.570419 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-da05deda-9953-4e5b-a398-5d614ebd7320 admin admin] The token cache is being invalidate because project c52c093db38c40a383ef38ffbc4083a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:37:15.570714 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-da05deda-9953-4e5b-a398-5d614ebd7320 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:15.573997 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-da05deda-9953-4e5b-a398-5d614ebd7320 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:15.576585 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1294/2579] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:37:15 2021] DELETE /identity/v3/projects/c52c093db38c40a383ef38ffbc4083a5 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:37:15.584279 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f0eeb-e43f-4059-a529-a1584639102a None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:15.584556 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f0eeb-e43f-4059-a529-a1584639102a None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:15.585004 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f0eeb-e43f-4059-a529-a1584639102a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:15.624890 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-fb8f0eeb-e43f-4059-a529-a1584639102a None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:37:15.626887 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-fb8f0eeb-e43f-4059-a529-a1584639102a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:15.734431 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1286/2580] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:37:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:37:15.743978 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f761557-b1d5-4cac-add6-db4144b4c98e None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:15.744892 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f761557-b1d5-4cac-add6-db4144b4c98e None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:15.745185 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f761557-b1d5-4cac-add6-db4144b4c98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:15.768503 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-8f761557-b1d5-4cac-add6-db4144b4c98e None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:37:15.769738 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-8f761557-b1d5-4cac-add6-db4144b4c98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:15.780093 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1295/2581] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:37:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:37:15.791887 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f0eeb-e43f-4059-a529-a1584639102a None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:15.811603 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f0eeb-e43f-4059-a529-a1584639102a None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:15.821543 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e2442-a683-4232-b4e0-e4322c1af843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:15.822650 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e2442-a683-4232-b4e0-e4322c1af843 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:15.822939 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e2442-a683-4232-b4e0-e4322c1af843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:15.823215 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e2442-a683-4232-b4e0-e4322c1af843 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:15.824904 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e2442-a683-4232-b4e0-e4322c1af843 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:37:15.826446 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e2442-a683-4232-b4e0-e4322c1af843 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:15.828125 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e2442-a683-4232-b4e0-e4322c1af843 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:15.842348 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1287/2582] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:37:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:37:15.847768 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f761557-b1d5-4cac-add6-db4144b4c98e None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:15.858388 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f761557-b1d5-4cac-add6-db4144b4c98e None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:15.863762 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208d6e0-1d9c-41c7-8928-4e3b7f31c511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:15.864440 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208d6e0-1d9c-41c7-8928-4e3b7f31c511 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:15.864775 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208d6e0-1d9c-41c7-8928-4e3b7f31c511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:15.865751 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208d6e0-1d9c-41c7-8928-4e3b7f31c511 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:15.866667 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208d6e0-1d9c-41c7-8928-4e3b7f31c511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:15.868569 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208d6e0-1d9c-41c7-8928-4e3b7f31c511 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:15.971942 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1296/2583] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:37:15 2021] POST /identity/v3/projects => generated 389 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:37:15.983723 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e2442-a683-4232-b4e0-e4322c1af843 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:16.005336 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e2442-a683-4232-b4e0-e4322c1af843 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:16.118078 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead4081-87fd-4600-99ca-7d1dedbeb760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:16.118771 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead4081-87fd-4600-99ca-7d1dedbeb760 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:16.119056 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead4081-87fd-4600-99ca-7d1dedbeb760 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:16.119336 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead4081-87fd-4600-99ca-7d1dedbeb760 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:16.120055 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead4081-87fd-4600-99ca-7d1dedbeb760 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:16.122145 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead4081-87fd-4600-99ca-7d1dedbeb760 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:16.208796 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1288/2584] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:37:15 2021] POST /identity/v3/users => generated 295 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:37:16.213109 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208d6e0-1d9c-41c7-8928-4e3b7f31c511 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:16.227750 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208d6e0-1d9c-41c7-8928-4e3b7f31c511 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:16.233880 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e60f94-b637-4f4e-a647-8ebc804aece5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:16.234832 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e60f94-b637-4f4e-a647-8ebc804aece5 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:16.236050 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e60f94-b637-4f4e-a647-8ebc804aece5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:16.236575 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e60f94-b637-4f4e-a647-8ebc804aece5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:16.237443 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e60f94-b637-4f4e-a647-8ebc804aece5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:16.239234 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e60f94-b637-4f4e-a647-8ebc804aece5 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:16.256288 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1297/2585] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:37:16 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:37:16.263329 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead4081-87fd-4600-99ca-7d1dedbeb760 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:16.275533 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead4081-87fd-4600-99ca-7d1dedbeb760 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:16.289528 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c16c17-9630-43f4-a6ac-d4fd2f080bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:16.290218 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c16c17-9630-43f4-a6ac-d4fd2f080bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:16.290500 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c16c17-9630-43f4-a6ac-d4fd2f080bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:16.290776 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c16c17-9630-43f4-a6ac-d4fd2f080bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:16.291527 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c16c17-9630-43f4-a6ac-d4fd2f080bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:16.293191 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c16c17-9630-43f4-a6ac-d4fd2f080bf1 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:16.304383 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1289/2586] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:37:16 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:37:16.308619 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e60f94-b637-4f4e-a647-8ebc804aece5 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:16.335229 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e60f94-b637-4f4e-a647-8ebc804aece5 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:16.340744 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc673f42-b4d1-453e-8da2-5a528aecc3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:16.341748 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc673f42-b4d1-453e-8da2-5a528aecc3e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:16.342029 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc673f42-b4d1-453e-8da2-5a528aecc3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:16.342487 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc673f42-b4d1-453e-8da2-5a528aecc3e2 admin admin] PATH_INFO: `/v3/projects/6ad465310286400ca50d99ed32f6a4bc/users/c9f55377c4d54c56aa2188ccba1cc875/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:16.359182 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc673f42-b4d1-453e-8da2-5a528aecc3e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ad465310286400ca50d99ed32f6a4bc, user_id=c9f55377c4d54c56aa2188ccba1cc875, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:16.362054 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc673f42-b4d1-453e-8da2-5a528aecc3e2 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:16.432989 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1298/2587] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:37:16 2021] PUT /identity/v3/projects/6ad465310286400ca50d99ed32f6a4bc/users/c9f55377c4d54c56aa2188ccba1cc875/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:37:16.444018 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b03e9-8d6b-4bb3-b4b5-b56ba5926a7d None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:16.444411 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b03e9-8d6b-4bb3-b4b5-b56ba5926a7d None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:16.444792 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b03e9-8d6b-4bb3-b4b5-b56ba5926a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:16.475783 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-417b03e9-8d6b-4bb3-b4b5-b56ba5926a7d None None] MFA Rules not processed for user `c9f55377c4d54c56aa2188ccba1cc875`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:37:16.476950 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-417b03e9-8d6b-4bb3-b4b5-b56ba5926a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:16.544812 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1290/2588] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:37:16 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:37:16.554660 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc673f42-b4d1-453e-8da2-5a528aecc3e2 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:16.556487 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-dc673f42-b4d1-453e-8da2-5a528aecc3e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:16.619377 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc673f42-b4d1-453e-8da2-5a528aecc3e2 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:16.623410 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab9bca-77c1-465c-ab9a-f13724b1793d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:16.625356 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab9bca-77c1-465c-ab9a-f13724b1793d service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:16.625356 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab9bca-77c1-465c-ab9a-f13724b1793d service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:16.625356 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab9bca-77c1-465c-ab9a-f13724b1793d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:16.635400 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab9bca-77c1-465c-ab9a-f13724b1793d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:16.636849 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab9bca-77c1-465c-ab9a-f13724b1793d service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:16.646892 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1299/2589] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:37:16 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:37:19.901823 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d3f01-429b-4b6d-9eb8-efab1f70e22b None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:19.902349 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d3f01-429b-4b6d-9eb8-efab1f70e22b None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:19.902461 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d3f01-429b-4b6d-9eb8-efab1f70e22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:19.936309 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-870d3f01-429b-4b6d-9eb8-efab1f70e22b None None] MFA Rules not processed for user `94f87b8e0ff64d1f91897c25139ad4cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:37:19.937536 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-870d3f01-429b-4b6d-9eb8-efab1f70e22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:20.019267 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1291/2590] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:37:19 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:37:20.025107 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab9bca-77c1-465c-ab9a-f13724b1793d service cinder] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:20.026079 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-5cab9bca-77c1-465c-ab9a-f13724b1793d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:20.108702 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab9bca-77c1-465c-ab9a-f13724b1793d service cinder] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:20.114767 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53310f-f736-48d7-891c-4aba20507ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:20.115446 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53310f-f736-48d7-891c-4aba20507ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:20.115729 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53310f-f736-48d7-891c-4aba20507ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:20.116006 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53310f-f736-48d7-891c-4aba20507ce3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:20.116729 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53310f-f736-48d7-891c-4aba20507ce3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:20.118644 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53310f-f736-48d7-891c-4aba20507ce3 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:20.210258 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1300/2591] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:37:20 2021] POST /identity/v3/projects => generated 373 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:37:20.214251 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d3f01-429b-4b6d-9eb8-efab1f70e22b None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:20.225993 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d3f01-429b-4b6d-9eb8-efab1f70e22b None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:20.286026 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48881792-a6ae-4d1d-be1f-d84bc07e91ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:20.286709 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48881792-a6ae-4d1d-be1f-d84bc07e91ce admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:20.286998 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48881792-a6ae-4d1d-be1f-d84bc07e91ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:20.287276 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48881792-a6ae-4d1d-be1f-d84bc07e91ce admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:20.287985 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48881792-a6ae-4d1d-be1f-d84bc07e91ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:20.289934 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48881792-a6ae-4d1d-be1f-d84bc07e91ce admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:20.397637 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1292/2592] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:37:20 2021] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:37:20.402408 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53310f-f736-48d7-891c-4aba20507ce3 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:20.439547 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53310f-f736-48d7-891c-4aba20507ce3 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:20.446996 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029b118-8616-49c5-839b-365b3eae4082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:20.447784 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029b118-8616-49c5-839b-365b3eae4082 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:20.448395 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029b118-8616-49c5-839b-365b3eae4082 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:20.448744 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029b118-8616-49c5-839b-365b3eae4082 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:20.449691 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029b118-8616-49c5-839b-365b3eae4082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:20.451342 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029b118-8616-49c5-839b-365b3eae4082 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:20.462831 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1301/2593] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:37:20 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:37:20.468687 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48881792-a6ae-4d1d-be1f-d84bc07e91ce admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:20.479854 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48881792-a6ae-4d1d-be1f-d84bc07e91ce admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:20.484728 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a116be-0653-4621-abd9-a74b214eb65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:20.486169 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a116be-0653-4621-abd9-a74b214eb65a admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:20.486457 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a116be-0653-4621-abd9-a74b214eb65a admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:20.486750 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a116be-0653-4621-abd9-a74b214eb65a admin admin] PATH_INFO: `/v3/projects/2782edd0ce0e455b825d4fa9efd24221/users/ad7996ccf04f405f859122eb401b2e71/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:20.503280 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a116be-0653-4621-abd9-a74b214eb65a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2782edd0ce0e455b825d4fa9efd24221, user_id=ad7996ccf04f405f859122eb401b2e71, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:20.505948 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a116be-0653-4621-abd9-a74b214eb65a admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:20.563095 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1293/2594] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:37:20 2021] PUT /identity/v3/projects/2782edd0ce0e455b825d4fa9efd24221/users/ad7996ccf04f405f859122eb401b2e71/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:37:20.567059 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029b118-8616-49c5-839b-365b3eae4082 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:20.577541 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029b118-8616-49c5-839b-365b3eae4082 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:20.633797 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9b2e4-5be2-41ad-8608-db2ccadb2d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:20.634389 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9b2e4-5be2-41ad-8608-db2ccadb2d43 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:20.634702 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9b2e4-5be2-41ad-8608-db2ccadb2d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:20.634979 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9b2e4-5be2-41ad-8608-db2ccadb2d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:20.635723 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9b2e4-5be2-41ad-8608-db2ccadb2d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:20.637360 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9b2e4-5be2-41ad-8608-db2ccadb2d43 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:20.647994 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1302/2595] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:37:20 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:37:20.651900 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a116be-0653-4621-abd9-a74b214eb65a admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:20.682613 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a116be-0653-4621-abd9-a74b214eb65a admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:20.682613 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80216914-e351-4967-89f9-dd46d4c8c79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:20.682613 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80216914-e351-4967-89f9-dd46d4c8c79c admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:20.682613 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80216914-e351-4967-89f9-dd46d4c8c79c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:20.683922 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80216914-e351-4967-89f9-dd46d4c8c79c admin admin] PATH_INFO: `/v3/projects/2782edd0ce0e455b825d4fa9efd24221/users/ad7996ccf04f405f859122eb401b2e71/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:20.683922 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80216914-e351-4967-89f9-dd46d4c8c79c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2782edd0ce0e455b825d4fa9efd24221, user_id=ad7996ccf04f405f859122eb401b2e71, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:20.683922 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80216914-e351-4967-89f9-dd46d4c8c79c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:20.693316 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1294/2596] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:37:20 2021] PUT /identity/v3/projects/2782edd0ce0e455b825d4fa9efd24221/users/ad7996ccf04f405f859122eb401b2e71/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:37:26.531872 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf89a98-22bf-48fe-968b-b7d9969e5c0a None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:26.532620 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf89a98-22bf-48fe-968b-b7d9969e5c0a None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:26.532729 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf89a98-22bf-48fe-968b-b7d9969e5c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:26.560570 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-0cf89a98-22bf-48fe-968b-b7d9969e5c0a None None] MFA Rules not processed for user `ad7996ccf04f405f859122eb401b2e71`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:37:26.561724 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-0cf89a98-22bf-48fe-968b-b7d9969e5c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:26.653227 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1303/2597] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:37:26 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:37:26.661963 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80216914-e351-4967-89f9-dd46d4c8c79c admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:26.665127 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-80216914-e351-4967-89f9-dd46d4c8c79c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:26.750441 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80216914-e351-4967-89f9-dd46d4c8c79c admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:26.756332 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dc54c-08d9-4bbd-801c-54f8c342020c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:26.756994 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dc54c-08d9-4bbd-801c-54f8c342020c service nova] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:26.757278 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dc54c-08d9-4bbd-801c-54f8c342020c service nova] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:26.757604 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dc54c-08d9-4bbd-801c-54f8c342020c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:26.818242 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2dc54c-08d9-4bbd-801c-54f8c342020c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:26.819807 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2dc54c-08d9-4bbd-801c-54f8c342020c service nova] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:26.829643 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1295/2598] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:37:26 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:37:29.363511 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d59d1-e75f-442d-ad34-726a3e45ec1f None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:29.364015 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d59d1-e75f-442d-ad34-726a3e45ec1f None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:29.364132 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d59d1-e75f-442d-ad34-726a3e45ec1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:29.381356 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-372d59d1-e75f-442d-ad34-726a3e45ec1f None None] MFA Rules not processed for user `94f87b8e0ff64d1f91897c25139ad4cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:37:29.382994 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-372d59d1-e75f-442d-ad34-726a3e45ec1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:29.389612 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1304/2599] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:37:29 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:37:43.820820 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dc54c-08d9-4bbd-801c-54f8c342020c service nova] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:43.885336 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dc54c-08d9-4bbd-801c-54f8c342020c service nova] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:43.891358 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b72be8-f30f-444f-8b6d-a0473bf6e365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:43.892100 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b72be8-f30f-444f-8b6d-a0473bf6e365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:43.892382 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b72be8-f30f-444f-8b6d-a0473bf6e365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:43.892655 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b72be8-f30f-444f-8b6d-a0473bf6e365 admin admin] PATH_INFO: `/v3/users/c9f55377c4d54c56aa2188ccba1cc875` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:43.895963 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b72be8-f30f-444f-8b6d-a0473bf6e365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9f55377c4d54c56aa2188ccba1cc875)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:43.896348 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b72be8-f30f-444f-8b6d-a0473bf6e365 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:44.071627 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-e5b72be8-f30f-444f-8b6d-a0473bf6e365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9f55377c4d54c56aa2188ccba1cc875'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:44.072579 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-e5b72be8-f30f-444f-8b6d-a0473bf6e365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9f55377c4d54c56aa2188ccba1cc875'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:44.079249 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-e5b72be8-f30f-444f-8b6d-a0473bf6e365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9f55377c4d54c56aa2188ccba1cc875'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:44.079887 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-e5b72be8-f30f-444f-8b6d-a0473bf6e365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9f55377c4d54c56aa2188ccba1cc875'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:44.092501 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-e5b72be8-f30f-444f-8b6d-a0473bf6e365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9f55377c4d54c56aa2188ccba1cc875'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:44.176106 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1296/2600] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:37:43 2021] DELETE /identity/v3/users/c9f55377c4d54c56aa2188ccba1cc875 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:37:44.178097 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9214360-667a-4e2b-8601-5fc7891b0975 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:44.178551 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9214360-667a-4e2b-8601-5fc7891b0975 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:44.178551 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9214360-667a-4e2b-8601-5fc7891b0975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:44.206795 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-d9214360-667a-4e2b-8601-5fc7891b0975 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:37:44.208081 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-d9214360-667a-4e2b-8601-5fc7891b0975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:44.298273 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1305/2601] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:37:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:37:44.306524 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b72be8-f30f-444f-8b6d-a0473bf6e365 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:44.308193 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-e5b72be8-f30f-444f-8b6d-a0473bf6e365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:44.368469 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b72be8-f30f-444f-8b6d-a0473bf6e365 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:44.372630 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab48c5-84ac-4549-896a-21618daf28bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:44.373278 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab48c5-84ac-4549-896a-21618daf28bb service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:44.373595 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab48c5-84ac-4549-896a-21618daf28bb service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:44.373864 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab48c5-84ac-4549-896a-21618daf28bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:44.388091 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab48c5-84ac-4549-896a-21618daf28bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:44.388091 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab48c5-84ac-4549-896a-21618daf28bb service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:44.397748 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1297/2602] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:37:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:37:44.933311 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9214360-667a-4e2b-8601-5fc7891b0975 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:44.934796 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-d9214360-667a-4e2b-8601-5fc7891b0975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:44.964908 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9214360-667a-4e2b-8601-5fc7891b0975 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:44.969704 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c8068-0be3-4f3e-abad-ba4c6cf98200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:44.970657 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c8068-0be3-4f3e-abad-ba4c6cf98200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:44.971090 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c8068-0be3-4f3e-abad-ba4c6cf98200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:44.971503 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c8068-0be3-4f3e-abad-ba4c6cf98200 admin admin] PATH_INFO: `/v3/projects/6ad465310286400ca50d99ed32f6a4bc` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:44.973033 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c8068-0be3-4f3e-abad-ba4c6cf98200 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ad465310286400ca50d99ed32f6a4bc)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:44.975027 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c8068-0be3-4f3e-abad-ba4c6cf98200 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:45.097631 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-c49c8068-0be3-4f3e-abad-ba4c6cf98200 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ad465310286400ca50d99ed32f6a4bc', 'request_id': 'req-c49c8068-0be3-4f3e-abad-ba4c6cf98200'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:45.103103 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-c49c8068-0be3-4f3e-abad-ba4c6cf98200 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ad465310286400ca50d99ed32f6a4bc', 'request_id': 'req-c49c8068-0be3-4f3e-abad-ba4c6cf98200'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:45.111246 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-c49c8068-0be3-4f3e-abad-ba4c6cf98200 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ad465310286400ca50d99ed32f6a4bc', 'request_id': 'req-c49c8068-0be3-4f3e-abad-ba4c6cf98200'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:45.190042 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-c49c8068-0be3-4f3e-abad-ba4c6cf98200 admin admin] The token cache is being invalidate because project 6ad465310286400ca50d99ed32f6a4bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:37:45.197097 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-c49c8068-0be3-4f3e-abad-ba4c6cf98200 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:45.197097 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-c49c8068-0be3-4f3e-abad-ba4c6cf98200 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:37:45.197097 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1306/2603] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:37:44 2021] DELETE /identity/v3/projects/6ad465310286400ca50d99ed32f6a4bc => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:37:45.200366 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdd841-ce6d-4841-a22b-15f4c19994b8 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:45.200810 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdd841-ce6d-4841-a22b-15f4c19994b8 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:45.200920 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdd841-ce6d-4841-a22b-15f4c19994b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:45.219628 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-20cdd841-ce6d-4841-a22b-15f4c19994b8 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:37:45.220836 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-20cdd841-ce6d-4841-a22b-15f4c19994b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:45.280503 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1298/2604] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:37:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:37:45.288257 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce9aeb-d32f-4b00-bd59-522a4cba6ac2 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:45.288552 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce9aeb-d32f-4b00-bd59-522a4cba6ac2 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:45.288835 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce9aeb-d32f-4b00-bd59-522a4cba6ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:45.307609 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-8fce9aeb-d32f-4b00-bd59-522a4cba6ac2 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:37:45.308821 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-8fce9aeb-d32f-4b00-bd59-522a4cba6ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:45.319015 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1307/2605] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:37:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:37:45.324954 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdd841-ce6d-4841-a22b-15f4c19994b8 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:45.335374 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdd841-ce6d-4841-a22b-15f4c19994b8 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:45.340316 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ba53e-1316-40f3-bde9-689e2d9bdd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:45.346100 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ba53e-1316-40f3-bde9-689e2d9bdd7e admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:45.346100 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ba53e-1316-40f3-bde9-689e2d9bdd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:45.346100 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ba53e-1316-40f3-bde9-689e2d9bdd7e admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:45.346100 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ba53e-1316-40f3-bde9-689e2d9bdd7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:37:45.346100 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ba53e-1316-40f3-bde9-689e2d9bdd7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:45.346100 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ba53e-1316-40f3-bde9-689e2d9bdd7e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:45.357013 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1299/2606] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:37:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:37:45.361221 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce9aeb-d32f-4b00-bd59-522a4cba6ac2 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:45.371025 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce9aeb-d32f-4b00-bd59-522a4cba6ac2 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:45.377639 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc292006-478f-445a-9ebb-09ce0baff1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:45.377639 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc292006-478f-445a-9ebb-09ce0baff1de admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:45.377639 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc292006-478f-445a-9ebb-09ce0baff1de admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:45.377639 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc292006-478f-445a-9ebb-09ce0baff1de admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:45.378627 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc292006-478f-445a-9ebb-09ce0baff1de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:45.380392 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc292006-478f-445a-9ebb-09ce0baff1de admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:45.449285 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1308/2607] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:37:45 2021] POST /identity/v3/projects => generated 383 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:37:45.453566 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ba53e-1316-40f3-bde9-689e2d9bdd7e admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:45.464023 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ba53e-1316-40f3-bde9-689e2d9bdd7e admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:45.519593 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111283a-d296-4bf3-bb1a-86de4bd27c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:45.520344 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111283a-d296-4bf3-bb1a-86de4bd27c50 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:45.520630 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111283a-d296-4bf3-bb1a-86de4bd27c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:45.520908 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111283a-d296-4bf3-bb1a-86de4bd27c50 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:45.521648 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111283a-d296-4bf3-bb1a-86de4bd27c50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:45.523545 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111283a-d296-4bf3-bb1a-86de4bd27c50 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:45.630593 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1300/2608] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:37:45 2021] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:37:45.634669 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc292006-478f-445a-9ebb-09ce0baff1de admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:45.645659 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc292006-478f-445a-9ebb-09ce0baff1de admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:45.650440 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ee69c-c4ee-40ad-a1b6-4fbe4e4ee158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:45.651092 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ee69c-c4ee-40ad-a1b6-4fbe4e4ee158 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:45.651375 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ee69c-c4ee-40ad-a1b6-4fbe4e4ee158 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:45.651650 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ee69c-c4ee-40ad-a1b6-4fbe4e4ee158 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:45.652395 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ee69c-c4ee-40ad-a1b6-4fbe4e4ee158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:45.654025 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ee69c-c4ee-40ad-a1b6-4fbe4e4ee158 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:45.664570 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1309/2609] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:37:45 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:37:45.668551 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111283a-d296-4bf3-bb1a-86de4bd27c50 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:45.679248 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111283a-d296-4bf3-bb1a-86de4bd27c50 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:45.683793 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadd19c-7f75-43ef-8bfd-16d1b7da51fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:45.684440 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadd19c-7f75-43ef-8bfd-16d1b7da51fb admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:45.684723 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadd19c-7f75-43ef-8bfd-16d1b7da51fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:45.684997 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadd19c-7f75-43ef-8bfd-16d1b7da51fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:45.685779 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaadd19c-7f75-43ef-8bfd-16d1b7da51fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:45.687352 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaadd19c-7f75-43ef-8bfd-16d1b7da51fb admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:45.698524 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1301/2610] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:37:45 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:37:45.702555 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ee69c-c4ee-40ad-a1b6-4fbe4e4ee158 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:45.712913 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ee69c-c4ee-40ad-a1b6-4fbe4e4ee158 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:45.717748 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b9a547-2332-4926-b760-972b81838d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:45.718622 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9a547-2332-4926-b760-972b81838d2c admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:45.718902 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9a547-2332-4926-b760-972b81838d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:45.719172 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9a547-2332-4926-b760-972b81838d2c admin admin] PATH_INFO: `/v3/projects/ed0d906c96b540a7b11d508615543890/users/f2e25bf447bf4b018e51ce45fbef64ac/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:45.734059 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b9a547-2332-4926-b760-972b81838d2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed0d906c96b540a7b11d508615543890, user_id=f2e25bf447bf4b018e51ce45fbef64ac, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:45.736646 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b9a547-2332-4926-b760-972b81838d2c admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:45.852705 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1310/2611] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:37:45 2021] PUT /identity/v3/projects/ed0d906c96b540a7b11d508615543890/users/f2e25bf447bf4b018e51ce45fbef64ac/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:37:45.857763 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96830a-a6d9-499b-ad95-44696f2415e7 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:45.858110 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96830a-a6d9-499b-ad95-44696f2415e7 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:45.858392 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96830a-a6d9-499b-ad95-44696f2415e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:45.877603 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-8d96830a-a6d9-499b-ad95-44696f2415e7 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:37:45.878881 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-8d96830a-a6d9-499b-ad95-44696f2415e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:45.936725 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1302/2612] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:37:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:37:45.949366 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b9a547-2332-4926-b760-972b81838d2c admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:45.951252 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-92b9a547-2332-4926-b760-972b81838d2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:46.018168 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b9a547-2332-4926-b760-972b81838d2c admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:46.024534 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66069f54-6233-40b3-b804-17f01292796b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:46.026186 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66069f54-6233-40b3-b804-17f01292796b service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:46.026756 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66069f54-6233-40b3-b804-17f01292796b service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:46.027042 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66069f54-6233-40b3-b804-17f01292796b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:46.038358 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66069f54-6233-40b3-b804-17f01292796b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:46.039780 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66069f54-6233-40b3-b804-17f01292796b service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:46.050414 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1311/2613] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:37:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:37:51.733350 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dcd2e-3e98-46b5-b5b2-761f0f3a5789 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:51.733866 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dcd2e-3e98-46b5-b5b2-761f0f3a5789 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:51.733951 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dcd2e-3e98-46b5-b5b2-761f0f3a5789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:51.762180 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-b98dcd2e-3e98-46b5-b5b2-761f0f3a5789 None None] MFA Rules not processed for user `f2e25bf447bf4b018e51ce45fbef64ac`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:37:51.764196 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-b98dcd2e-3e98-46b5-b5b2-761f0f3a5789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:51.835755 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1303/2614] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:37:51 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:37:51.840227 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66069f54-6233-40b3-b804-17f01292796b service neutron] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:51.850225 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66069f54-6233-40b3-b804-17f01292796b service neutron] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:51.854832 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f86ef-1532-440f-b786-e22789e7b4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:51.855562 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f86ef-1532-440f-b786-e22789e7b4aa admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:51.855907 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f86ef-1532-440f-b786-e22789e7b4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:51.856244 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f86ef-1532-440f-b786-e22789e7b4aa admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:51.857023 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29f86ef-1532-440f-b786-e22789e7b4aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:51.859005 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29f86ef-1532-440f-b786-e22789e7b4aa admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:51.951042 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1312/2615] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:37:51 2021] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:37:51.955135 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98dcd2e-3e98-46b5-b5b2-761f0f3a5789 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:51.966980 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98dcd2e-3e98-46b5-b5b2-761f0f3a5789 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:52.024795 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8587be5-01f6-4bf2-9bc5-453c9b5815bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:52.025876 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8587be5-01f6-4bf2-9bc5-453c9b5815bb admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:52.026167 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8587be5-01f6-4bf2-9bc5-453c9b5815bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:52.026443 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8587be5-01f6-4bf2-9bc5-453c9b5815bb admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:52.027179 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8587be5-01f6-4bf2-9bc5-453c9b5815bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:52.029492 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8587be5-01f6-4bf2-9bc5-453c9b5815bb admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:52.102910 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1304/2616] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:37:51 2021] POST /identity/v3/users => generated 299 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:37:52.107078 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f86ef-1532-440f-b786-e22789e7b4aa admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:52.117834 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f86ef-1532-440f-b786-e22789e7b4aa admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:52.122613 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99d8bb-42be-4c3d-b956-bc6615dd63ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:52.123279 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99d8bb-42be-4c3d-b956-bc6615dd63ff admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:52.123559 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99d8bb-42be-4c3d-b956-bc6615dd63ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:52.123839 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99d8bb-42be-4c3d-b956-bc6615dd63ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:52.124575 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99d8bb-42be-4c3d-b956-bc6615dd63ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:52.126318 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99d8bb-42be-4c3d-b956-bc6615dd63ff admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:52.138269 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1313/2617] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:37:52 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:37:52.142115 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8587be5-01f6-4bf2-9bc5-453c9b5815bb admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:52.152511 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8587be5-01f6-4bf2-9bc5-453c9b5815bb admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:52.157123 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5ad98-8df9-4649-9c2a-def51ac134a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:52.158123 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5ad98-8df9-4649-9c2a-def51ac134a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:52.158401 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5ad98-8df9-4649-9c2a-def51ac134a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:52.158706 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5ad98-8df9-4649-9c2a-def51ac134a9 admin admin] PATH_INFO: `/v3/projects/ce37dcbb36ad436fbb4c75aff35bbebf/users/dbf3bce8afdf4a1abb7541c22082480d/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:52.178384 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e5ad98-8df9-4649-9c2a-def51ac134a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce37dcbb36ad436fbb4c75aff35bbebf, user_id=dbf3bce8afdf4a1abb7541c22082480d, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:52.180995 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e5ad98-8df9-4649-9c2a-def51ac134a9 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:52.234455 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1305/2618] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:37:52 2021] PUT /identity/v3/projects/ce37dcbb36ad436fbb4c75aff35bbebf/users/dbf3bce8afdf4a1abb7541c22082480d/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:37:52.244314 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99d8bb-42be-4c3d-b956-bc6615dd63ff admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:52.254617 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99d8bb-42be-4c3d-b956-bc6615dd63ff admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:52.311661 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc804ce-8fdd-4b02-8070-1f8ad6c5f479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:52.312447 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc804ce-8fdd-4b02-8070-1f8ad6c5f479 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:52.312818 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc804ce-8fdd-4b02-8070-1f8ad6c5f479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:52.313181 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc804ce-8fdd-4b02-8070-1f8ad6c5f479 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:52.314055 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc804ce-8fdd-4b02-8070-1f8ad6c5f479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:52.315783 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc804ce-8fdd-4b02-8070-1f8ad6c5f479 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:52.326295 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1314/2619] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:37:52 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:37:52.334447 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5ad98-8df9-4649-9c2a-def51ac134a9 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:52.344928 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5ad98-8df9-4649-9c2a-def51ac134a9 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:52.350551 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f93bf-6c09-49a2-ab8a-653576084fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:52.351641 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f93bf-6c09-49a2-ab8a-653576084fde admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:52.351929 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f93bf-6c09-49a2-ab8a-653576084fde admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:52.352373 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f93bf-6c09-49a2-ab8a-653576084fde admin admin] PATH_INFO: `/v3/projects/ce37dcbb36ad436fbb4c75aff35bbebf/users/dbf3bce8afdf4a1abb7541c22082480d/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:52.354462 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f93bf-6c09-49a2-ab8a-653576084fde admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce37dcbb36ad436fbb4c75aff35bbebf, user_id=dbf3bce8afdf4a1abb7541c22082480d, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:52.357074 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f93bf-6c09-49a2-ab8a-653576084fde admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:52.369957 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1306/2620] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:37:52 2021] PUT /identity/v3/projects/ce37dcbb36ad436fbb4c75aff35bbebf/users/dbf3bce8afdf4a1abb7541c22082480d/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:37:57.907150 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852bbdf8-0916-49ee-a3a6-8a8bb88dccb5 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:57.907553 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852bbdf8-0916-49ee-a3a6-8a8bb88dccb5 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:57.907938 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852bbdf8-0916-49ee-a3a6-8a8bb88dccb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:57.936753 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-852bbdf8-0916-49ee-a3a6-8a8bb88dccb5 None None] MFA Rules not processed for user `dbf3bce8afdf4a1abb7541c22082480d`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:37:57.938026 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-852bbdf8-0916-49ee-a3a6-8a8bb88dccb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:58.035340 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1315/2621] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:37:57 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:37:58.048568 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f93bf-6c09-49a2-ab8a-653576084fde admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:58.051408 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-0e6f93bf-6c09-49a2-ab8a-653576084fde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:58.148903 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f93bf-6c09-49a2-ab8a-653576084fde admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:58.153149 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08742f0-82b9-4517-aa0f-05114cf36260 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '544443ed44ef41bcaa86af52926bfd14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:58.153919 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08742f0-82b9-4517-aa0f-05114cf36260 service glance] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:58.154264 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08742f0-82b9-4517-aa0f-05114cf36260 service glance] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:58.154620 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08742f0-82b9-4517-aa0f-05114cf36260 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:58.254519 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08742f0-82b9-4517-aa0f-05114cf36260 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:58.255995 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08742f0-82b9-4517-aa0f-05114cf36260 service glance] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:58.270325 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1307/2622] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:37:58 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:37:58.487773 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4c08b-de00-457b-877d-ef65e15b42cf None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:58.488067 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4c08b-de00-457b-877d-ef65e15b42cf None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:58.488352 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4c08b-de00-457b-877d-ef65e15b42cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:58.509613 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-aae4c08b-de00-457b-877d-ef65e15b42cf None None] MFA Rules not processed for user `abc393885c6c4cf6bd4dd52f698fc38c`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:37:58.510876 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-aae4c08b-de00-457b-877d-ef65e15b42cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:58.570240 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1316/2623] 10.222.0.62 () {58 vars in 1009 bytes} [Tue Nov 23 19:37:58 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:37:58.600230 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08742f0-82b9-4517-aa0f-05114cf36260 service glance] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:37:58.601692 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-b08742f0-82b9-4517-aa0f-05114cf36260 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:37:58.708820 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08742f0-82b9-4517-aa0f-05114cf36260 service glance] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:37:58.715263 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c4eae-992b-40d8-a5d3-890abd9e7f62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87b6ed93587a4c87ad5002fc80b985c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:37:58.716012 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c4eae-992b-40d8-a5d3-890abd9e7f62 service swift] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:37:58.716292 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c4eae-992b-40d8-a5d3-890abd9e7f62 service swift] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:37:58.716578 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c4eae-992b-40d8-a5d3-890abd9e7f62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:37:58.727351 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c4eae-992b-40d8-a5d3-890abd9e7f62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:37:58.729629 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c4eae-992b-40d8-a5d3-890abd9e7f62 service swift] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:37:58.739301 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1308/2624] 10.222.0.62 () {60 vars in 1384 bytes} [Tue Nov 23 19:37:58 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:38:11.600277 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c276d-3338-4a27-90df-42bb7c369f0f None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:38:11.600826 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c276d-3338-4a27-90df-42bb7c369f0f None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:38:11.600826 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c276d-3338-4a27-90df-42bb7c369f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:38:11.620118 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-e61c276d-3338-4a27-90df-42bb7c369f0f None None] MFA Rules not processed for user `f2e25bf447bf4b018e51ce45fbef64ac`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:38:11.621383 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-e61c276d-3338-4a27-90df-42bb7c369f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:38:11.635350 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1317/2625] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:38:11 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:38:15.080244 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a278e3-853e-4ba8-86d7-8e215ec14c44 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:38:15.081175 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a278e3-853e-4ba8-86d7-8e215ec14c44 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:38:15.082481 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a278e3-853e-4ba8-86d7-8e215ec14c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:38:15.109058 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-33a278e3-853e-4ba8-86d7-8e215ec14c44 None None] MFA Rules not processed for user `abc393885c6c4cf6bd4dd52f698fc38c`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:38:15.110326 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-33a278e3-853e-4ba8-86d7-8e215ec14c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:38:15.120777 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1309/2626] 10.222.0.62 () {58 vars in 1009 bytes} [Tue Nov 23 19:38:15 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:38:15.138131 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c276d-3338-4a27-90df-42bb7c369f0f None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:38:15.151974 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c276d-3338-4a27-90df-42bb7c369f0f None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:38:15.157575 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f103686-5cad-4349-a0ff-b7f4edf72c9d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87b6ed93587a4c87ad5002fc80b985c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:38:15.161042 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f103686-5cad-4349-a0ff-b7f4edf72c9d service swift] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:38:15.161042 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f103686-5cad-4349-a0ff-b7f4edf72c9d service swift] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:38:15.161042 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f103686-5cad-4349-a0ff-b7f4edf72c9d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:38:15.168915 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f103686-5cad-4349-a0ff-b7f4edf72c9d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:38:15.170543 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f103686-5cad-4349-a0ff-b7f4edf72c9d service swift] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:38:15.179050 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1318/2627] 10.222.0.62 () {60 vars in 1384 bytes} [Tue Nov 23 19:38:15 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:38:16.180911 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a278e3-853e-4ba8-86d7-8e215ec14c44 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:38:16.182488 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-33a278e3-853e-4ba8-86d7-8e215ec14c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:38:16.310783 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a278e3-853e-4ba8-86d7-8e215ec14c44 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:38:16.333663 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d71143-8673-48d9-b545-27daf9d0ce4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:38:16.336091 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d71143-8673-48d9-b545-27daf9d0ce4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:38:16.337633 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d71143-8673-48d9-b545-27daf9d0ce4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:38:16.338111 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d71143-8673-48d9-b545-27daf9d0ce4c admin admin] PATH_INFO: `/v3/users/1c9eae7258ce43f0b7838a82396121d3` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:38:16.341624 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d71143-8673-48d9-b545-27daf9d0ce4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c9eae7258ce43f0b7838a82396121d3)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:38:16.346924 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d71143-8673-48d9-b545-27daf9d0ce4c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:38:16.482061 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31392652-c10e-416c-84e0-d0449c27e72f None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:38:16.482599 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31392652-c10e-416c-84e0-d0449c27e72f None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:38:16.482599 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31392652-c10e-416c-84e0-d0449c27e72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:38:16.503394 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-31392652-c10e-416c-84e0-d0449c27e72f None None] MFA Rules not processed for user `8cabe29657c04e1da5b3a13cd2cdf77e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:38:16.504637 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-31392652-c10e-416c-84e0-d0449c27e72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:38:16.580581 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-86d71143-8673-48d9-b545-27daf9d0ce4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c9eae7258ce43f0b7838a82396121d3'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:38:16.581343 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-86d71143-8673-48d9-b545-27daf9d0ce4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c9eae7258ce43f0b7838a82396121d3'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:38:16.589084 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1319/2628] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:38:16 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:38:16.593731 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-86d71143-8673-48d9-b545-27daf9d0ce4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c9eae7258ce43f0b7838a82396121d3'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:38:16.594452 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-86d71143-8673-48d9-b545-27daf9d0ce4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c9eae7258ce43f0b7838a82396121d3'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:38:16.609295 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-86d71143-8673-48d9-b545-27daf9d0ce4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c9eae7258ce43f0b7838a82396121d3'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:38:16.739515 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1310/2629] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:38:16 2021] DELETE /identity/v3/users/1c9eae7258ce43f0b7838a82396121d3 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:38:17.035611 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31392652-c10e-416c-84e0-d0449c27e72f None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:38:17.039011 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-31392652-c10e-416c-84e0-d0449c27e72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:38:17.081656 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31392652-c10e-416c-84e0-d0449c27e72f None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:38:17.164002 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadbe47-4fcc-45ad-bd50-dc1b4d2f3067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:38:17.164854 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadbe47-4fcc-45ad-bd50-dc1b4d2f3067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:38:17.165130 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadbe47-4fcc-45ad-bd50-dc1b4d2f3067 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:38:17.165427 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadbe47-4fcc-45ad-bd50-dc1b4d2f3067 admin admin] PATH_INFO: `/v3/projects/766c6a829b9945cfb36bad289566c0ad` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:38:17.167249 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadbe47-4fcc-45ad-bd50-dc1b4d2f3067 admin admin] RBAC: Authorizing `identity:delete_project(project_id=766c6a829b9945cfb36bad289566c0ad)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:38:17.168713 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadbe47-4fcc-45ad-bd50-dc1b4d2f3067 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:38:17.294833 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-0cadbe47-4fcc-45ad-bd50-dc1b4d2f3067 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '766c6a829b9945cfb36bad289566c0ad', 'request_id': 'req-0cadbe47-4fcc-45ad-bd50-dc1b4d2f3067'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:38:17.304385 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-0cadbe47-4fcc-45ad-bd50-dc1b4d2f3067 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '766c6a829b9945cfb36bad289566c0ad', 'request_id': 'req-0cadbe47-4fcc-45ad-bd50-dc1b4d2f3067'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:38:17.318626 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-0cadbe47-4fcc-45ad-bd50-dc1b4d2f3067 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '766c6a829b9945cfb36bad289566c0ad', 'request_id': 'req-0cadbe47-4fcc-45ad-bd50-dc1b4d2f3067'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:38:17.404216 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-0cadbe47-4fcc-45ad-bd50-dc1b4d2f3067 admin admin] The token cache is being invalidate because project 766c6a829b9945cfb36bad289566c0ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:38:17.404507 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-0cadbe47-4fcc-45ad-bd50-dc1b4d2f3067 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:38:17.405307 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-0cadbe47-4fcc-45ad-bd50-dc1b4d2f3067 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:38:17.408295 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1320/2630] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:38:17 2021] DELETE /identity/v3/projects/766c6a829b9945cfb36bad289566c0ad => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:38:20.008080 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d71143-8673-48d9-b545-27daf9d0ce4c admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:38:20.009558 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-86d71143-8673-48d9-b545-27daf9d0ce4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:38:20.079923 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d71143-8673-48d9-b545-27daf9d0ce4c admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:38:20.129094 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493e101-66d4-4b49-bb1f-97a83d3f566f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:38:20.129774 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493e101-66d4-4b49-bb1f-97a83d3f566f service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:38:20.130051 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493e101-66d4-4b49-bb1f-97a83d3f566f service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:38:20.130327 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493e101-66d4-4b49-bb1f-97a83d3f566f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:38:20.132069 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-9493e101-66d4-4b49-bb1f-97a83d3f566f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:38:20.200732 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493e101-66d4-4b49-bb1f-97a83d3f566f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:38:20.202205 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493e101-66d4-4b49-bb1f-97a83d3f566f service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:38:20.213886 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1311/2631] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:38:20 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:38:26.213139 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadbe47-4fcc-45ad-bd50-dc1b4d2f3067 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:38:26.214912 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-0cadbe47-4fcc-45ad-bd50-dc1b4d2f3067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:38:26.230966 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadbe47-4fcc-45ad-bd50-dc1b4d2f3067 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:38:26.235360 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a9fa8-fd5d-4db7-a119-334d2106a302 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:38:26.236101 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a9fa8-fd5d-4db7-a119-334d2106a302 service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:38:26.236486 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a9fa8-fd5d-4db7-a119-334d2106a302 service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:38:26.236821 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a9fa8-fd5d-4db7-a119-334d2106a302 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:38:26.238875 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-311a9fa8-fd5d-4db7-a119-334d2106a302 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:38:26.257556 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a9fa8-fd5d-4db7-a119-334d2106a302 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:38:26.259782 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a9fa8-fd5d-4db7-a119-334d2106a302 service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:38:26.281632 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1321/2632] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:38:26 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:38:29.206356 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493e101-66d4-4b49-bb1f-97a83d3f566f service neutron] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:38:29.207994 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-9493e101-66d4-4b49-bb1f-97a83d3f566f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:38:29.219769 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493e101-66d4-4b49-bb1f-97a83d3f566f service neutron] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:38:29.224305 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac2e45-d52d-4a99-89b2-f6867d6abffb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:38:29.225057 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac2e45-d52d-4a99-89b2-f6867d6abffb service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:38:29.225571 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac2e45-d52d-4a99-89b2-f6867d6abffb service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:38:29.225914 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac2e45-d52d-4a99-89b2-f6867d6abffb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:38:29.227997 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-62ac2e45-d52d-4a99-89b2-f6867d6abffb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:38:29.320219 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac2e45-d52d-4a99-89b2-f6867d6abffb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:38:29.360238 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac2e45-d52d-4a99-89b2-f6867d6abffb service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:38:29.360238 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1312/2633] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:38:29 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:38:29.652207 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a9fa8-fd5d-4db7-a119-334d2106a302 service neutron] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:38:29.653808 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-311a9fa8-fd5d-4db7-a119-334d2106a302 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:38:29.668498 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a9fa8-fd5d-4db7-a119-334d2106a302 service neutron] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:38:29.676339 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fccbe5-53a8-47ad-b248-ed9e97c9d249 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:38:29.676950 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fccbe5-53a8-47ad-b248-ed9e97c9d249 service nova] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:38:29.677230 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fccbe5-53a8-47ad-b248-ed9e97c9d249 service nova] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:38:29.677606 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fccbe5-53a8-47ad-b248-ed9e97c9d249 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:38:29.679407 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-83fccbe5-53a8-47ad-b248-ed9e97c9d249 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:38:29.747108 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fccbe5-53a8-47ad-b248-ed9e97c9d249 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:38:29.748875 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fccbe5-53a8-47ad-b248-ed9e97c9d249 service nova] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:38:29.761548 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1322/2634] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:38:29 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:38:36.784721 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac2e45-d52d-4a99-89b2-f6867d6abffb service neutron] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:38:36.793645 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac2e45-d52d-4a99-89b2-f6867d6abffb service neutron] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:38:36.797586 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df662914-c84a-439c-b177-e7f9b30872ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:38:36.798241 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df662914-c84a-439c-b177-e7f9b30872ea service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:38:36.798532 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df662914-c84a-439c-b177-e7f9b30872ea service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:38:36.798810 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df662914-c84a-439c-b177-e7f9b30872ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:38:36.800552 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-df662914-c84a-439c-b177-e7f9b30872ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:38:36.810691 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df662914-c84a-439c-b177-e7f9b30872ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:38:36.812831 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df662914-c84a-439c-b177-e7f9b30872ea service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:38:36.821998 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1313/2635] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:38:36 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:38:47.998673 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fccbe5-53a8-47ad-b248-ed9e97c9d249 service nova] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:38:48.008191 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fccbe5-53a8-47ad-b248-ed9e97c9d249 service nova] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:38:48.011721 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be221c-0454-44f4-9dd1-5873c43c0a3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:38:48.012409 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be221c-0454-44f4-9dd1-5873c43c0a3d service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:38:48.012686 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be221c-0454-44f4-9dd1-5873c43c0a3d service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:38:48.013026 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be221c-0454-44f4-9dd1-5873c43c0a3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:38:48.014916 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-41be221c-0454-44f4-9dd1-5873c43c0a3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:38:48.076675 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be221c-0454-44f4-9dd1-5873c43c0a3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:38:48.078168 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be221c-0454-44f4-9dd1-5873c43c0a3d service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:38:48.088379 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1323/2636] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:38:47 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:38:50.235478 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df662914-c84a-439c-b177-e7f9b30872ea service neutron] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:38:50.237686 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-df662914-c84a-439c-b177-e7f9b30872ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:38:50.256786 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df662914-c84a-439c-b177-e7f9b30872ea service neutron] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:38:50.260103 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e17e0fa-d5b5-4bcf-bbd0-48a3aa88fd33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:38:50.260833 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17e0fa-d5b5-4bcf-bbd0-48a3aa88fd33 service nova] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:38:50.261184 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17e0fa-d5b5-4bcf-bbd0-48a3aa88fd33 service nova] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:38:50.261545 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17e0fa-d5b5-4bcf-bbd0-48a3aa88fd33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:38:50.263362 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-1e17e0fa-d5b5-4bcf-bbd0-48a3aa88fd33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:38:50.276271 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e17e0fa-d5b5-4bcf-bbd0-48a3aa88fd33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:38:50.278138 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e17e0fa-d5b5-4bcf-bbd0-48a3aa88fd33 service nova] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:38:50.289784 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1314/2637] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:38:50 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:39:33.328337 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be221c-0454-44f4-9dd1-5873c43c0a3d service neutron] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:39:33.342311 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be221c-0454-44f4-9dd1-5873c43c0a3d service neutron] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:39:33.350122 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2a106-64c8-4dff-92b6-32f53e7f4594 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:39:33.350860 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2a106-64c8-4dff-92b6-32f53e7f4594 service nova] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:39:33.351233 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2a106-64c8-4dff-92b6-32f53e7f4594 service nova] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:39:33.351576 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2a106-64c8-4dff-92b6-32f53e7f4594 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:39:33.353650 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-b1d2a106-64c8-4dff-92b6-32f53e7f4594 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:39:33.366706 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d2a106-64c8-4dff-92b6-32f53e7f4594 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:39:33.368503 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d2a106-64c8-4dff-92b6-32f53e7f4594 service nova] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:39:33.380090 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1324/2638] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:39:33 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:39:35.314109 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0d7e3-439f-498f-a728-19a6f68645fa None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:39:35.314618 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0d7e3-439f-498f-a728-19a6f68645fa None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:39:35.314806 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0d7e3-439f-498f-a728-19a6f68645fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:39:35.332930 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-5cf0d7e3-439f-498f-a728-19a6f68645fa None None] MFA Rules not processed for user `ecaf914ba335477182e4e1153d0d3f71`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:39:35.334208 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-5cf0d7e3-439f-498f-a728-19a6f68645fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:39:35.390415 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1315/2639] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:39:35 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:39:35.708464 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2a106-64c8-4dff-92b6-32f53e7f4594 service nova] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:39:35.717476 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2a106-64c8-4dff-92b6-32f53e7f4594 service nova] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:39:35.721024 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45022227-b7ae-4b29-b286-b267a751ef1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:39:35.721701 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45022227-b7ae-4b29-b286-b267a751ef1c service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:39:35.722059 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45022227-b7ae-4b29-b286-b267a751ef1c service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:39:35.722333 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45022227-b7ae-4b29-b286-b267a751ef1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:39:35.724073 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-45022227-b7ae-4b29-b286-b267a751ef1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:39:35.733193 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45022227-b7ae-4b29-b286-b267a751ef1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:39:35.734625 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45022227-b7ae-4b29-b286-b267a751ef1c service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:39:35.742710 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1325/2640] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:39:35 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:39:36.357543 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3559d-01f2-45a0-b519-4d33dcce358d None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:39:36.358049 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3559d-01f2-45a0-b519-4d33dcce358d None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:39:36.358247 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3559d-01f2-45a0-b519-4d33dcce358d None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:39:36.360138 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1316/2641] 10.222.0.62 () {54 vars in 960 bytes} [Tue Nov 23 19:39:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:39:36.366287 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad5939-fa39-4119-b763-aee9acade043 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:39:36.366578 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad5939-fa39-4119-b763-aee9acade043 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:39:36.366857 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad5939-fa39-4119-b763-aee9acade043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:39:36.410313 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-80ad5939-fa39-4119-b763-aee9acade043 None None] MFA Rules not processed for user `d100a378f1ff441080555bfc2ff4d6ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:39:36.411521 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-80ad5939-fa39-4119-b763-aee9acade043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:39:36.471129 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1326/2642] 10.222.0.62 () {58 vars in 1057 bytes} [Tue Nov 23 19:39:36 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:39:36.480010 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3559d-01f2-45a0-b519-4d33dcce358d None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:39:36.493542 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3559d-01f2-45a0-b519-4d33dcce358d None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:39:36.498925 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703d63f-d592-43ec-8bdf-e81f288783ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd100a378f1ff441080555bfc2ff4d6ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:39:36.499688 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703d63f-d592-43ec-8bdf-e81f288783ce service placement] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:39:36.500038 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703d63f-d592-43ec-8bdf-e81f288783ce service placement] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:39:36.500394 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703d63f-d592-43ec-8bdf-e81f288783ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:39:36.502187 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-5703d63f-d592-43ec-8bdf-e81f288783ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:39:36.513891 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703d63f-d592-43ec-8bdf-e81f288783ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:39:36.515462 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703d63f-d592-43ec-8bdf-e81f288783ce service placement] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:39:36.525958 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1317/2643] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:39:36 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:39:46.101655 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943648cd-5068-4472-a135-954beefa6c49 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:39:46.102152 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943648cd-5068-4472-a135-954beefa6c49 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:39:46.102247 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943648cd-5068-4472-a135-954beefa6c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:39:46.120072 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-943648cd-5068-4472-a135-954beefa6c49 None None] MFA Rules not processed for user `abc393885c6c4cf6bd4dd52f698fc38c`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:39:46.121297 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-943648cd-5068-4472-a135-954beefa6c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:39:46.176748 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1327/2644] 10.222.0.62 () {58 vars in 1009 bytes} [Tue Nov 23 19:39:46 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:39:46.218871 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703d63f-d592-43ec-8bdf-e81f288783ce service placement] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:39:46.220266 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-5703d63f-d592-43ec-8bdf-e81f288783ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:39:46.288437 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703d63f-d592-43ec-8bdf-e81f288783ce service placement] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:39:46.293332 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe55c7-1a96-46bc-9c49-f6f1f0ae8b81 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87b6ed93587a4c87ad5002fc80b985c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:39:46.293998 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe55c7-1a96-46bc-9c49-f6f1f0ae8b81 service swift] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:39:46.294282 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe55c7-1a96-46bc-9c49-f6f1f0ae8b81 service swift] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:39:46.294559 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe55c7-1a96-46bc-9c49-f6f1f0ae8b81 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:39:46.302362 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe55c7-1a96-46bc-9c49-f6f1f0ae8b81 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:39:46.303920 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe55c7-1a96-46bc-9c49-f6f1f0ae8b81 service swift] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:39:46.311684 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1318/2645] 10.222.0.62 () {60 vars in 1384 bytes} [Tue Nov 23 19:39:46 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:39:46.732356 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943648cd-5068-4472-a135-954beefa6c49 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:39:46.749725 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943648cd-5068-4472-a135-954beefa6c49 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:39:46.757002 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae0c6f-c13f-4f94-8b59-2f10ba2e487a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:39:46.757768 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae0c6f-c13f-4f94-8b59-2f10ba2e487a service nova] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:39:46.758051 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae0c6f-c13f-4f94-8b59-2f10ba2e487a service nova] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:39:46.758372 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae0c6f-c13f-4f94-8b59-2f10ba2e487a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:39:46.762432 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-9aae0c6f-c13f-4f94-8b59-2f10ba2e487a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:39:46.777762 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae0c6f-c13f-4f94-8b59-2f10ba2e487a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:39:46.779564 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae0c6f-c13f-4f94-8b59-2f10ba2e487a service nova] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:39:46.799611 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1328/2646] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:39:46 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:40:03.327468 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d19d5-1072-4db8-9dc4-2e1fec0b103e None None] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:40:03.328132 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d19d5-1072-4db8-9dc4-2e1fec0b103e None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:40:03.328132 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d19d5-1072-4db8-9dc4-2e1fec0b103e None None] PATH_INFO: `/` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:40:03.329869 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1319/2647] 10.222.0.62 () {54 vars in 921 bytes} [Tue Nov 23 19:40:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 23 19:40:03.337032 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af10324-d925-4c7a-b277-a52d1f8aa728 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:40:03.337573 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af10324-d925-4c7a-b277-a52d1f8aa728 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:40:03.337573 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af10324-d925-4c7a-b277-a52d1f8aa728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:40:03.375333 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-9af10324-d925-4c7a-b277-a52d1f8aa728 None None] MFA Rules not processed for user `6d91fe7f996b48b0bc28e1eadc4f8869`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:40:03.377056 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-9af10324-d925-4c7a-b277-a52d1f8aa728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:40:03.386921 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1329/2648] 10.222.0.62 () {58 vars in 1018 bytes} [Tue Nov 23 19:40:03 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:40:03.404271 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d19d5-1072-4db8-9dc4-2e1fec0b103e None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:40:03.404271 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-727d19d5-1072-4db8-9dc4-2e1fec0b103e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:40:03.459914 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d19d5-1072-4db8-9dc4-2e1fec0b103e None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:40:03.463419 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ecc67-d08f-4ecc-a582-1b5619f7d8aa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '544443ed44ef41bcaa86af52926bfd14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:40:03.464048 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ecc67-d08f-4ecc-a582-1b5619f7d8aa service glance] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:40:03.464329 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ecc67-d08f-4ecc-a582-1b5619f7d8aa service glance] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:40:03.464605 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ecc67-d08f-4ecc-a582-1b5619f7d8aa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:40:03.476600 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ecc67-d08f-4ecc-a582-1b5619f7d8aa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:40:03.478100 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ecc67-d08f-4ecc-a582-1b5619f7d8aa service glance] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:40:03.488635 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1320/2649] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:40:03 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:40:03.686204 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89a337-4926-4266-9344-7b0707bf9110 None None] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:40:03.686489 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89a337-4926-4266-9344-7b0707bf9110 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:40:03.686768 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89a337-4926-4266-9344-7b0707bf9110 None None] PATH_INFO: `/` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:40:03.688593 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1330/2650] 10.222.0.62 () {54 vars in 921 bytes} [Tue Nov 23 19:40:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 23 19:40:03.694923 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a4c84-e252-47a9-955f-3e5190546cae None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:40:03.695212 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a4c84-e252-47a9-955f-3e5190546cae None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:40:03.695493 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a4c84-e252-47a9-955f-3e5190546cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:40:03.713833 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-ee7a4c84-e252-47a9-955f-3e5190546cae None None] MFA Rules not processed for user `f1ef2ac0a788451eb50fa80f559f808f`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:40:03.715034 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-ee7a4c84-e252-47a9-955f-3e5190546cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:40:03.721701 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1321/2651] 10.222.0.62 () {58 vars in 1018 bytes} [Tue Nov 23 19:40:03 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:40:03.733572 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89a337-4926-4266-9344-7b0707bf9110 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:40:03.744803 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89a337-4926-4266-9344-7b0707bf9110 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:40:03.748326 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3a5fd-78e0-4f3b-a6cc-dfdfb376bf8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:40:03.748932 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3a5fd-78e0-4f3b-a6cc-dfdfb376bf8d service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:40:03.749213 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3a5fd-78e0-4f3b-a6cc-dfdfb376bf8d service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:40:03.749525 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3a5fd-78e0-4f3b-a6cc-dfdfb376bf8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:40:03.757432 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3a5fd-78e0-4f3b-a6cc-dfdfb376bf8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:40:03.758851 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3a5fd-78e0-4f3b-a6cc-dfdfb376bf8d service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:40:03.766365 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1331/2652] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:40:03 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:40:06.140388 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445e1cb-6543-40f9-9a84-8576dd50d0e3 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:40:06.140871 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445e1cb-6543-40f9-9a84-8576dd50d0e3 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:40:06.140996 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445e1cb-6543-40f9-9a84-8576dd50d0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:40:06.160126 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-2445e1cb-6543-40f9-9a84-8576dd50d0e3 None None] MFA Rules not processed for user `abc393885c6c4cf6bd4dd52f698fc38c`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:40:06.161296 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-2445e1cb-6543-40f9-9a84-8576dd50d0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:40:06.168787 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1322/2653] 10.222.0.62 () {58 vars in 1009 bytes} [Tue Nov 23 19:40:06 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:40:06.182188 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3a5fd-78e0-4f3b-a6cc-dfdfb376bf8d service neutron] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:40:06.194826 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3a5fd-78e0-4f3b-a6cc-dfdfb376bf8d service neutron] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:40:06.199857 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a4bd5-aaf2-409c-b650-2278bcf3cb5b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87b6ed93587a4c87ad5002fc80b985c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:40:06.200500 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a4bd5-aaf2-409c-b650-2278bcf3cb5b service swift] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:40:06.200787 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a4bd5-aaf2-409c-b650-2278bcf3cb5b service swift] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:40:06.201065 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a4bd5-aaf2-409c-b650-2278bcf3cb5b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:40:06.209788 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a4bd5-aaf2-409c-b650-2278bcf3cb5b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:40:06.211294 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a4bd5-aaf2-409c-b650-2278bcf3cb5b service swift] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:40:06.219136 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1332/2654] 10.222.0.62 () {60 vars in 1384 bytes} [Tue Nov 23 19:40:06 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:40:24.677214 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b4249-1a15-4cf6-b059-f7c1e5bd5264 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:40:24.677774 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b4249-1a15-4cf6-b059-f7c1e5bd5264 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:40:24.677876 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b4249-1a15-4cf6-b059-f7c1e5bd5264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:40:24.695775 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-1c2b4249-1a15-4cf6-b059-f7c1e5bd5264 None None] MFA Rules not processed for user `abc393885c6c4cf6bd4dd52f698fc38c`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:40:24.696961 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-1c2b4249-1a15-4cf6-b059-f7c1e5bd5264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:40:24.704423 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1323/2655] 10.222.0.62 () {58 vars in 967 bytes} [Tue Nov 23 19:40:24 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:40:24.717896 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a4bd5-aaf2-409c-b650-2278bcf3cb5b service swift] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:40:24.728298 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a4bd5-aaf2-409c-b650-2278bcf3cb5b service swift] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:40:24.734135 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713e449-a58c-4cd8-90f3-3736ec634b61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87b6ed93587a4c87ad5002fc80b985c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:40:24.734758 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713e449-a58c-4cd8-90f3-3736ec634b61 service swift] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:40:24.735040 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713e449-a58c-4cd8-90f3-3736ec634b61 service swift] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:40:24.735319 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713e449-a58c-4cd8-90f3-3736ec634b61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:40:24.743162 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713e449-a58c-4cd8-90f3-3736ec634b61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:40:24.744704 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713e449-a58c-4cd8-90f3-3736ec634b61 service swift] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:40:24.752732 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1333/2656] 10.222.0.62 () {60 vars in 1384 bytes} [Tue Nov 23 19:40:24 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:40:34.940601 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d61eb-8dc6-4301-a513-55821f0f0b04 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:40:34.941082 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d61eb-8dc6-4301-a513-55821f0f0b04 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:40:34.941195 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d61eb-8dc6-4301-a513-55821f0f0b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:40:34.959574 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-558d61eb-8dc6-4301-a513-55821f0f0b04 None None] MFA Rules not processed for user `abc393885c6c4cf6bd4dd52f698fc38c`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:40:34.960764 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-558d61eb-8dc6-4301-a513-55821f0f0b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:40:34.967967 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1324/2657] 10.222.0.62 () {58 vars in 967 bytes} [Tue Nov 23 19:40:34 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:40:34.980752 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713e449-a58c-4cd8-90f3-3736ec634b61 service swift] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:40:34.991190 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713e449-a58c-4cd8-90f3-3736ec634b61 service swift] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:40:34.996324 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b292f0b-fbe0-4fd8-9bf4-2f87a55a2771 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87b6ed93587a4c87ad5002fc80b985c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:40:35.000910 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b292f0b-fbe0-4fd8-9bf4-2f87a55a2771 service swift] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:40:35.000910 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b292f0b-fbe0-4fd8-9bf4-2f87a55a2771 service swift] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:40:35.000910 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b292f0b-fbe0-4fd8-9bf4-2f87a55a2771 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:40:35.006384 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b292f0b-fbe0-4fd8-9bf4-2f87a55a2771 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:40:35.008042 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b292f0b-fbe0-4fd8-9bf4-2f87a55a2771 service swift] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:40:35.016656 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1334/2658] 10.222.0.62 () {60 vars in 1384 bytes} [Tue Nov 23 19:40:34 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 23 19:40:44.158837 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d61eb-8dc6-4301-a513-55821f0f0b04 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:40:44.160743 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-558d61eb-8dc6-4301-a513-55821f0f0b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:40:44.231225 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d61eb-8dc6-4301-a513-55821f0f0b04 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:40:44.236530 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc3669-06d6-43f3-8e47-71428e93039a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:40:44.237445 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc3669-06d6-43f3-8e47-71428e93039a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:40:44.237738 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc3669-06d6-43f3-8e47-71428e93039a admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:40:44.238018 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc3669-06d6-43f3-8e47-71428e93039a admin admin] PATH_INFO: `/v3/users/f2e25bf447bf4b018e51ce45fbef64ac` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:40:44.239275 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc3669-06d6-43f3-8e47-71428e93039a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2e25bf447bf4b018e51ce45fbef64ac)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:40:44.241176 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc3669-06d6-43f3-8e47-71428e93039a admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:40:44.403995 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-14fc3669-06d6-43f3-8e47-71428e93039a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2e25bf447bf4b018e51ce45fbef64ac'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:40:44.404675 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-14fc3669-06d6-43f3-8e47-71428e93039a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2e25bf447bf4b018e51ce45fbef64ac'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:40:44.411327 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-14fc3669-06d6-43f3-8e47-71428e93039a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2e25bf447bf4b018e51ce45fbef64ac'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:40:44.411893 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-14fc3669-06d6-43f3-8e47-71428e93039a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2e25bf447bf4b018e51ce45fbef64ac'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:40:44.424021 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-14fc3669-06d6-43f3-8e47-71428e93039a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2e25bf447bf4b018e51ce45fbef64ac'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:40:44.494011 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1325/2659] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:40:44 2021] DELETE /identity/v3/users/f2e25bf447bf4b018e51ce45fbef64ac => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:40:44.696154 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b292f0b-fbe0-4fd8-9bf4-2f87a55a2771 service swift] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:40:44.712907 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b292f0b-fbe0-4fd8-9bf4-2f87a55a2771 service swift] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:40:44.772050 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517db856-c3df-4853-a3d4-1588336a564b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:40:44.772934 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517db856-c3df-4853-a3d4-1588336a564b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:40:44.773218 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517db856-c3df-4853-a3d4-1588336a564b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:40:44.773529 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517db856-c3df-4853-a3d4-1588336a564b admin admin] PATH_INFO: `/v3/projects/ed0d906c96b540a7b11d508615543890` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:40:44.774737 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517db856-c3df-4853-a3d4-1588336a564b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed0d906c96b540a7b11d508615543890)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:40:44.776651 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517db856-c3df-4853-a3d4-1588336a564b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:40:44.882215 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-517db856-c3df-4853-a3d4-1588336a564b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed0d906c96b540a7b11d508615543890', 'request_id': 'req-517db856-c3df-4853-a3d4-1588336a564b'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:40:44.887349 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-517db856-c3df-4853-a3d4-1588336a564b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed0d906c96b540a7b11d508615543890', 'request_id': 'req-517db856-c3df-4853-a3d4-1588336a564b'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:40:44.893443 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-517db856-c3df-4853-a3d4-1588336a564b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed0d906c96b540a7b11d508615543890', 'request_id': 'req-517db856-c3df-4853-a3d4-1588336a564b'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:40:44.949972 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-517db856-c3df-4853-a3d4-1588336a564b admin admin] The token cache is being invalidate because project ed0d906c96b540a7b11d508615543890 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:40:44.950261 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-517db856-c3df-4853-a3d4-1588336a564b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:40:44.950873 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-517db856-c3df-4853-a3d4-1588336a564b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:40:44.953129 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1335/2660] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:40:44 2021] DELETE /identity/v3/projects/ed0d906c96b540a7b11d508615543890 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:40:44.957029 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc3669-06d6-43f3-8e47-71428e93039a admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:40:44.958618 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-14fc3669-06d6-43f3-8e47-71428e93039a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:40:44.972076 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc3669-06d6-43f3-8e47-71428e93039a admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:40:45.026586 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8f197-8e40-4ab0-bc86-7b64700737d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:40:45.027592 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8f197-8e40-4ab0-bc86-7b64700737d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:40:45.027874 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8f197-8e40-4ab0-bc86-7b64700737d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:40:45.028153 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8f197-8e40-4ab0-bc86-7b64700737d3 admin admin] PATH_INFO: `/v3/users/dbf3bce8afdf4a1abb7541c22082480d` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:40:45.029392 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe8f197-8e40-4ab0-bc86-7b64700737d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbf3bce8afdf4a1abb7541c22082480d)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:40:45.031912 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe8f197-8e40-4ab0-bc86-7b64700737d3 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:40:45.192227 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-9fe8f197-8e40-4ab0-bc86-7b64700737d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbf3bce8afdf4a1abb7541c22082480d'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:40:45.192873 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-9fe8f197-8e40-4ab0-bc86-7b64700737d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbf3bce8afdf4a1abb7541c22082480d'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:40:45.199469 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-9fe8f197-8e40-4ab0-bc86-7b64700737d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbf3bce8afdf4a1abb7541c22082480d'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:40:45.200162 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-9fe8f197-8e40-4ab0-bc86-7b64700737d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbf3bce8afdf4a1abb7541c22082480d'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:40:45.211873 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-9fe8f197-8e40-4ab0-bc86-7b64700737d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbf3bce8afdf4a1abb7541c22082480d'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:40:45.271164 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1326/2661] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:40:44 2021] DELETE /identity/v3/users/dbf3bce8afdf4a1abb7541c22082480d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:40:45.484315 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517db856-c3df-4853-a3d4-1588336a564b admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:40:45.485523 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-517db856-c3df-4853-a3d4-1588336a564b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:40:45.503420 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517db856-c3df-4853-a3d4-1588336a564b admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:40:45.559753 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c3f68-888a-46b5-9f6a-c575c7dc8ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:40:45.560603 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c3f68-888a-46b5-9f6a-c575c7dc8ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:40:45.561495 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c3f68-888a-46b5-9f6a-c575c7dc8ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:40:45.561730 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c3f68-888a-46b5-9f6a-c575c7dc8ce7 admin admin] PATH_INFO: `/v3/projects/ce37dcbb36ad436fbb4c75aff35bbebf` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:40:45.563072 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c3f68-888a-46b5-9f6a-c575c7dc8ce7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce37dcbb36ad436fbb4c75aff35bbebf)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:40:45.565199 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c3f68-888a-46b5-9f6a-c575c7dc8ce7 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:40:45.676337 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-1b2c3f68-888a-46b5-9f6a-c575c7dc8ce7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce37dcbb36ad436fbb4c75aff35bbebf', 'request_id': 'req-1b2c3f68-888a-46b5-9f6a-c575c7dc8ce7'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:40:45.681546 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-1b2c3f68-888a-46b5-9f6a-c575c7dc8ce7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce37dcbb36ad436fbb4c75aff35bbebf', 'request_id': 'req-1b2c3f68-888a-46b5-9f6a-c575c7dc8ce7'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:40:45.688003 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-1b2c3f68-888a-46b5-9f6a-c575c7dc8ce7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce37dcbb36ad436fbb4c75aff35bbebf', 'request_id': 'req-1b2c3f68-888a-46b5-9f6a-c575c7dc8ce7'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:40:45.767437 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-1b2c3f68-888a-46b5-9f6a-c575c7dc8ce7 admin admin] The token cache is being invalidate because project ce37dcbb36ad436fbb4c75aff35bbebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:40:45.768058 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-1b2c3f68-888a-46b5-9f6a-c575c7dc8ce7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:40:45.768348 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-1b2c3f68-888a-46b5-9f6a-c575c7dc8ce7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:40:45.770030 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1336/2662] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:40:45 2021] DELETE /identity/v3/projects/ce37dcbb36ad436fbb4c75aff35bbebf => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:41:15.022036 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8f197-8e40-4ab0-bc86-7b64700737d3 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:41:15.023563 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-9fe8f197-8e40-4ab0-bc86-7b64700737d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:41:15.082090 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8f197-8e40-4ab0-bc86-7b64700737d3 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:41:15.129058 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31f573-de23-4134-b0a8-b343d0188b9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:41:15.129738 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31f573-de23-4134-b0a8-b343d0188b9e service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:41:15.130020 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31f573-de23-4134-b0a8-b343d0188b9e service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:41:15.130293 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31f573-de23-4134-b0a8-b343d0188b9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:41:15.132071 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-8b31f573-de23-4134-b0a8-b343d0188b9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:41:15.193587 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31f573-de23-4134-b0a8-b343d0188b9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:41:15.195011 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31f573-de23-4134-b0a8-b343d0188b9e service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:41:15.205477 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1327/2663] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:41:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:41:18.899896 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c3f68-888a-46b5-9f6a-c575c7dc8ce7 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:41:18.902895 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-1b2c3f68-888a-46b5-9f6a-c575c7dc8ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:41:18.915467 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c3f68-888a-46b5-9f6a-c575c7dc8ce7 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:41:18.920363 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f979c-df18-4b97-b699-788b5321e4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:41:18.921237 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f979c-df18-4b97-b699-788b5321e4fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:41:18.921564 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f979c-df18-4b97-b699-788b5321e4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:41:18.921844 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f979c-df18-4b97-b699-788b5321e4fe admin admin] PATH_INFO: `/v3/users/8cabe29657c04e1da5b3a13cd2cdf77e` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:41:18.923084 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f979c-df18-4b97-b699-788b5321e4fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cabe29657c04e1da5b3a13cd2cdf77e)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:41:18.924980 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f979c-df18-4b97-b699-788b5321e4fe admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:41:19.122864 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-e30f979c-df18-4b97-b699-788b5321e4fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cabe29657c04e1da5b3a13cd2cdf77e'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:41:19.123526 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-e30f979c-df18-4b97-b699-788b5321e4fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cabe29657c04e1da5b3a13cd2cdf77e'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:41:19.178258 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-e30f979c-df18-4b97-b699-788b5321e4fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cabe29657c04e1da5b3a13cd2cdf77e'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:41:19.178889 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-e30f979c-df18-4b97-b699-788b5321e4fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cabe29657c04e1da5b3a13cd2cdf77e'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:41:19.191451 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-e30f979c-df18-4b97-b699-788b5321e4fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cabe29657c04e1da5b3a13cd2cdf77e'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:41:19.203574 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1337/2664] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:41:18 2021] DELETE /identity/v3/users/8cabe29657c04e1da5b3a13cd2cdf77e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:41:19.504842 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31f573-de23-4134-b0a8-b343d0188b9e service neutron] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:41:19.516072 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31f573-de23-4134-b0a8-b343d0188b9e service neutron] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:41:19.584184 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ef34e-383d-450e-b06f-bd6914bc063e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:41:19.585042 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ef34e-383d-450e-b06f-bd6914bc063e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:41:19.585323 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ef34e-383d-450e-b06f-bd6914bc063e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:41:19.585674 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ef34e-383d-450e-b06f-bd6914bc063e admin admin] PATH_INFO: `/v3/projects/2d925fb59ba34355aa85758374d76928` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:41:19.586870 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ef34e-383d-450e-b06f-bd6914bc063e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d925fb59ba34355aa85758374d76928)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:41:19.588739 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ef34e-383d-450e-b06f-bd6914bc063e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:41:19.732394 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-118ef34e-383d-450e-b06f-bd6914bc063e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d925fb59ba34355aa85758374d76928', 'request_id': 'req-118ef34e-383d-450e-b06f-bd6914bc063e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:41:19.738555 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-118ef34e-383d-450e-b06f-bd6914bc063e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d925fb59ba34355aa85758374d76928', 'request_id': 'req-118ef34e-383d-450e-b06f-bd6914bc063e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:41:19.743717 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-118ef34e-383d-450e-b06f-bd6914bc063e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d925fb59ba34355aa85758374d76928', 'request_id': 'req-118ef34e-383d-450e-b06f-bd6914bc063e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:41:19.823322 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-118ef34e-383d-450e-b06f-bd6914bc063e admin admin] The token cache is being invalidate because project 2d925fb59ba34355aa85758374d76928 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:41:19.823643 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-118ef34e-383d-450e-b06f-bd6914bc063e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:41:19.824275 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-118ef34e-383d-450e-b06f-bd6914bc063e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:41:19.825833 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1328/2665] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:41:19 2021] DELETE /identity/v3/projects/2d925fb59ba34355aa85758374d76928 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:41:19.832229 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3c1ca-6fe5-4b38-873f-f9b3077cf2df None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:41:19.834302 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3c1ca-6fe5-4b38-873f-f9b3077cf2df None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:41:19.834302 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3c1ca-6fe5-4b38-873f-f9b3077cf2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:41:19.850772 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-14a3c1ca-6fe5-4b38-873f-f9b3077cf2df None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:41:19.852030 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-14a3c1ca-6fe5-4b38-873f-f9b3077cf2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:41:19.910361 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1338/2666] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:41:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:41:19.918408 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e657ca-b245-4842-be98-681105503f7c None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:41:19.918707 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e657ca-b245-4842-be98-681105503f7c None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:41:19.918988 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e657ca-b245-4842-be98-681105503f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:41:19.937679 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-34e657ca-b245-4842-be98-681105503f7c None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:41:19.939123 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-34e657ca-b245-4842-be98-681105503f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:41:19.947108 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1329/2667] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:41:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:41:19.952042 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3c1ca-6fe5-4b38-873f-f9b3077cf2df None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:41:19.961625 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3c1ca-6fe5-4b38-873f-f9b3077cf2df None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:41:19.966179 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa32bc-ff5c-408c-a24c-74761c9d052b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:41:19.966824 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa32bc-ff5c-408c-a24c-74761c9d052b admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:41:19.967163 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa32bc-ff5c-408c-a24c-74761c9d052b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:41:19.967163 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa32bc-ff5c-408c-a24c-74761c9d052b admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:41:19.968117 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa32bc-ff5c-408c-a24c-74761c9d052b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:41:19.968424 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa32bc-ff5c-408c-a24c-74761c9d052b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:41:19.970057 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa32bc-ff5c-408c-a24c-74761c9d052b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:41:19.981093 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1339/2668] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:41:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:41:19.985288 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e657ca-b245-4842-be98-681105503f7c None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:41:19.994363 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e657ca-b245-4842-be98-681105503f7c None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:41:19.999600 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660fed7-7233-435d-a9d7-9e8470803ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:41:20.000245 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660fed7-7233-435d-a9d7-9e8470803ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:41:20.000530 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660fed7-7233-435d-a9d7-9e8470803ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:41:20.000807 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660fed7-7233-435d-a9d7-9e8470803ea1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:41:20.001545 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660fed7-7233-435d-a9d7-9e8470803ea1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:41:20.003429 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660fed7-7233-435d-a9d7-9e8470803ea1 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:41:20.123704 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1330/2669] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:41:19 2021] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:41:20.127788 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa32bc-ff5c-408c-a24c-74761c9d052b admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:41:20.140119 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa32bc-ff5c-408c-a24c-74761c9d052b admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:41:20.198123 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3ab76-50ff-4e8f-84fa-6371e97cb708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:41:20.198789 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3ab76-50ff-4e8f-84fa-6371e97cb708 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:41:20.199068 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3ab76-50ff-4e8f-84fa-6371e97cb708 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:41:20.199343 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3ab76-50ff-4e8f-84fa-6371e97cb708 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:41:20.200070 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3ab76-50ff-4e8f-84fa-6371e97cb708 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:41:20.203146 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3ab76-50ff-4e8f-84fa-6371e97cb708 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:41:20.299056 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1340/2670] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:41:20 2021] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:41:20.303120 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660fed7-7233-435d-a9d7-9e8470803ea1 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:41:20.314505 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660fed7-7233-435d-a9d7-9e8470803ea1 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:41:20.319144 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ce202-ace2-4bb8-9372-41cbdb5e437e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:41:20.319798 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ce202-ace2-4bb8-9372-41cbdb5e437e admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:41:20.320100 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ce202-ace2-4bb8-9372-41cbdb5e437e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:41:20.320375 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ce202-ace2-4bb8-9372-41cbdb5e437e admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:41:20.321111 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ce202-ace2-4bb8-9372-41cbdb5e437e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:41:20.322729 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ce202-ace2-4bb8-9372-41cbdb5e437e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:41:20.332987 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1331/2671] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:41:20 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:41:20.336950 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3ab76-50ff-4e8f-84fa-6371e97cb708 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:41:20.347039 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3ab76-50ff-4e8f-84fa-6371e97cb708 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:41:20.351847 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb56702-729b-454b-80e5-2f95b5269039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:41:20.352498 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb56702-729b-454b-80e5-2f95b5269039 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:41:20.352783 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb56702-729b-454b-80e5-2f95b5269039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:41:20.353061 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb56702-729b-454b-80e5-2f95b5269039 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:41:20.353891 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb56702-729b-454b-80e5-2f95b5269039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:41:20.355454 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb56702-729b-454b-80e5-2f95b5269039 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:41:20.365973 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1341/2672] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:41:20 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:41:20.370237 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ce202-ace2-4bb8-9372-41cbdb5e437e admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:41:20.381197 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ce202-ace2-4bb8-9372-41cbdb5e437e admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:41:20.385754 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d46263-e0a6-488b-ac4b-9e369d31410e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:41:20.386620 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d46263-e0a6-488b-ac4b-9e369d31410e admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:41:20.386900 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d46263-e0a6-488b-ac4b-9e369d31410e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:41:20.387176 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d46263-e0a6-488b-ac4b-9e369d31410e admin admin] PATH_INFO: `/v3/projects/e738acf03acd4f9d90b4dc46fb48bb06/users/3df4695a2e3645f0b08aaae98d9025eb/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:41:20.401934 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d46263-e0a6-488b-ac4b-9e369d31410e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e738acf03acd4f9d90b4dc46fb48bb06, user_id=3df4695a2e3645f0b08aaae98d9025eb, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:41:20.404621 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d46263-e0a6-488b-ac4b-9e369d31410e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:41:20.463918 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1332/2673] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:41:20 2021] PUT /identity/v3/projects/e738acf03acd4f9d90b4dc46fb48bb06/users/3df4695a2e3645f0b08aaae98d9025eb/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:41:20.469077 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545702f5-932a-4391-890f-68d091c56b4c None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:41:20.471882 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545702f5-932a-4391-890f-68d091c56b4c None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:41:20.471882 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545702f5-932a-4391-890f-68d091c56b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:41:20.488243 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-545702f5-932a-4391-890f-68d091c56b4c None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:41:20.489513 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-545702f5-932a-4391-890f-68d091c56b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:41:20.547883 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1342/2674] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:41:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:41:20.557790 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d46263-e0a6-488b-ac4b-9e369d31410e admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:41:20.559493 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-83d46263-e0a6-488b-ac4b-9e369d31410e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:41:20.617935 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d46263-e0a6-488b-ac4b-9e369d31410e admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:41:20.621642 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71a076-f1ea-4cfb-adfa-41e295dc34d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:41:20.622386 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71a076-f1ea-4cfb-adfa-41e295dc34d4 service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:41:20.622731 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71a076-f1ea-4cfb-adfa-41e295dc34d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:41:20.623072 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71a076-f1ea-4cfb-adfa-41e295dc34d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:41:20.633122 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b71a076-f1ea-4cfb-adfa-41e295dc34d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:41:20.634591 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b71a076-f1ea-4cfb-adfa-41e295dc34d4 service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:41:20.644680 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1333/2675] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:41:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:41:21.763094 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec34fba-73ee-4671-988c-7f6d3f207dd9 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:41:21.763555 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec34fba-73ee-4671-988c-7f6d3f207dd9 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:41:21.763668 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec34fba-73ee-4671-988c-7f6d3f207dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:41:21.798832 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-7ec34fba-73ee-4671-988c-7f6d3f207dd9 None None] MFA Rules not processed for user `3df4695a2e3645f0b08aaae98d9025eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:41:21.800151 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-7ec34fba-73ee-4671-988c-7f6d3f207dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:41:21.887446 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1343/2676] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:41:21 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:41:21.888742 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076700e7-6d63-4f0c-a3ba-7c1962a8cfde None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:41:21.889827 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076700e7-6d63-4f0c-a3ba-7c1962a8cfde None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:41:21.889933 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076700e7-6d63-4f0c-a3ba-7c1962a8cfde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:41:21.918608 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-076700e7-6d63-4f0c-a3ba-7c1962a8cfde None None] MFA Rules not processed for user `3df4695a2e3645f0b08aaae98d9025eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:41:21.920773 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-076700e7-6d63-4f0c-a3ba-7c1962a8cfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:41:21.942099 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1334/2677] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:41:21 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:41:21.949538 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec34fba-73ee-4671-988c-7f6d3f207dd9 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:41:21.951201 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-7ec34fba-73ee-4671-988c-7f6d3f207dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:41:22.032207 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec34fba-73ee-4671-988c-7f6d3f207dd9 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:41:22.038312 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459c33e-4432-40c9-bbb2-379dfa0c1a22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:41:22.038967 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459c33e-4432-40c9-bbb2-379dfa0c1a22 service nova] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:41:22.039252 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459c33e-4432-40c9-bbb2-379dfa0c1a22 service nova] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:41:22.039528 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459c33e-4432-40c9-bbb2-379dfa0c1a22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:41:22.048367 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459c33e-4432-40c9-bbb2-379dfa0c1a22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:41:22.050073 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459c33e-4432-40c9-bbb2-379dfa0c1a22 service nova] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:41:22.059575 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1344/2678] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:41:21 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:41:22.417059 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076700e7-6d63-4f0c-a3ba-7c1962a8cfde None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:41:22.418629 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-076700e7-6d63-4f0c-a3ba-7c1962a8cfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:41:22.430511 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076700e7-6d63-4f0c-a3ba-7c1962a8cfde None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:41:22.436479 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977b4d2-5815-45b7-a80d-3b825518a83e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:41:22.436479 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977b4d2-5815-45b7-a80d-3b825518a83e service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:41:22.436479 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977b4d2-5815-45b7-a80d-3b825518a83e service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:41:22.436479 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977b4d2-5815-45b7-a80d-3b825518a83e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:41:22.438313 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-3977b4d2-5815-45b7-a80d-3b825518a83e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:41:22.448208 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3977b4d2-5815-45b7-a80d-3b825518a83e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:41:22.449664 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3977b4d2-5815-45b7-a80d-3b825518a83e service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:41:22.458481 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1335/2679] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:41:22 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:41:27.489025 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb68da3-1762-43fd-a319-6293aebe7410 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:41:27.489518 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb68da3-1762-43fd-a319-6293aebe7410 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:41:27.489620 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb68da3-1762-43fd-a319-6293aebe7410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:41:27.507377 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-9bb68da3-1762-43fd-a319-6293aebe7410 None None] MFA Rules not processed for user `97620b529cf8418da91d58596ef4c808`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:41:27.511423 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-9bb68da3-1762-43fd-a319-6293aebe7410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:41:27.565000 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1345/2680] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:41:27 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:41:45.922887 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bb224-4b6f-421a-9e0b-c6efcf027778 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:41:45.923454 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bb224-4b6f-421a-9e0b-c6efcf027778 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:41:45.923454 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bb224-4b6f-421a-9e0b-c6efcf027778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:41:45.941128 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-f37bb224-4b6f-421a-9e0b-c6efcf027778 None None] MFA Rules not processed for user `3df4695a2e3645f0b08aaae98d9025eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:41:45.942340 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-f37bb224-4b6f-421a-9e0b-c6efcf027778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:41:45.949211 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1336/2681] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:41:45 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:41:47.508953 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb68da3-1762-43fd-a319-6293aebe7410 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:41:47.510387 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-9bb68da3-1762-43fd-a319-6293aebe7410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:41:47.581729 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb68da3-1762-43fd-a319-6293aebe7410 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:41:47.586758 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e00d2a-203f-4abb-a553-ddb5b1f1bb43 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd100a378f1ff441080555bfc2ff4d6ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:41:47.587407 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e00d2a-203f-4abb-a553-ddb5b1f1bb43 service placement] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:41:47.587693 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e00d2a-203f-4abb-a553-ddb5b1f1bb43 service placement] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:41:47.587967 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e00d2a-203f-4abb-a553-ddb5b1f1bb43 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:41:47.589788 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-44e00d2a-203f-4abb-a553-ddb5b1f1bb43 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:41:47.601735 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e00d2a-203f-4abb-a553-ddb5b1f1bb43 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:41:47.603274 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e00d2a-203f-4abb-a553-ddb5b1f1bb43 service placement] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:41:47.613224 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1346/2682] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:41:47 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:41:48.963073 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37bb224-4b6f-421a-9e0b-c6efcf027778 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:41:48.964648 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-f37bb224-4b6f-421a-9e0b-c6efcf027778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:41:49.024141 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37bb224-4b6f-421a-9e0b-c6efcf027778 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:41:49.027798 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f872b3-4c5b-4c0f-a05f-1da2baf14abf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:41:49.031059 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f872b3-4c5b-4c0f-a05f-1da2baf14abf service cinder] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:41:49.031059 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f872b3-4c5b-4c0f-a05f-1da2baf14abf service cinder] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:41:49.031059 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f872b3-4c5b-4c0f-a05f-1da2baf14abf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:41:49.031059 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-31f872b3-4c5b-4c0f-a05f-1da2baf14abf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:41:49.101609 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f872b3-4c5b-4c0f-a05f-1da2baf14abf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:41:49.101609 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f872b3-4c5b-4c0f-a05f-1da2baf14abf service cinder] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:41:49.101994 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1337/2683] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:41:48 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:41:57.351473 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad197d4-0375-43fb-9f06-d4cb5094e035 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:41:57.352133 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad197d4-0375-43fb-9f06-d4cb5094e035 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:41:57.352133 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad197d4-0375-43fb-9f06-d4cb5094e035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:41:57.368896 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-4ad197d4-0375-43fb-9f06-d4cb5094e035 None None] MFA Rules not processed for user `ecaf914ba335477182e4e1153d0d3f71`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:41:57.370075 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-4ad197d4-0375-43fb-9f06-d4cb5094e035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:41:57.377296 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1347/2684] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:41:57 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:42:05.884339 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae978ee5-01ef-493b-a9fd-3eeadbf45c97 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:42:05.884876 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae978ee5-01ef-493b-a9fd-3eeadbf45c97 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:42:05.884985 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae978ee5-01ef-493b-a9fd-3eeadbf45c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:42:05.902132 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-ae978ee5-01ef-493b-a9fd-3eeadbf45c97 None None] MFA Rules not processed for user `3df4695a2e3645f0b08aaae98d9025eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:42:05.903321 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-ae978ee5-01ef-493b-a9fd-3eeadbf45c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:42:05.910151 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1338/2685] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:42:05 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:42:09.720882 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad197d4-0375-43fb-9f06-d4cb5094e035 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:42:09.722356 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-4ad197d4-0375-43fb-9f06-d4cb5094e035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:42:09.738007 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad197d4-0375-43fb-9f06-d4cb5094e035 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:42:09.744094 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2781786-8c41-46a9-94b2-577b8ab7f9c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:42:09.744750 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2781786-8c41-46a9-94b2-577b8ab7f9c3 service nova] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:42:09.745033 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2781786-8c41-46a9-94b2-577b8ab7f9c3 service nova] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:42:09.745310 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2781786-8c41-46a9-94b2-577b8ab7f9c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:42:09.747142 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-f2781786-8c41-46a9-94b2-577b8ab7f9c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:42:09.758277 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2781786-8c41-46a9-94b2-577b8ab7f9c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:42:09.759991 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2781786-8c41-46a9-94b2-577b8ab7f9c3 service nova] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:42:09.769581 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1348/2686] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:42:09 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:42:17.567869 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae978ee5-01ef-493b-a9fd-3eeadbf45c97 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:42:17.578080 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae978ee5-01ef-493b-a9fd-3eeadbf45c97 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:42:17.581604 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67d398-50fe-4882-bfa3-42f01394c08b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:42:17.582233 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67d398-50fe-4882-bfa3-42f01394c08b service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:42:17.582513 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67d398-50fe-4882-bfa3-42f01394c08b service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:42:17.582785 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67d398-50fe-4882-bfa3-42f01394c08b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:42:17.585002 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-fb67d398-50fe-4882-bfa3-42f01394c08b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:42:17.648591 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67d398-50fe-4882-bfa3-42f01394c08b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:42:17.650100 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67d398-50fe-4882-bfa3-42f01394c08b service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:42:17.659871 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1339/2687] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:42:17 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:42:29.430556 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2781786-8c41-46a9-94b2-577b8ab7f9c3 service nova] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:42:29.439750 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2781786-8c41-46a9-94b2-577b8ab7f9c3 service nova] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:42:29.443261 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47637f-2302-4164-8b8c-08e024d56a0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:42:29.443879 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47637f-2302-4164-8b8c-08e024d56a0c service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:42:29.444362 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47637f-2302-4164-8b8c-08e024d56a0c service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:42:29.444644 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47637f-2302-4164-8b8c-08e024d56a0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:42:29.446401 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-7f47637f-2302-4164-8b8c-08e024d56a0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:42:29.503479 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47637f-2302-4164-8b8c-08e024d56a0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:42:29.504900 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47637f-2302-4164-8b8c-08e024d56a0c service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:42:29.514064 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1349/2688] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:42:29 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:42:35.201518 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17f440-66bb-428b-9fde-0ba9fc67a7a4 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:42:35.201996 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17f440-66bb-428b-9fde-0ba9fc67a7a4 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:42:35.202103 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17f440-66bb-428b-9fde-0ba9fc67a7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:42:35.222256 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-8e17f440-66bb-428b-9fde-0ba9fc67a7a4 None None] MFA Rules not processed for user `3df4695a2e3645f0b08aaae98d9025eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:42:35.223636 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-8e17f440-66bb-428b-9fde-0ba9fc67a7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:42:35.232089 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1340/2689] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:42:35 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:42:37.471141 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47637f-2302-4164-8b8c-08e024d56a0c service neutron] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:42:37.480046 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47637f-2302-4164-8b8c-08e024d56a0c service neutron] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:42:37.483800 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087bba8b-0a88-40f1-ab06-4aee7eace0e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:42:37.484431 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bba8b-0a88-40f1-ab06-4aee7eace0e0 service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:42:37.484718 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bba8b-0a88-40f1-ab06-4aee7eace0e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:42:37.484996 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bba8b-0a88-40f1-ab06-4aee7eace0e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:42:37.486823 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-087bba8b-0a88-40f1-ab06-4aee7eace0e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:42:37.499455 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087bba8b-0a88-40f1-ab06-4aee7eace0e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:42:37.500869 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087bba8b-0a88-40f1-ab06-4aee7eace0e0 service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:42:37.511234 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1350/2690] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:42:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:42:46.192376 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17f440-66bb-428b-9fde-0ba9fc67a7a4 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:42:46.195011 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-8e17f440-66bb-428b-9fde-0ba9fc67a7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:42:46.216718 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17f440-66bb-428b-9fde-0ba9fc67a7a4 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:42:46.221760 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceafbfe-701b-4dbe-b8fe-ffb7d4859621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:42:46.222642 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceafbfe-701b-4dbe-b8fe-ffb7d4859621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:42:46.222926 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceafbfe-701b-4dbe-b8fe-ffb7d4859621 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:42:46.223260 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceafbfe-701b-4dbe-b8fe-ffb7d4859621 admin admin] PATH_INFO: `/v3/users/94f87b8e0ff64d1f91897c25139ad4cc` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:42:46.225793 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceafbfe-701b-4dbe-b8fe-ffb7d4859621 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94f87b8e0ff64d1f91897c25139ad4cc)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:42:46.227731 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceafbfe-701b-4dbe-b8fe-ffb7d4859621 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:42:46.441483 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-6ceafbfe-701b-4dbe-b8fe-ffb7d4859621 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94f87b8e0ff64d1f91897c25139ad4cc'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:42:46.442075 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-6ceafbfe-701b-4dbe-b8fe-ffb7d4859621 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94f87b8e0ff64d1f91897c25139ad4cc'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:42:46.450034 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-6ceafbfe-701b-4dbe-b8fe-ffb7d4859621 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94f87b8e0ff64d1f91897c25139ad4cc'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:42:46.450662 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-6ceafbfe-701b-4dbe-b8fe-ffb7d4859621 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94f87b8e0ff64d1f91897c25139ad4cc'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:42:46.462594 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-6ceafbfe-701b-4dbe-b8fe-ffb7d4859621 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94f87b8e0ff64d1f91897c25139ad4cc'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:42:46.524642 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1341/2691] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:42:46 2021] DELETE /identity/v3/users/94f87b8e0ff64d1f91897c25139ad4cc => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:42:46.772696 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087bba8b-0a88-40f1-ab06-4aee7eace0e0 service neutron] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:42:46.794646 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087bba8b-0a88-40f1-ab06-4aee7eace0e0 service neutron] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:42:46.872322 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d0976-e3a4-4b9b-be93-7135bb19f245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:42:46.873299 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d0976-e3a4-4b9b-be93-7135bb19f245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:42:46.873682 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d0976-e3a4-4b9b-be93-7135bb19f245 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:42:46.874040 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d0976-e3a4-4b9b-be93-7135bb19f245 admin admin] PATH_INFO: `/v3/projects/35f8a5017a27449084aabd12f27f5a8a` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:42:46.875586 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d0976-e3a4-4b9b-be93-7135bb19f245 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35f8a5017a27449084aabd12f27f5a8a)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:42:46.878348 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d0976-e3a4-4b9b-be93-7135bb19f245 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:42:46.982809 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-5a6d0976-e3a4-4b9b-be93-7135bb19f245 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35f8a5017a27449084aabd12f27f5a8a', 'request_id': 'req-5a6d0976-e3a4-4b9b-be93-7135bb19f245'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:42:46.988250 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-5a6d0976-e3a4-4b9b-be93-7135bb19f245 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35f8a5017a27449084aabd12f27f5a8a', 'request_id': 'req-5a6d0976-e3a4-4b9b-be93-7135bb19f245'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:42:46.994741 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-5a6d0976-e3a4-4b9b-be93-7135bb19f245 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35f8a5017a27449084aabd12f27f5a8a', 'request_id': 'req-5a6d0976-e3a4-4b9b-be93-7135bb19f245'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:42:47.060914 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-5a6d0976-e3a4-4b9b-be93-7135bb19f245 admin admin] The token cache is being invalidate because project 35f8a5017a27449084aabd12f27f5a8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:42:47.061146 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-5a6d0976-e3a4-4b9b-be93-7135bb19f245 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:42:47.061775 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-5a6d0976-e3a4-4b9b-be93-7135bb19f245 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:42:47.063384 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1351/2692] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:42:46 2021] DELETE /identity/v3/projects/35f8a5017a27449084aabd12f27f5a8a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:42:47.067419 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceafbfe-701b-4dbe-b8fe-ffb7d4859621 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:42:47.068901 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-6ceafbfe-701b-4dbe-b8fe-ffb7d4859621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:42:47.081917 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceafbfe-701b-4dbe-b8fe-ffb7d4859621 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:42:47.136671 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9ca91-2c84-4f48-bf8e-eff469ac6456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:42:47.137490 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9ca91-2c84-4f48-bf8e-eff469ac6456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:42:47.137769 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9ca91-2c84-4f48-bf8e-eff469ac6456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:42:47.138042 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9ca91-2c84-4f48-bf8e-eff469ac6456 admin admin] PATH_INFO: `/v3/users/ad7996ccf04f405f859122eb401b2e71` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:42:47.139216 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9ca91-2c84-4f48-bf8e-eff469ac6456 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad7996ccf04f405f859122eb401b2e71)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:42:47.141085 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9ca91-2c84-4f48-bf8e-eff469ac6456 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:42:47.298141 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-92d9ca91-2c84-4f48-bf8e-eff469ac6456 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad7996ccf04f405f859122eb401b2e71'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:42:47.298880 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-92d9ca91-2c84-4f48-bf8e-eff469ac6456 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad7996ccf04f405f859122eb401b2e71'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:42:47.306133 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-92d9ca91-2c84-4f48-bf8e-eff469ac6456 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad7996ccf04f405f859122eb401b2e71'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:42:47.306764 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-92d9ca91-2c84-4f48-bf8e-eff469ac6456 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad7996ccf04f405f859122eb401b2e71'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:42:47.319653 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-92d9ca91-2c84-4f48-bf8e-eff469ac6456 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad7996ccf04f405f859122eb401b2e71'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:42:47.370399 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1342/2693] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:42:47 2021] DELETE /identity/v3/users/ad7996ccf04f405f859122eb401b2e71 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:42:47.606631 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d0976-e3a4-4b9b-be93-7135bb19f245 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:42:47.612591 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-5a6d0976-e3a4-4b9b-be93-7135bb19f245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:42:47.622064 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d0976-e3a4-4b9b-be93-7135bb19f245 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:42:47.677321 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2fc9ed-985a-43af-b6d3-779fda9f58d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:42:47.678971 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fc9ed-985a-43af-b6d3-779fda9f58d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:42:47.679241 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fc9ed-985a-43af-b6d3-779fda9f58d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:42:47.679507 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fc9ed-985a-43af-b6d3-779fda9f58d5 admin admin] PATH_INFO: `/v3/projects/2782edd0ce0e455b825d4fa9efd24221` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:42:47.680687 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2fc9ed-985a-43af-b6d3-779fda9f58d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2782edd0ce0e455b825d4fa9efd24221)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:42:47.682564 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2fc9ed-985a-43af-b6d3-779fda9f58d5 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:42:47.775072 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-8e2fc9ed-985a-43af-b6d3-779fda9f58d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2782edd0ce0e455b825d4fa9efd24221', 'request_id': 'req-8e2fc9ed-985a-43af-b6d3-779fda9f58d5'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:42:47.780261 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-8e2fc9ed-985a-43af-b6d3-779fda9f58d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2782edd0ce0e455b825d4fa9efd24221', 'request_id': 'req-8e2fc9ed-985a-43af-b6d3-779fda9f58d5'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:42:47.786308 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-8e2fc9ed-985a-43af-b6d3-779fda9f58d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2782edd0ce0e455b825d4fa9efd24221', 'request_id': 'req-8e2fc9ed-985a-43af-b6d3-779fda9f58d5'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:42:47.831812 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-8e2fc9ed-985a-43af-b6d3-779fda9f58d5 admin admin] The token cache is being invalidate because project 2782edd0ce0e455b825d4fa9efd24221 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:42:47.832130 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-8e2fc9ed-985a-43af-b6d3-779fda9f58d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:42:47.832734 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-8e2fc9ed-985a-43af-b6d3-779fda9f58d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:42:47.835221 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1352/2694] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:42:47 2021] DELETE /identity/v3/projects/2782edd0ce0e455b825d4fa9efd24221 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:43:20.880288 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9ca91-2c84-4f48-bf8e-eff469ac6456 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:20.881693 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-92d9ca91-2c84-4f48-bf8e-eff469ac6456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:20.939715 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9ca91-2c84-4f48-bf8e-eff469ac6456 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:20.993684 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ef71e-764b-443f-8c48-f90584de1d9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:20.994419 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ef71e-764b-443f-8c48-f90584de1d9f service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:20.996860 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ef71e-764b-443f-8c48-f90584de1d9f service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:20.996860 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ef71e-764b-443f-8c48-f90584de1d9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:20.998125 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-a85ef71e-764b-443f-8c48-f90584de1d9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:21.089419 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ef71e-764b-443f-8c48-f90584de1d9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:21.090897 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ef71e-764b-443f-8c48-f90584de1d9f service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:21.103344 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1343/2695] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:43:20 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:43:22.794014 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2fc9ed-985a-43af-b6d3-779fda9f58d5 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:22.795518 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-8e2fc9ed-985a-43af-b6d3-779fda9f58d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:22.862297 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2fc9ed-985a-43af-b6d3-779fda9f58d5 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:22.867141 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd7f7d-470e-42b0-ab3b-a752387d4980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:22.868007 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd7f7d-470e-42b0-ab3b-a752387d4980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:22.868293 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd7f7d-470e-42b0-ab3b-a752387d4980 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:22.868568 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd7f7d-470e-42b0-ab3b-a752387d4980 admin admin] PATH_INFO: `/v3/users/3df4695a2e3645f0b08aaae98d9025eb` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:22.869810 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd7f7d-470e-42b0-ab3b-a752387d4980 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3df4695a2e3645f0b08aaae98d9025eb)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:22.871881 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd7f7d-470e-42b0-ab3b-a752387d4980 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:23.062928 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-f5bd7f7d-470e-42b0-ab3b-a752387d4980 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3df4695a2e3645f0b08aaae98d9025eb'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:23.062928 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-f5bd7f7d-470e-42b0-ab3b-a752387d4980 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3df4695a2e3645f0b08aaae98d9025eb'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:23.117301 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-f5bd7f7d-470e-42b0-ab3b-a752387d4980 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3df4695a2e3645f0b08aaae98d9025eb'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:23.117942 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-f5bd7f7d-470e-42b0-ab3b-a752387d4980 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3df4695a2e3645f0b08aaae98d9025eb'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:23.130183 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-f5bd7f7d-470e-42b0-ab3b-a752387d4980 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3df4695a2e3645f0b08aaae98d9025eb'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:23.142262 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1353/2696] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:43:22 2021] DELETE /identity/v3/users/3df4695a2e3645f0b08aaae98d9025eb => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:43:23.388198 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ef71e-764b-443f-8c48-f90584de1d9f service neutron] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:23.398695 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ef71e-764b-443f-8c48-f90584de1d9f service neutron] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:23.459373 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b84cf-acb7-4390-9b6e-ce6baed5c433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:23.460317 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b84cf-acb7-4390-9b6e-ce6baed5c433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:23.460736 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b84cf-acb7-4390-9b6e-ce6baed5c433 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:23.461161 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b84cf-acb7-4390-9b6e-ce6baed5c433 admin admin] PATH_INFO: `/v3/projects/e738acf03acd4f9d90b4dc46fb48bb06` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:23.462402 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b84cf-acb7-4390-9b6e-ce6baed5c433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e738acf03acd4f9d90b4dc46fb48bb06)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:23.464747 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b84cf-acb7-4390-9b6e-ce6baed5c433 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:23.564090 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-3b3b84cf-acb7-4390-9b6e-ce6baed5c433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e738acf03acd4f9d90b4dc46fb48bb06', 'request_id': 'req-3b3b84cf-acb7-4390-9b6e-ce6baed5c433'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:23.570152 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-3b3b84cf-acb7-4390-9b6e-ce6baed5c433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e738acf03acd4f9d90b4dc46fb48bb06', 'request_id': 'req-3b3b84cf-acb7-4390-9b6e-ce6baed5c433'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:23.576073 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-3b3b84cf-acb7-4390-9b6e-ce6baed5c433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e738acf03acd4f9d90b4dc46fb48bb06', 'request_id': 'req-3b3b84cf-acb7-4390-9b6e-ce6baed5c433'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:23.693954 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-3b3b84cf-acb7-4390-9b6e-ce6baed5c433 admin admin] The token cache is being invalidate because project e738acf03acd4f9d90b4dc46fb48bb06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:43:23.694243 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-3b3b84cf-acb7-4390-9b6e-ce6baed5c433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:23.694884 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-3b3b84cf-acb7-4390-9b6e-ce6baed5c433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:23.696602 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1344/2697] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:43:23 2021] DELETE /identity/v3/projects/e738acf03acd4f9d90b4dc46fb48bb06 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:43:23.703014 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348a8a9-dea4-4d46-9cef-2978f95cd7c1 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:23.703303 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348a8a9-dea4-4d46-9cef-2978f95cd7c1 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:23.703581 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348a8a9-dea4-4d46-9cef-2978f95cd7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:23.720683 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-d348a8a9-dea4-4d46-9cef-2978f95cd7c1 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:23.721933 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-d348a8a9-dea4-4d46-9cef-2978f95cd7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:23.779851 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1354/2698] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:43:23.788276 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39406b32-a5fa-4872-9618-3986e0d5e879 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:23.788562 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39406b32-a5fa-4872-9618-3986e0d5e879 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:23.788841 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39406b32-a5fa-4872-9618-3986e0d5e879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:23.807442 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-39406b32-a5fa-4872-9618-3986e0d5e879 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:23.810393 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-39406b32-a5fa-4872-9618-3986e0d5e879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:23.817191 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1345/2699] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:43:23.821578 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348a8a9-dea4-4d46-9cef-2978f95cd7c1 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:23.831983 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348a8a9-dea4-4d46-9cef-2978f95cd7c1 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:23.836536 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63422a9-7b01-4dd2-8d3c-0de1c601394c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:23.837180 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63422a9-7b01-4dd2-8d3c-0de1c601394c admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:23.837493 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63422a9-7b01-4dd2-8d3c-0de1c601394c admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:23.837772 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63422a9-7b01-4dd2-8d3c-0de1c601394c admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:23.838501 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63422a9-7b01-4dd2-8d3c-0de1c601394c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:43:23.838814 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63422a9-7b01-4dd2-8d3c-0de1c601394c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:23.840442 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63422a9-7b01-4dd2-8d3c-0de1c601394c admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:23.851531 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1355/2700] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:43:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:43:23.855721 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39406b32-a5fa-4872-9618-3986e0d5e879 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:23.864687 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39406b32-a5fa-4872-9618-3986e0d5e879 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:23.869298 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f5f09-ad9d-4fc1-a612-21f65f4224b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:23.870062 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f5f09-ad9d-4fc1-a612-21f65f4224b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:23.870346 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f5f09-ad9d-4fc1-a612-21f65f4224b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:23.870619 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f5f09-ad9d-4fc1-a612-21f65f4224b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:23.871864 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f5f09-ad9d-4fc1-a612-21f65f4224b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:23.873762 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f5f09-ad9d-4fc1-a612-21f65f4224b8 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:23.930223 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1346/2701] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:43:23 2021] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:43:23.939037 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63422a9-7b01-4dd2-8d3c-0de1c601394c admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:23.948886 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63422a9-7b01-4dd2-8d3c-0de1c601394c admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:24.002157 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60466b-192a-4b76-94ef-69daa8945db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:24.002817 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60466b-192a-4b76-94ef-69daa8945db7 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:24.003103 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60466b-192a-4b76-94ef-69daa8945db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:24.003380 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60466b-192a-4b76-94ef-69daa8945db7 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:24.004088 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60466b-192a-4b76-94ef-69daa8945db7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:24.006018 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60466b-192a-4b76-94ef-69daa8945db7 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:24.066587 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1356/2702] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:43:23 2021] POST /identity/v3/users => generated 287 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:43:24.070790 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f5f09-ad9d-4fc1-a612-21f65f4224b8 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:24.081042 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f5f09-ad9d-4fc1-a612-21f65f4224b8 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:24.086011 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c6c7e-36f2-4d3e-a7e4-65cf1d96c7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:24.086670 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c6c7e-36f2-4d3e-a7e4-65cf1d96c7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:24.086974 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c6c7e-36f2-4d3e-a7e4-65cf1d96c7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:24.087228 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c6c7e-36f2-4d3e-a7e4-65cf1d96c7b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:24.087995 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c6c7e-36f2-4d3e-a7e4-65cf1d96c7b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:24.089637 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c6c7e-36f2-4d3e-a7e4-65cf1d96c7b3 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:24.102341 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1347/2703] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:43:24 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:43:24.106971 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60466b-192a-4b76-94ef-69daa8945db7 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:24.116855 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60466b-192a-4b76-94ef-69daa8945db7 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:24.122092 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc157bcb-0f19-4af4-b52e-81a6e531d0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:24.122750 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc157bcb-0f19-4af4-b52e-81a6e531d0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:24.123034 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc157bcb-0f19-4af4-b52e-81a6e531d0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:24.123341 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc157bcb-0f19-4af4-b52e-81a6e531d0c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:24.124073 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc157bcb-0f19-4af4-b52e-81a6e531d0c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:24.125668 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc157bcb-0f19-4af4-b52e-81a6e531d0c2 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:24.137042 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1357/2704] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:43:24 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:43:24.141184 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c6c7e-36f2-4d3e-a7e4-65cf1d96c7b3 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:24.151236 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c6c7e-36f2-4d3e-a7e4-65cf1d96c7b3 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:24.156778 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4022123-ba6e-4077-8bf4-2d7f1b90a0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:24.157741 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4022123-ba6e-4077-8bf4-2d7f1b90a0e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:24.158019 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4022123-ba6e-4077-8bf4-2d7f1b90a0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:24.158291 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4022123-ba6e-4077-8bf4-2d7f1b90a0e7 admin admin] PATH_INFO: `/v3/projects/9862d233407049d384209824b4c4f00e/users/4c0d82557b1c4d95998c7c15cf025e1e/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:24.176220 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4022123-ba6e-4077-8bf4-2d7f1b90a0e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9862d233407049d384209824b4c4f00e, user_id=4c0d82557b1c4d95998c7c15cf025e1e, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:24.179466 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4022123-ba6e-4077-8bf4-2d7f1b90a0e7 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:24.210524 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc157bcb-0f19-4af4-b52e-81a6e531d0c2 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:24.212261 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-cc157bcb-0f19-4af4-b52e-81a6e531d0c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:24.255789 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1348/2705] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:43:24 2021] PUT /identity/v3/projects/9862d233407049d384209824b4c4f00e/users/4c0d82557b1c4d95998c7c15cf025e1e/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:43:24.266661 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8754f-ca47-4a7e-814c-bcd0326abcde None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:24.267167 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8754f-ca47-4a7e-814c-bcd0326abcde None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:24.267352 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8754f-ca47-4a7e-814c-bcd0326abcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:24.274907 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc157bcb-0f19-4af4-b52e-81a6e531d0c2 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:24.295922 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-12a8754f-ca47-4a7e-814c-bcd0326abcde None None] MFA Rules not processed for user `4c0d82557b1c4d95998c7c15cf025e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:24.297135 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-12a8754f-ca47-4a7e-814c-bcd0326abcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:24.325001 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5decab-f986-4ca0-b86a-0eaa03be23b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:24.325696 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5decab-f986-4ca0-b86a-0eaa03be23b3 service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:24.325982 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5decab-f986-4ca0-b86a-0eaa03be23b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:24.326260 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5decab-f986-4ca0-b86a-0eaa03be23b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:24.328091 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-bd5decab-f986-4ca0-b86a-0eaa03be23b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:24.360109 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1349/2706] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:24 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:43:24.364488 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8754f-ca47-4a7e-814c-bcd0326abcde None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:24.389266 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5decab-f986-4ca0-b86a-0eaa03be23b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:24.390732 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5decab-f986-4ca0-b86a-0eaa03be23b3 service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:24.400373 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1358/2707] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:43:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:43:24.424451 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8754f-ca47-4a7e-814c-bcd0326abcde None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:24.429281 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4222253-230f-4a4c-8197-0fbf000bb36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:24.430007 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4222253-230f-4a4c-8197-0fbf000bb36c admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:24.430296 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4222253-230f-4a4c-8197-0fbf000bb36c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:24.430575 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4222253-230f-4a4c-8197-0fbf000bb36c admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:24.431284 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4222253-230f-4a4c-8197-0fbf000bb36c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:24.433162 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4222253-230f-4a4c-8197-0fbf000bb36c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:24.507334 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1350/2708] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:43:24 2021] POST /identity/v3/projects => generated 371 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:43:24.511409 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5decab-f986-4ca0-b86a-0eaa03be23b3 service neutron] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:24.520975 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5decab-f986-4ca0-b86a-0eaa03be23b3 service neutron] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:24.579225 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319b9de-41cb-4361-903b-e6b79357a61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:24.579606 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319b9de-41cb-4361-903b-e6b79357a61b admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:24.579892 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319b9de-41cb-4361-903b-e6b79357a61b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:24.580170 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319b9de-41cb-4361-903b-e6b79357a61b admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:24.580889 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e319b9de-41cb-4361-903b-e6b79357a61b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:24.582948 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e319b9de-41cb-4361-903b-e6b79357a61b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:24.660773 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1359/2709] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:43:24 2021] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:43:24.664899 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4222253-230f-4a4c-8197-0fbf000bb36c admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:24.676027 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4222253-230f-4a4c-8197-0fbf000bb36c admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:24.681323 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad5eb3-cba1-4103-9189-c37e86044d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:24.682012 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad5eb3-cba1-4103-9189-c37e86044d54 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:24.682293 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad5eb3-cba1-4103-9189-c37e86044d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:24.682563 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad5eb3-cba1-4103-9189-c37e86044d54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:24.683294 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad5eb3-cba1-4103-9189-c37e86044d54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:24.685491 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad5eb3-cba1-4103-9189-c37e86044d54 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:24.696343 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1351/2710] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:43:24 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:43:24.703939 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319b9de-41cb-4361-903b-e6b79357a61b admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:24.711760 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319b9de-41cb-4361-903b-e6b79357a61b admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:24.716947 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695f3e0-7edc-4cd8-b177-ab4cb4e9ed70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:24.717861 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695f3e0-7edc-4cd8-b177-ab4cb4e9ed70 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:24.718140 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695f3e0-7edc-4cd8-b177-ab4cb4e9ed70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:24.718411 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695f3e0-7edc-4cd8-b177-ab4cb4e9ed70 admin admin] PATH_INFO: `/v3/projects/16d65bb61b764b09b0d85f652c48f535/users/5e98e4bdc3f24b31aa66573a91280a38/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:24.733083 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7695f3e0-7edc-4cd8-b177-ab4cb4e9ed70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16d65bb61b764b09b0d85f652c48f535, user_id=5e98e4bdc3f24b31aa66573a91280a38, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:24.735693 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7695f3e0-7edc-4cd8-b177-ab4cb4e9ed70 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:24.829057 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1360/2711] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:43:24 2021] PUT /identity/v3/projects/16d65bb61b764b09b0d85f652c48f535/users/5e98e4bdc3f24b31aa66573a91280a38/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:43:24.833244 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad5eb3-cba1-4103-9189-c37e86044d54 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:24.844826 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad5eb3-cba1-4103-9189-c37e86044d54 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:24.901963 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910efed-2600-4774-af35-555a10d40a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:24.903241 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910efed-2600-4774-af35-555a10d40a7b admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:24.903549 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910efed-2600-4774-af35-555a10d40a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:24.903822 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910efed-2600-4774-af35-555a10d40a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:24.904573 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d910efed-2600-4774-af35-555a10d40a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:24.906210 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d910efed-2600-4774-af35-555a10d40a7b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:24.920053 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1352/2712] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:43:24 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:43:24.921366 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695f3e0-7edc-4cd8-b177-ab4cb4e9ed70 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:24.932336 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695f3e0-7edc-4cd8-b177-ab4cb4e9ed70 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:24.937607 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda7c88-16fe-4a52-9d81-22bdff3fab61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:24.938506 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda7c88-16fe-4a52-9d81-22bdff3fab61 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:24.938789 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda7c88-16fe-4a52-9d81-22bdff3fab61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:24.939059 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda7c88-16fe-4a52-9d81-22bdff3fab61 admin admin] PATH_INFO: `/v3/projects/16d65bb61b764b09b0d85f652c48f535/users/5e98e4bdc3f24b31aa66573a91280a38/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:24.941092 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda7c88-16fe-4a52-9d81-22bdff3fab61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16d65bb61b764b09b0d85f652c48f535, user_id=5e98e4bdc3f24b31aa66573a91280a38, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:24.943738 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda7c88-16fe-4a52-9d81-22bdff3fab61 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:24.955700 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1361/2713] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:43:24 2021] PUT /identity/v3/projects/16d65bb61b764b09b0d85f652c48f535/users/5e98e4bdc3f24b31aa66573a91280a38/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:43:24.966258 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c0a33-e46b-480c-bec8-ef1d9b7b202f None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:24.966544 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c0a33-e46b-480c-bec8-ef1d9b7b202f None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:24.966970 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c0a33-e46b-480c-bec8-ef1d9b7b202f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:24.995176 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-108c0a33-e46b-480c-bec8-ef1d9b7b202f None None] MFA Rules not processed for user `5e98e4bdc3f24b31aa66573a91280a38`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:24.996984 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-108c0a33-e46b-480c-bec8-ef1d9b7b202f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:25.068334 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1353/2714] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:24 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:43:25.079556 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda7c88-16fe-4a52-9d81-22bdff3fab61 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:25.081329 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-7eda7c88-16fe-4a52-9d81-22bdff3fab61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:25.141933 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda7c88-16fe-4a52-9d81-22bdff3fab61 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:25.145595 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a4473-453c-497f-a814-c06358ca0bd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:25.146237 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a4473-453c-497f-a814-c06358ca0bd1 service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:25.146518 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a4473-453c-497f-a814-c06358ca0bd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:25.146793 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a4473-453c-497f-a814-c06358ca0bd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:25.156464 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a4473-453c-497f-a814-c06358ca0bd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:25.157921 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a4473-453c-497f-a814-c06358ca0bd1 service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:25.167344 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1362/2715] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:43:25 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:43:25.764311 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c0a33-e46b-480c-bec8-ef1d9b7b202f None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:25.830061 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c0a33-e46b-480c-bec8-ef1d9b7b202f None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:25.834581 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507e912-e0d8-43f7-ac08-7f9febe095b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:25.835385 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507e912-e0d8-43f7-ac08-7f9febe095b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:25.835664 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507e912-e0d8-43f7-ac08-7f9febe095b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:25.835935 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507e912-e0d8-43f7-ac08-7f9febe095b7 admin admin] PATH_INFO: `/v3/users/4c0d82557b1c4d95998c7c15cf025e1e` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:25.837113 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507e912-e0d8-43f7-ac08-7f9febe095b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c0d82557b1c4d95998c7c15cf025e1e)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:25.839062 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a507e912-e0d8-43f7-ac08-7f9febe095b7 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:26.058372 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-a507e912-e0d8-43f7-ac08-7f9febe095b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c0d82557b1c4d95998c7c15cf025e1e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:26.059285 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-a507e912-e0d8-43f7-ac08-7f9febe095b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c0d82557b1c4d95998c7c15cf025e1e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:26.066260 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-a507e912-e0d8-43f7-ac08-7f9febe095b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c0d82557b1c4d95998c7c15cf025e1e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:26.066924 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-a507e912-e0d8-43f7-ac08-7f9febe095b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c0d82557b1c4d95998c7c15cf025e1e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:26.079124 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-a507e912-e0d8-43f7-ac08-7f9febe095b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c0d82557b1c4d95998c7c15cf025e1e'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:26.175855 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1354/2716] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:43:25 2021] DELETE /identity/v3/users/4c0d82557b1c4d95998c7c15cf025e1e => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:43:26.180943 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e49785-839a-46d7-bd1c-221060562261 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:26.181493 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e49785-839a-46d7-bd1c-221060562261 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:26.181630 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e49785-839a-46d7-bd1c-221060562261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:26.200814 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-20e49785-839a-46d7-bd1c-221060562261 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:26.201892 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-20e49785-839a-46d7-bd1c-221060562261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:26.270370 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1363/2717] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:43:26.281599 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507e912-e0d8-43f7-ac08-7f9febe095b7 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:26.283093 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-a507e912-e0d8-43f7-ac08-7f9febe095b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:26.351537 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507e912-e0d8-43f7-ac08-7f9febe095b7 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:26.355473 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ada068-5218-48e1-8396-1b27b7158849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:26.356423 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ada068-5218-48e1-8396-1b27b7158849 service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:26.356605 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ada068-5218-48e1-8396-1b27b7158849 service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:26.356950 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ada068-5218-48e1-8396-1b27b7158849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:26.373473 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ada068-5218-48e1-8396-1b27b7158849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:26.373473 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ada068-5218-48e1-8396-1b27b7158849 service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:26.379824 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1355/2718] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:43:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:43:26.919921 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e49785-839a-46d7-bd1c-221060562261 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:26.923226 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-20e49785-839a-46d7-bd1c-221060562261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:26.936844 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e49785-839a-46d7-bd1c-221060562261 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:26.942264 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d677c2f-3eaa-4c85-bd72-6213452e6d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:26.943435 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d677c2f-3eaa-4c85-bd72-6213452e6d69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:26.943721 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d677c2f-3eaa-4c85-bd72-6213452e6d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:26.944023 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d677c2f-3eaa-4c85-bd72-6213452e6d69 admin admin] PATH_INFO: `/v3/projects/9862d233407049d384209824b4c4f00e` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:26.945206 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d677c2f-3eaa-4c85-bd72-6213452e6d69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9862d233407049d384209824b4c4f00e)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:26.947182 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d677c2f-3eaa-4c85-bd72-6213452e6d69 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:27.049806 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4d677c2f-3eaa-4c85-bd72-6213452e6d69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9862d233407049d384209824b4c4f00e', 'request_id': 'req-4d677c2f-3eaa-4c85-bd72-6213452e6d69'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:27.055414 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4d677c2f-3eaa-4c85-bd72-6213452e6d69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9862d233407049d384209824b4c4f00e', 'request_id': 'req-4d677c2f-3eaa-4c85-bd72-6213452e6d69'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:27.062139 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4d677c2f-3eaa-4c85-bd72-6213452e6d69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9862d233407049d384209824b4c4f00e', 'request_id': 'req-4d677c2f-3eaa-4c85-bd72-6213452e6d69'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:27.112017 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4d677c2f-3eaa-4c85-bd72-6213452e6d69 admin admin] The token cache is being invalidate because project 9862d233407049d384209824b4c4f00e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:43:27.112633 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4d677c2f-3eaa-4c85-bd72-6213452e6d69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:27.113312 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4d677c2f-3eaa-4c85-bd72-6213452e6d69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:27.115322 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1364/2719] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:43:26 2021] DELETE /identity/v3/projects/9862d233407049d384209824b4c4f00e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:43:27.119085 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ada068-5218-48e1-8396-1b27b7158849 service neutron] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:27.130553 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ada068-5218-48e1-8396-1b27b7158849 service neutron] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:27.196389 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03380aed-f402-4308-9d3f-48517fb44ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:27.197259 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03380aed-f402-4308-9d3f-48517fb44ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:27.197613 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03380aed-f402-4308-9d3f-48517fb44ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:27.197891 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03380aed-f402-4308-9d3f-48517fb44ce1 admin admin] PATH_INFO: `/v3/users/5e98e4bdc3f24b31aa66573a91280a38` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:27.199619 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03380aed-f402-4308-9d3f-48517fb44ce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e98e4bdc3f24b31aa66573a91280a38)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:27.201612 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03380aed-f402-4308-9d3f-48517fb44ce1 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:27.388775 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-03380aed-f402-4308-9d3f-48517fb44ce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e98e4bdc3f24b31aa66573a91280a38'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:27.389533 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-03380aed-f402-4308-9d3f-48517fb44ce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e98e4bdc3f24b31aa66573a91280a38'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:27.397127 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-03380aed-f402-4308-9d3f-48517fb44ce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e98e4bdc3f24b31aa66573a91280a38'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:27.399138 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-03380aed-f402-4308-9d3f-48517fb44ce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e98e4bdc3f24b31aa66573a91280a38'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:27.410677 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-03380aed-f402-4308-9d3f-48517fb44ce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e98e4bdc3f24b31aa66573a91280a38'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:27.506334 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1356/2720] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:43:27 2021] DELETE /identity/v3/users/5e98e4bdc3f24b31aa66573a91280a38 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:43:28.024042 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d677c2f-3eaa-4c85-bd72-6213452e6d69 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:28.024042 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-4d677c2f-3eaa-4c85-bd72-6213452e6d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:28.033910 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d677c2f-3eaa-4c85-bd72-6213452e6d69 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:28.104189 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f999d3b2-5f13-4cce-a83f-8a92dcde30e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:28.105125 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999d3b2-5f13-4cce-a83f-8a92dcde30e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:28.105495 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999d3b2-5f13-4cce-a83f-8a92dcde30e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:28.105817 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999d3b2-5f13-4cce-a83f-8a92dcde30e1 admin admin] PATH_INFO: `/v3/projects/16d65bb61b764b09b0d85f652c48f535` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:28.109723 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f999d3b2-5f13-4cce-a83f-8a92dcde30e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16d65bb61b764b09b0d85f652c48f535)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:28.109723 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f999d3b2-5f13-4cce-a83f-8a92dcde30e1 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:28.211735 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-f999d3b2-5f13-4cce-a83f-8a92dcde30e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16d65bb61b764b09b0d85f652c48f535', 'request_id': 'req-f999d3b2-5f13-4cce-a83f-8a92dcde30e1'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:28.217274 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-f999d3b2-5f13-4cce-a83f-8a92dcde30e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16d65bb61b764b09b0d85f652c48f535', 'request_id': 'req-f999d3b2-5f13-4cce-a83f-8a92dcde30e1'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:28.224059 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-f999d3b2-5f13-4cce-a83f-8a92dcde30e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16d65bb61b764b09b0d85f652c48f535', 'request_id': 'req-f999d3b2-5f13-4cce-a83f-8a92dcde30e1'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:28.317244 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-f999d3b2-5f13-4cce-a83f-8a92dcde30e1 admin admin] The token cache is being invalidate because project 16d65bb61b764b09b0d85f652c48f535 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:43:28.317661 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-f999d3b2-5f13-4cce-a83f-8a92dcde30e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:28.325059 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-f999d3b2-5f13-4cce-a83f-8a92dcde30e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:28.325059 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1365/2721] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:43:28 2021] DELETE /identity/v3/projects/16d65bb61b764b09b0d85f652c48f535 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:43:28.326142 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29422470-00ad-4e79-bf8c-e07a19845dd8 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:28.326607 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29422470-00ad-4e79-bf8c-e07a19845dd8 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:28.326689 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29422470-00ad-4e79-bf8c-e07a19845dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:28.344175 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-29422470-00ad-4e79-bf8c-e07a19845dd8 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:28.345287 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-29422470-00ad-4e79-bf8c-e07a19845dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:28.371772 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f999d3b2-5f13-4cce-a83f-8a92dcde30e1 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:28.373331 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-f999d3b2-5f13-4cce-a83f-8a92dcde30e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:28.406102 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1357/2722] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:43:28.413865 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c487d6-1e0a-43ba-8a6b-e311df116941 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:28.414157 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c487d6-1e0a-43ba-8a6b-e311df116941 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:28.414433 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c487d6-1e0a-43ba-8a6b-e311df116941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:28.432473 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-53c487d6-1e0a-43ba-8a6b-e311df116941 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:28.434441 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-53c487d6-1e0a-43ba-8a6b-e311df116941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:28.439585 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f999d3b2-5f13-4cce-a83f-8a92dcde30e1 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:28.442324 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1358/2723] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:43:28.444492 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef955d-16a4-4f57-b002-d9bde57493c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:28.445358 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef955d-16a4-4f57-b002-d9bde57493c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:28.445670 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef955d-16a4-4f57-b002-d9bde57493c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:28.445944 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef955d-16a4-4f57-b002-d9bde57493c8 admin admin] PATH_INFO: `/v3/users/97620b529cf8418da91d58596ef4c808` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:28.446263 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c487d6-1e0a-43ba-8a6b-e311df116941 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:28.447149 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef955d-16a4-4f57-b002-d9bde57493c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97620b529cf8418da91d58596ef4c808)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:28.449073 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef955d-16a4-4f57-b002-d9bde57493c8 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:28.454928 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c487d6-1e0a-43ba-8a6b-e311df116941 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:28.459459 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bd846-f29c-4d43-9dc6-f371ccecbd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:28.460085 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bd846-f29c-4d43-9dc6-f371ccecbd39 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:28.460364 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bd846-f29c-4d43-9dc6-f371ccecbd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:28.460635 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bd846-f29c-4d43-9dc6-f371ccecbd39 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:28.461354 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6bd846-f29c-4d43-9dc6-f371ccecbd39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:43:28.461683 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6bd846-f29c-4d43-9dc6-f371ccecbd39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:28.463228 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6bd846-f29c-4d43-9dc6-f371ccecbd39 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:28.474559 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1359/2724] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:43:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:43:28.483640 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bd846-f29c-4d43-9dc6-f371ccecbd39 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:28.492931 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bd846-f29c-4d43-9dc6-f371ccecbd39 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:28.498067 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67cebc-e8cf-471f-9235-8e5d2b94e1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:28.498686 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67cebc-e8cf-471f-9235-8e5d2b94e1e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:28.498963 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67cebc-e8cf-471f-9235-8e5d2b94e1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:28.499232 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67cebc-e8cf-471f-9235-8e5d2b94e1e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:28.499908 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67cebc-e8cf-471f-9235-8e5d2b94e1e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:28.501781 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67cebc-e8cf-471f-9235-8e5d2b94e1e7 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:28.581539 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1360/2725] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:43:28 2021] POST /identity/v3/projects => generated 369 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:43:28.585808 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67cebc-e8cf-471f-9235-8e5d2b94e1e7 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:28.604845 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-84ef955d-16a4-4f57-b002-d9bde57493c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97620b529cf8418da91d58596ef4c808'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:28.606147 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-84ef955d-16a4-4f57-b002-d9bde57493c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97620b529cf8418da91d58596ef4c808'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:28.645815 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67cebc-e8cf-471f-9235-8e5d2b94e1e7 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:28.650494 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1170333-89a3-4b92-b259-6beaaf9d2d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:28.651165 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1170333-89a3-4b92-b259-6beaaf9d2d25 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:28.651450 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1170333-89a3-4b92-b259-6beaaf9d2d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:28.651727 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1170333-89a3-4b92-b259-6beaaf9d2d25 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:28.652918 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1170333-89a3-4b92-b259-6beaaf9d2d25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:28.654894 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1170333-89a3-4b92-b259-6beaaf9d2d25 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:28.660090 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-84ef955d-16a4-4f57-b002-d9bde57493c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97620b529cf8418da91d58596ef4c808'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:28.660721 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-84ef955d-16a4-4f57-b002-d9bde57493c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97620b529cf8418da91d58596ef4c808'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:28.674052 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-84ef955d-16a4-4f57-b002-d9bde57493c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97620b529cf8418da91d58596ef4c808'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:28.686990 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1366/2726] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:43:28 2021] DELETE /identity/v3/users/97620b529cf8418da91d58596ef4c808 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:43:28.729664 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1361/2727] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:43:28 2021] POST /identity/v3/users => generated 285 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:43:28.734008 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef955d-16a4-4f57-b002-d9bde57493c8 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:28.738810 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-84ef955d-16a4-4f57-b002-d9bde57493c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:28.799076 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef955d-16a4-4f57-b002-d9bde57493c8 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:28.804334 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb8b00-4099-47b6-b7b3-cf8fbbf0c9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:28.805000 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb8b00-4099-47b6-b7b3-cf8fbbf0c9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:28.805283 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb8b00-4099-47b6-b7b3-cf8fbbf0c9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:28.805641 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb8b00-4099-47b6-b7b3-cf8fbbf0c9a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:28.806707 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb8b00-4099-47b6-b7b3-cf8fbbf0c9a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:28.809189 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb8b00-4099-47b6-b7b3-cf8fbbf0c9a7 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:28.822767 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1367/2728] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:43:28 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:43:28.824014 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1170333-89a3-4b92-b259-6beaaf9d2d25 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:28.834739 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1170333-89a3-4b92-b259-6beaaf9d2d25 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:28.839372 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03d817-552f-45aa-91c8-2a6bc642cd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:28.840172 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03d817-552f-45aa-91c8-2a6bc642cd57 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:28.840624 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03d817-552f-45aa-91c8-2a6bc642cd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:28.840905 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03d817-552f-45aa-91c8-2a6bc642cd57 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:28.841681 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03d817-552f-45aa-91c8-2a6bc642cd57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:28.843261 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03d817-552f-45aa-91c8-2a6bc642cd57 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:28.853648 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1362/2729] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:43:28 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:43:28.858071 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb8b00-4099-47b6-b7b3-cf8fbbf0c9a7 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:28.868045 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb8b00-4099-47b6-b7b3-cf8fbbf0c9a7 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:28.873862 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1be24-87c6-4945-8b6b-d96adf5a0d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:28.874732 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1be24-87c6-4945-8b6b-d96adf5a0d81 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:28.875013 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1be24-87c6-4945-8b6b-d96adf5a0d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:28.875291 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1be24-87c6-4945-8b6b-d96adf5a0d81 admin admin] PATH_INFO: `/v3/projects/0c12ac8a9fb54048904eed8cf7c5ad65/users/5b4f44196eb748779c858e9f63bbaaee/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:28.891071 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1be24-87c6-4945-8b6b-d96adf5a0d81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c12ac8a9fb54048904eed8cf7c5ad65, user_id=5b4f44196eb748779c858e9f63bbaaee, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:28.893749 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d1be24-87c6-4945-8b6b-d96adf5a0d81 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:28.966067 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03d817-552f-45aa-91c8-2a6bc642cd57 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:28.967913 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-ad03d817-552f-45aa-91c8-2a6bc642cd57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:28.983787 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03d817-552f-45aa-91c8-2a6bc642cd57 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:28.992076 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1368/2730] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:43:28 2021] PUT /identity/v3/projects/0c12ac8a9fb54048904eed8cf7c5ad65/users/5b4f44196eb748779c858e9f63bbaaee/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:43:29.003857 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26ddb0-3c8b-4fa1-8cd2-90228f8e1444 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:29.004187 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26ddb0-3c8b-4fa1-8cd2-90228f8e1444 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:29.004407 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26ddb0-3c8b-4fa1-8cd2-90228f8e1444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:29.033900 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-7d26ddb0-3c8b-4fa1-8cd2-90228f8e1444 None None] MFA Rules not processed for user `5b4f44196eb748779c858e9f63bbaaee`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:29.035115 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-7d26ddb0-3c8b-4fa1-8cd2-90228f8e1444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:29.047048 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6e2ce-e003-4956-b2f5-68fe3e4c88e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:29.047901 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6e2ce-e003-4956-b2f5-68fe3e4c88e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:29.049475 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6e2ce-e003-4956-b2f5-68fe3e4c88e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:29.049475 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6e2ce-e003-4956-b2f5-68fe3e4c88e8 admin admin] PATH_INFO: `/v3/projects/c9d53f0599374b679185cc73383b417c` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:29.049670 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6e2ce-e003-4956-b2f5-68fe3e4c88e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9d53f0599374b679185cc73383b417c)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:29.051525 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6e2ce-e003-4956-b2f5-68fe3e4c88e8 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:29.098449 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1369/2731] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:29 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:43:29.102699 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26ddb0-3c8b-4fa1-8cd2-90228f8e1444 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:29.112549 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26ddb0-3c8b-4fa1-8cd2-90228f8e1444 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:29.116997 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2442eb4-635b-42bb-b2d1-739142af4292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:29.117682 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2442eb4-635b-42bb-b2d1-739142af4292 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:29.117964 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2442eb4-635b-42bb-b2d1-739142af4292 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:29.118235 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2442eb4-635b-42bb-b2d1-739142af4292 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:29.118917 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2442eb4-635b-42bb-b2d1-739142af4292 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:29.120760 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2442eb4-635b-42bb-b2d1-739142af4292 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:29.140581 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-50c6e2ce-e003-4956-b2f5-68fe3e4c88e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9d53f0599374b679185cc73383b417c', 'request_id': 'req-50c6e2ce-e003-4956-b2f5-68fe3e4c88e8'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:29.146581 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-50c6e2ce-e003-4956-b2f5-68fe3e4c88e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9d53f0599374b679185cc73383b417c', 'request_id': 'req-50c6e2ce-e003-4956-b2f5-68fe3e4c88e8'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:29.151882 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-50c6e2ce-e003-4956-b2f5-68fe3e4c88e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9d53f0599374b679185cc73383b417c', 'request_id': 'req-50c6e2ce-e003-4956-b2f5-68fe3e4c88e8'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:29.181053 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1370/2732] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:43:29 2021] POST /identity/v3/projects => generated 369 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:43:29.186339 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2442eb4-635b-42bb-b2d1-739142af4292 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:29.213699 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-50c6e2ce-e003-4956-b2f5-68fe3e4c88e8 admin admin] The token cache is being invalidate because project c9d53f0599374b679185cc73383b417c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:43:29.213992 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-50c6e2ce-e003-4956-b2f5-68fe3e4c88e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:29.214632 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-50c6e2ce-e003-4956-b2f5-68fe3e4c88e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:29.216259 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1363/2733] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:43:28 2021] DELETE /identity/v3/projects/c9d53f0599374b679185cc73383b417c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:43:29.221733 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a684d-b722-4991-9c0a-1e875bbe0daf None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:29.222024 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a684d-b722-4991-9c0a-1e875bbe0daf None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:29.222304 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a684d-b722-4991-9c0a-1e875bbe0daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:29.241534 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-710a684d-b722-4991-9c0a-1e875bbe0daf None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:29.242730 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-710a684d-b722-4991-9c0a-1e875bbe0daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:29.245894 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2442eb4-635b-42bb-b2d1-739142af4292 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:29.251181 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6a79f-c8e9-4d4c-9637-cd068f2a966a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:29.251973 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6a79f-c8e9-4d4c-9637-cd068f2a966a admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:29.252102 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1364/2734] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:43:29.252211 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6a79f-c8e9-4d4c-9637-cd068f2a966a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:29.252410 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6a79f-c8e9-4d4c-9637-cd068f2a966a admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:29.253137 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba6a79f-c8e9-4d4c-9637-cd068f2a966a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:29.255070 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba6a79f-c8e9-4d4c-9637-cd068f2a966a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:29.259556 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1c561-94fa-49c5-a84d-1374be265792 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:29.259844 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1c561-94fa-49c5-a84d-1374be265792 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:29.260119 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1c561-94fa-49c5-a84d-1374be265792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:29.278446 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-58c1c561-94fa-49c5-a84d-1374be265792 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:29.281287 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-58c1c561-94fa-49c5-a84d-1374be265792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:29.287300 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1365/2735] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:43:29.291249 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1c561-94fa-49c5-a84d-1374be265792 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:29.300834 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1c561-94fa-49c5-a84d-1374be265792 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:29.305335 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85fd1e-75fe-41a7-ab44-15af9583f7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:29.310656 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85fd1e-75fe-41a7-ab44-15af9583f7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:29.310656 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85fd1e-75fe-41a7-ab44-15af9583f7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:29.310656 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85fd1e-75fe-41a7-ab44-15af9583f7d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:29.310656 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85fd1e-75fe-41a7-ab44-15af9583f7d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:43:29.310656 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85fd1e-75fe-41a7-ab44-15af9583f7d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:29.310656 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85fd1e-75fe-41a7-ab44-15af9583f7d4 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:29.321504 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1366/2736] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:43:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:43:29.325789 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85fd1e-75fe-41a7-ab44-15af9583f7d4 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:29.334838 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85fd1e-75fe-41a7-ab44-15af9583f7d4 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:29.339301 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423b622-c2f7-451f-b23a-c370e0716dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:29.339893 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423b622-c2f7-451f-b23a-c370e0716dce admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:29.340446 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423b622-c2f7-451f-b23a-c370e0716dce admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:29.340719 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423b622-c2f7-451f-b23a-c370e0716dce admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:29.341391 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423b622-c2f7-451f-b23a-c370e0716dce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:29.343293 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423b622-c2f7-451f-b23a-c370e0716dce admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:29.367355 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1371/2737] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:43:29 2021] POST /identity/v3/users => generated 291 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:43:29.367573 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6a79f-c8e9-4d4c-9637-cd068f2a966a admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:29.368945 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-bba6a79f-c8e9-4d4c-9637-cd068f2a966a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:29.381044 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6a79f-c8e9-4d4c-9637-cd068f2a966a admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:29.385720 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36580a-f783-41c6-a721-9810528a8f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:29.386356 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36580a-f783-41c6-a721-9810528a8f33 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:29.386633 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36580a-f783-41c6-a721-9810528a8f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:29.386957 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36580a-f783-41c6-a721-9810528a8f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:29.387683 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36580a-f783-41c6-a721-9810528a8f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:29.389224 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36580a-f783-41c6-a721-9810528a8f33 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:29.399215 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1372/2738] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:43:29 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:43:29.403281 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36580a-f783-41c6-a721-9810528a8f33 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:29.412497 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36580a-f783-41c6-a721-9810528a8f33 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:29.416013 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1367/2739] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:43:29 2021] POST /identity/v3/projects => generated 405 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:43:29.417068 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a63f9-23af-4fe4-aa81-3fbe1ddac871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:29.417965 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a63f9-23af-4fe4-aa81-3fbe1ddac871 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:29.418890 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a63f9-23af-4fe4-aa81-3fbe1ddac871 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:29.419337 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a63f9-23af-4fe4-aa81-3fbe1ddac871 admin admin] PATH_INFO: `/v3/projects/6c2482b3bc7e402e865a1358323f96a8/users/08743578843948e1b9d8afccd720dd8f/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:29.420912 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423b622-c2f7-451f-b23a-c370e0716dce admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:29.436622 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a63f9-23af-4fe4-aa81-3fbe1ddac871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c2482b3bc7e402e865a1358323f96a8, user_id=08743578843948e1b9d8afccd720dd8f, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:29.439247 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a63f9-23af-4fe4-aa81-3fbe1ddac871 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:29.480511 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423b622-c2f7-451f-b23a-c370e0716dce admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:29.485952 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d0484-78c6-4e41-8185-82033fc64c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:29.487389 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d0484-78c6-4e41-8185-82033fc64c7e admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:29.487677 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d0484-78c6-4e41-8185-82033fc64c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:29.487953 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d0484-78c6-4e41-8185-82033fc64c7e admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:29.488656 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d0484-78c6-4e41-8185-82033fc64c7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:29.490642 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d0484-78c6-4e41-8185-82033fc64c7e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:29.529547 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1373/2740] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:43:29 2021] PUT /identity/v3/projects/6c2482b3bc7e402e865a1358323f96a8/users/08743578843948e1b9d8afccd720dd8f/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:43:29.533823 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a63f9-23af-4fe4-aa81-3fbe1ddac871 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:29.586299 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1368/2741] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:43:29 2021] POST /identity/v3/users => generated 303 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:43:29.591126 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d0484-78c6-4e41-8185-82033fc64c7e admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:29.594066 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a63f9-23af-4fe4-aa81-3fbe1ddac871 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:29.598819 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e5440-c85d-498f-b95e-ef5a6fc329f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:29.599474 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e5440-c85d-498f-b95e-ef5a6fc329f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:29.599760 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e5440-c85d-498f-b95e-ef5a6fc329f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:29.600037 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e5440-c85d-498f-b95e-ef5a6fc329f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:29.600770 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e5440-c85d-498f-b95e-ef5a6fc329f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:29.600882 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d0484-78c6-4e41-8185-82033fc64c7e admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:29.602364 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e5440-c85d-498f-b95e-ef5a6fc329f9 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:29.605651 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef18cd0d-c495-4fca-9e1b-1102b3996aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:29.606901 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18cd0d-c495-4fca-9e1b-1102b3996aae admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:29.607186 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18cd0d-c495-4fca-9e1b-1102b3996aae admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:29.607464 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18cd0d-c495-4fca-9e1b-1102b3996aae admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:29.608201 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef18cd0d-c495-4fca-9e1b-1102b3996aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:29.609801 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef18cd0d-c495-4fca-9e1b-1102b3996aae admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:29.612671 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1374/2742] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:43:29 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:43:29.616681 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e5440-c85d-498f-b95e-ef5a6fc329f9 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:29.624120 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1369/2743] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:43:29 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:43:29.626590 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e5440-c85d-498f-b95e-ef5a6fc329f9 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:29.626778 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef18cd0d-c495-4fca-9e1b-1102b3996aae admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:29.631195 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac522523-369d-4b55-8258-71fb8eef3d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:29.632057 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac522523-369d-4b55-8258-71fb8eef3d9d admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:29.632336 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac522523-369d-4b55-8258-71fb8eef3d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:29.632598 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac522523-369d-4b55-8258-71fb8eef3d9d admin admin] PATH_INFO: `/v3/projects/6c2482b3bc7e402e865a1358323f96a8/users/08743578843948e1b9d8afccd720dd8f/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:29.634596 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac522523-369d-4b55-8258-71fb8eef3d9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c2482b3bc7e402e865a1358323f96a8, user_id=08743578843948e1b9d8afccd720dd8f, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:29.636500 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef18cd0d-c495-4fca-9e1b-1102b3996aae admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:29.637585 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac522523-369d-4b55-8258-71fb8eef3d9d admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:29.641491 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08853ee4-9f50-4dca-a26b-11e470782f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:29.642134 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08853ee4-9f50-4dca-a26b-11e470782f03 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:29.642421 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08853ee4-9f50-4dca-a26b-11e470782f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:29.642710 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08853ee4-9f50-4dca-a26b-11e470782f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:29.643435 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08853ee4-9f50-4dca-a26b-11e470782f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:29.645026 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08853ee4-9f50-4dca-a26b-11e470782f03 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:29.647842 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1375/2744] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:43:29 2021] PUT /identity/v3/projects/6c2482b3bc7e402e865a1358323f96a8/users/08743578843948e1b9d8afccd720dd8f/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:43:29.660997 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1370/2745] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:43:29 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:43:29.661196 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449aee1d-6055-4294-b26a-ee34c55ed811 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:29.661196 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449aee1d-6055-4294-b26a-ee34c55ed811 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:29.661196 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449aee1d-6055-4294-b26a-ee34c55ed811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:29.661948 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08853ee4-9f50-4dca-a26b-11e470782f03 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:29.671945 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08853ee4-9f50-4dca-a26b-11e470782f03 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:29.685149 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-449aee1d-6055-4294-b26a-ee34c55ed811 None None] MFA Rules not processed for user `08743578843948e1b9d8afccd720dd8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:29.686388 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-449aee1d-6055-4294-b26a-ee34c55ed811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:29.726038 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72f490-f289-4b09-b13b-55360bd32426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:29.727072 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72f490-f289-4b09-b13b-55360bd32426 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:29.727452 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72f490-f289-4b09-b13b-55360bd32426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:29.727830 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72f490-f289-4b09-b13b-55360bd32426 admin admin] PATH_INFO: `/v3/projects/33aae306238f4dc18446de6c98952b34/users/0487c655429a4285bd45d53c091170fe/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:29.742627 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72f490-f289-4b09-b13b-55360bd32426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33aae306238f4dc18446de6c98952b34, user_id=0487c655429a4285bd45d53c091170fe, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:29.745218 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72f490-f289-4b09-b13b-55360bd32426 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:29.752918 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1376/2746] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:29 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:43:29.764106 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449aee1d-6055-4294-b26a-ee34c55ed811 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:29.765490 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-449aee1d-6055-4294-b26a-ee34c55ed811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:29.810438 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1371/2747] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:43:29 2021] PUT /identity/v3/projects/33aae306238f4dc18446de6c98952b34/users/0487c655429a4285bd45d53c091170fe/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:43:29.815690 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad9f92-cca2-4d98-a2f4-9e819b9b71ca None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:29.816051 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad9f92-cca2-4d98-a2f4-9e819b9b71ca None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:29.816335 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad9f92-cca2-4d98-a2f4-9e819b9b71ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:29.822410 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449aee1d-6055-4294-b26a-ee34c55ed811 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:29.833181 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-86ad9f92-cca2-4d98-a2f4-9e819b9b71ca None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:29.834414 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-86ad9f92-cca2-4d98-a2f4-9e819b9b71ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:29.871172 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38774e5-6b2b-4365-a57b-e1aeedaa554d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:29.872379 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38774e5-6b2b-4365-a57b-e1aeedaa554d service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:29.872661 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38774e5-6b2b-4365-a57b-e1aeedaa554d service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:29.872942 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38774e5-6b2b-4365-a57b-e1aeedaa554d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:29.893255 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1372/2748] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:43:29.904835 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad9f92-cca2-4d98-a2f4-9e819b9b71ca None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:29.906227 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-86ad9f92-cca2-4d98-a2f4-9e819b9b71ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:29.932663 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38774e5-6b2b-4365-a57b-e1aeedaa554d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:29.934121 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38774e5-6b2b-4365-a57b-e1aeedaa554d service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:29.944090 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1377/2749] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:43:29 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:43:29.962111 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad9f92-cca2-4d98-a2f4-9e819b9b71ca None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:29.966414 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89594163-a579-4f8e-b43c-a8714f5f759f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:29.967061 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89594163-a579-4f8e-b43c-a8714f5f759f service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:29.973644 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89594163-a579-4f8e-b43c-a8714f5f759f service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:29.973644 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89594163-a579-4f8e-b43c-a8714f5f759f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:29.976464 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89594163-a579-4f8e-b43c-a8714f5f759f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:29.977922 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89594163-a579-4f8e-b43c-a8714f5f759f service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:29.987106 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1373/2750] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:43:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:43:30.034445 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38774e5-6b2b-4365-a57b-e1aeedaa554d service cinder] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:30.035969 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-e38774e5-6b2b-4365-a57b-e1aeedaa554d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:30.048493 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38774e5-6b2b-4365-a57b-e1aeedaa554d service cinder] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:30.052486 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b84bdd-da08-468c-883d-8968983fe43d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:30.053162 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b84bdd-da08-468c-883d-8968983fe43d service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:30.053483 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b84bdd-da08-468c-883d-8968983fe43d service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:30.053760 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b84bdd-da08-468c-883d-8968983fe43d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:30.055688 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-27b84bdd-da08-468c-883d-8968983fe43d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:30.131306 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b84bdd-da08-468c-883d-8968983fe43d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:30.133936 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b84bdd-da08-468c-883d-8968983fe43d service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:30.149052 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1378/2751] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:43:30 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:43:31.141606 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d5da4-9277-4794-8586-de57c97e4ce5 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:31.142134 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d5da4-9277-4794-8586-de57c97e4ce5 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:31.142134 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d5da4-9277-4794-8586-de57c97e4ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:31.168208 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-b62d5da4-9277-4794-8586-de57c97e4ce5 None None] MFA Rules not processed for user `0487c655429a4285bd45d53c091170fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:31.169449 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-b62d5da4-9277-4794-8586-de57c97e4ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:31.235255 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1374/2752] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:31 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:43:31.240068 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b84bdd-da08-468c-883d-8968983fe43d service cinder] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:31.251211 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b84bdd-da08-468c-883d-8968983fe43d service cinder] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:31.255884 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734d333-ee31-4920-86a0-173527c96781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:31.256532 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734d333-ee31-4920-86a0-173527c96781 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:31.256817 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734d333-ee31-4920-86a0-173527c96781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:31.257094 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734d333-ee31-4920-86a0-173527c96781 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:31.257840 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7734d333-ee31-4920-86a0-173527c96781 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:31.259706 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7734d333-ee31-4920-86a0-173527c96781 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:31.370449 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1379/2753] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:43:31 2021] POST /identity/v3/projects => generated 405 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:43:31.374795 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d5da4-9277-4794-8586-de57c97e4ce5 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:31.385171 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d5da4-9277-4794-8586-de57c97e4ce5 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:31.438852 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4888069a-aff2-4022-a9ec-e3240221a8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:31.439506 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888069a-aff2-4022-a9ec-e3240221a8d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:31.439784 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888069a-aff2-4022-a9ec-e3240221a8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:31.440056 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888069a-aff2-4022-a9ec-e3240221a8d7 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:31.440744 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4888069a-aff2-4022-a9ec-e3240221a8d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:31.442646 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4888069a-aff2-4022-a9ec-e3240221a8d7 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:31.572268 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1375/2754] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:43:31 2021] POST /identity/v3/users => generated 309 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:43:31.573426 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734d333-ee31-4920-86a0-173527c96781 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:31.584734 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734d333-ee31-4920-86a0-173527c96781 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:31.590763 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff7238-f9ae-4ffa-b074-97fbcbd12649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:31.591139 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff7238-f9ae-4ffa-b074-97fbcbd12649 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:31.591575 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff7238-f9ae-4ffa-b074-97fbcbd12649 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:31.591907 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff7238-f9ae-4ffa-b074-97fbcbd12649 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:31.592789 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff7238-f9ae-4ffa-b074-97fbcbd12649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:31.594530 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff7238-f9ae-4ffa-b074-97fbcbd12649 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:31.605497 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1380/2755] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:43:31 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:43:31.609718 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4888069a-aff2-4022-a9ec-e3240221a8d7 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:31.620234 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4888069a-aff2-4022-a9ec-e3240221a8d7 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:31.625380 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4916df0e-81c5-4fdd-be36-ecd7be78d309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:31.626286 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916df0e-81c5-4fdd-be36-ecd7be78d309 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:31.626602 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916df0e-81c5-4fdd-be36-ecd7be78d309 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:31.626897 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916df0e-81c5-4fdd-be36-ecd7be78d309 admin admin] PATH_INFO: `/v3/projects/ddba7a4e56954bf0a8c78196f930f63a/users/5b90ee149cda4074915e3f575458f19a/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:31.642024 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4916df0e-81c5-4fdd-be36-ecd7be78d309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddba7a4e56954bf0a8c78196f930f63a, user_id=5b90ee149cda4074915e3f575458f19a, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:31.644645 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4916df0e-81c5-4fdd-be36-ecd7be78d309 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:31.701208 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1376/2756] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:43:31 2021] PUT /identity/v3/projects/ddba7a4e56954bf0a8c78196f930f63a/users/5b90ee149cda4074915e3f575458f19a/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:43:31.705018 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff7238-f9ae-4ffa-b074-97fbcbd12649 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:31.716908 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff7238-f9ae-4ffa-b074-97fbcbd12649 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:31.790012 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc427b-c27e-486a-a530-bc65c3a598ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:31.790969 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc427b-c27e-486a-a530-bc65c3a598ea admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:31.791636 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc427b-c27e-486a-a530-bc65c3a598ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:31.792106 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc427b-c27e-486a-a530-bc65c3a598ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:31.793185 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc427b-c27e-486a-a530-bc65c3a598ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:31.795005 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc427b-c27e-486a-a530-bc65c3a598ea admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:31.807011 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1381/2757] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:43:31 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:43:31.812049 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4916df0e-81c5-4fdd-be36-ecd7be78d309 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:31.825499 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4916df0e-81c5-4fdd-be36-ecd7be78d309 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:31.827720 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867792f6-e081-4ac0-89d7-bae483e30560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:31.828604 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867792f6-e081-4ac0-89d7-bae483e30560 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:31.828888 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867792f6-e081-4ac0-89d7-bae483e30560 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:31.829163 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867792f6-e081-4ac0-89d7-bae483e30560 admin admin] PATH_INFO: `/v3/projects/ddba7a4e56954bf0a8c78196f930f63a/users/5b90ee149cda4074915e3f575458f19a/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:31.831202 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867792f6-e081-4ac0-89d7-bae483e30560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddba7a4e56954bf0a8c78196f930f63a, user_id=5b90ee149cda4074915e3f575458f19a, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:31.833971 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867792f6-e081-4ac0-89d7-bae483e30560 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:31.845473 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1377/2758] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:43:31 2021] PUT /identity/v3/projects/ddba7a4e56954bf0a8c78196f930f63a/users/5b90ee149cda4074915e3f575458f19a/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:43:33.255482 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fc1b6-9c50-4193-9cd3-3fda54af3d20 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:33.256020 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fc1b6-9c50-4193-9cd3-3fda54af3d20 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:33.256124 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fc1b6-9c50-4193-9cd3-3fda54af3d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:33.283445 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-1b7fc1b6-9c50-4193-9cd3-3fda54af3d20 None None] MFA Rules not processed for user `5b90ee149cda4074915e3f575458f19a`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:33.284733 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-1b7fc1b6-9c50-4193-9cd3-3fda54af3d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:33.353726 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1382/2759] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:33 2021] POST /identity/v3/auth/tokens => generated 3339 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:43:34.581884 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867792f6-e081-4ac0-89d7-bae483e30560 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:34.628302 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fc1b6-9c50-4193-9cd3-3fda54af3d20 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:34.646610 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867792f6-e081-4ac0-89d7-bae483e30560 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:34.651444 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c8799-90b2-477d-9636-b3274167339c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:34.652399 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c8799-90b2-477d-9636-b3274167339c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:34.653196 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c8799-90b2-477d-9636-b3274167339c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:34.653551 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c8799-90b2-477d-9636-b3274167339c admin admin] PATH_INFO: `/v3/users/0487c655429a4285bd45d53c091170fe` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:34.654764 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c8799-90b2-477d-9636-b3274167339c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0487c655429a4285bd45d53c091170fe)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:34.656654 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c8799-90b2-477d-9636-b3274167339c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:34.690670 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fc1b6-9c50-4193-9cd3-3fda54af3d20 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:34.695321 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fef78b-5640-4f37-85e7-eac6cbc1bd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:34.696184 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fef78b-5640-4f37-85e7-eac6cbc1bd21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:34.696469 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fef78b-5640-4f37-85e7-eac6cbc1bd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:34.696746 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fef78b-5640-4f37-85e7-eac6cbc1bd21 admin admin] PATH_INFO: `/v3/users/5b4f44196eb748779c858e9f63bbaaee` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:34.698008 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fef78b-5640-4f37-85e7-eac6cbc1bd21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b4f44196eb748779c858e9f63bbaaee)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:34.700428 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fef78b-5640-4f37-85e7-eac6cbc1bd21 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:34.827751 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-8f1c8799-90b2-477d-9636-b3274167339c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0487c655429a4285bd45d53c091170fe'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:34.828412 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-8f1c8799-90b2-477d-9636-b3274167339c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0487c655429a4285bd45d53c091170fe'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:34.835082 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-8f1c8799-90b2-477d-9636-b3274167339c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0487c655429a4285bd45d53c091170fe'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:34.835773 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-8f1c8799-90b2-477d-9636-b3274167339c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0487c655429a4285bd45d53c091170fe'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:34.839399 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-51fef78b-5640-4f37-85e7-eac6cbc1bd21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b4f44196eb748779c858e9f63bbaaee'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:34.841089 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-51fef78b-5640-4f37-85e7-eac6cbc1bd21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b4f44196eb748779c858e9f63bbaaee'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:34.847971 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-8f1c8799-90b2-477d-9636-b3274167339c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0487c655429a4285bd45d53c091170fe'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:34.894470 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-51fef78b-5640-4f37-85e7-eac6cbc1bd21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b4f44196eb748779c858e9f63bbaaee'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:34.895047 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-51fef78b-5640-4f37-85e7-eac6cbc1bd21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b4f44196eb748779c858e9f63bbaaee'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:34.907497 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-51fef78b-5640-4f37-85e7-eac6cbc1bd21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b4f44196eb748779c858e9f63bbaaee'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:34.919983 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1383/2760] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:43:34 2021] DELETE /identity/v3/users/5b4f44196eb748779c858e9f63bbaaee => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:43:34.924316 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69ee5f-23c0-4a7f-9e02-57ec27816239 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:34.924624 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69ee5f-23c0-4a7f-9e02-57ec27816239 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:34.924895 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69ee5f-23c0-4a7f-9e02-57ec27816239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:34.941400 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-2d69ee5f-23c0-4a7f-9e02-57ec27816239 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:34.942604 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-2d69ee5f-23c0-4a7f-9e02-57ec27816239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:34.951935 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1378/2761] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:43:34 2021] DELETE /identity/v3/users/0487c655429a4285bd45d53c091170fe => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:43:34.999763 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1384/2762] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:43:35.009628 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c8799-90b2-477d-9636-b3274167339c admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:35.011190 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-8f1c8799-90b2-477d-9636-b3274167339c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:35.068922 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c8799-90b2-477d-9636-b3274167339c admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:35.072848 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784e5c5-bc68-4c33-822f-8ce89af29404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:35.073558 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784e5c5-bc68-4c33-822f-8ce89af29404 service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:35.073840 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784e5c5-bc68-4c33-822f-8ce89af29404 service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:35.074116 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784e5c5-bc68-4c33-822f-8ce89af29404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:35.135761 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784e5c5-bc68-4c33-822f-8ce89af29404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:35.137770 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784e5c5-bc68-4c33-822f-8ce89af29404 service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:35.147211 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1379/2763] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:43:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:43:35.165032 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69ee5f-23c0-4a7f-9e02-57ec27816239 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:35.167012 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-2d69ee5f-23c0-4a7f-9e02-57ec27816239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:35.180494 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69ee5f-23c0-4a7f-9e02-57ec27816239 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:35.187610 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634a4ab-554f-419c-a24b-a0cc32efc9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:35.188578 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634a4ab-554f-419c-a24b-a0cc32efc9b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:35.188868 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634a4ab-554f-419c-a24b-a0cc32efc9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:35.189163 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634a4ab-554f-419c-a24b-a0cc32efc9b1 admin admin] PATH_INFO: `/v3/projects/33aae306238f4dc18446de6c98952b34` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:35.190403 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634a4ab-554f-419c-a24b-a0cc32efc9b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33aae306238f4dc18446de6c98952b34)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:35.192781 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634a4ab-554f-419c-a24b-a0cc32efc9b1 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:35.295239 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-1634a4ab-554f-419c-a24b-a0cc32efc9b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33aae306238f4dc18446de6c98952b34', 'request_id': 'req-1634a4ab-554f-419c-a24b-a0cc32efc9b1'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:35.300753 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-1634a4ab-554f-419c-a24b-a0cc32efc9b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33aae306238f4dc18446de6c98952b34', 'request_id': 'req-1634a4ab-554f-419c-a24b-a0cc32efc9b1'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:35.307046 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-1634a4ab-554f-419c-a24b-a0cc32efc9b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33aae306238f4dc18446de6c98952b34', 'request_id': 'req-1634a4ab-554f-419c-a24b-a0cc32efc9b1'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:35.368433 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-1634a4ab-554f-419c-a24b-a0cc32efc9b1 admin admin] The token cache is being invalidate because project 33aae306238f4dc18446de6c98952b34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:43:35.370387 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-1634a4ab-554f-419c-a24b-a0cc32efc9b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:35.370387 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-1634a4ab-554f-419c-a24b-a0cc32efc9b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:35.370943 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1385/2764] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:43:35 2021] DELETE /identity/v3/projects/33aae306238f4dc18446de6c98952b34 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:43:35.375110 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784e5c5-bc68-4c33-822f-8ce89af29404 service neutron] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:35.384903 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784e5c5-bc68-4c33-822f-8ce89af29404 service neutron] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:35.443447 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d0e04-9e7d-4a17-bd1d-f260b9602e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:35.444342 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d0e04-9e7d-4a17-bd1d-f260b9602e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:35.444626 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d0e04-9e7d-4a17-bd1d-f260b9602e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:35.444899 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d0e04-9e7d-4a17-bd1d-f260b9602e9c admin admin] PATH_INFO: `/v3/users/5b90ee149cda4074915e3f575458f19a` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:35.446138 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d0e04-9e7d-4a17-bd1d-f260b9602e9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b90ee149cda4074915e3f575458f19a)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:35.448053 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d0e04-9e7d-4a17-bd1d-f260b9602e9c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:35.531311 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634a4ab-554f-419c-a24b-a0cc32efc9b1 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:35.533287 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-1634a4ab-554f-419c-a24b-a0cc32efc9b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:35.553806 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634a4ab-554f-419c-a24b-a0cc32efc9b1 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:35.560385 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2265d-8e08-4350-a47a-d64b478acfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:35.561323 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2265d-8e08-4350-a47a-d64b478acfe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:35.561666 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2265d-8e08-4350-a47a-d64b478acfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:35.562059 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2265d-8e08-4350-a47a-d64b478acfe7 admin admin] PATH_INFO: `/v3/projects/0c12ac8a9fb54048904eed8cf7c5ad65` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:35.563425 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2265d-8e08-4350-a47a-d64b478acfe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c12ac8a9fb54048904eed8cf7c5ad65)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:35.565207 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2265d-8e08-4350-a47a-d64b478acfe7 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:35.638789 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-670d0e04-9e7d-4a17-bd1d-f260b9602e9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b90ee149cda4074915e3f575458f19a'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:35.639476 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-670d0e04-9e7d-4a17-bd1d-f260b9602e9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b90ee149cda4074915e3f575458f19a'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:35.646100 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-670d0e04-9e7d-4a17-bd1d-f260b9602e9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b90ee149cda4074915e3f575458f19a'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:35.646725 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-670d0e04-9e7d-4a17-bd1d-f260b9602e9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b90ee149cda4074915e3f575458f19a'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:35.658918 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-670d0e04-9e7d-4a17-bd1d-f260b9602e9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b90ee149cda4074915e3f575458f19a'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:35.672662 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-45b2265d-8e08-4350-a47a-d64b478acfe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c12ac8a9fb54048904eed8cf7c5ad65', 'request_id': 'req-45b2265d-8e08-4350-a47a-d64b478acfe7'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:35.677987 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-45b2265d-8e08-4350-a47a-d64b478acfe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c12ac8a9fb54048904eed8cf7c5ad65', 'request_id': 'req-45b2265d-8e08-4350-a47a-d64b478acfe7'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:35.684523 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-45b2265d-8e08-4350-a47a-d64b478acfe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c12ac8a9fb54048904eed8cf7c5ad65', 'request_id': 'req-45b2265d-8e08-4350-a47a-d64b478acfe7'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:35.728589 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1380/2765] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:43:35 2021] DELETE /identity/v3/users/5b90ee149cda4074915e3f575458f19a => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:43:35.786327 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-45b2265d-8e08-4350-a47a-d64b478acfe7 admin admin] The token cache is being invalidate because project 0c12ac8a9fb54048904eed8cf7c5ad65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:43:35.786647 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-45b2265d-8e08-4350-a47a-d64b478acfe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:35.787286 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-45b2265d-8e08-4350-a47a-d64b478acfe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:35.789385 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1386/2766] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:43:35 2021] DELETE /identity/v3/projects/0c12ac8a9fb54048904eed8cf7c5ad65 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:43:35.795018 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d0e04-9e7d-4a17-bd1d-f260b9602e9c admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:35.796591 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-670d0e04-9e7d-4a17-bd1d-f260b9602e9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:35.863203 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d0e04-9e7d-4a17-bd1d-f260b9602e9c admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:35.867930 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3b914-4f85-43ed-b174-5548271aaf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:35.868794 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3b914-4f85-43ed-b174-5548271aaf62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:35.869073 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3b914-4f85-43ed-b174-5548271aaf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:35.869347 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3b914-4f85-43ed-b174-5548271aaf62 admin admin] PATH_INFO: `/v3/users/08743578843948e1b9d8afccd720dd8f` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:35.870667 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df3b914-4f85-43ed-b174-5548271aaf62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08743578843948e1b9d8afccd720dd8f)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:35.873044 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df3b914-4f85-43ed-b174-5548271aaf62 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:35.947278 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2265d-8e08-4350-a47a-d64b478acfe7 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:35.948703 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-45b2265d-8e08-4350-a47a-d64b478acfe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:36.015002 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2265d-8e08-4350-a47a-d64b478acfe7 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:36.019748 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1019076-227d-4d41-baa2-c8549f15efe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:36.020612 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1019076-227d-4d41-baa2-c8549f15efe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:36.020893 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1019076-227d-4d41-baa2-c8549f15efe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:36.021172 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1019076-227d-4d41-baa2-c8549f15efe2 admin admin] PATH_INFO: `/v3/projects/ddba7a4e56954bf0a8c78196f930f63a` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:36.022550 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1019076-227d-4d41-baa2-c8549f15efe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddba7a4e56954bf0a8c78196f930f63a)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:36.024300 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1019076-227d-4d41-baa2-c8549f15efe2 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:36.035342 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-0df3b914-4f85-43ed-b174-5548271aaf62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08743578843948e1b9d8afccd720dd8f'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:36.036080 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-0df3b914-4f85-43ed-b174-5548271aaf62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08743578843948e1b9d8afccd720dd8f'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:36.042737 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-0df3b914-4f85-43ed-b174-5548271aaf62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08743578843948e1b9d8afccd720dd8f'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:36.044024 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-0df3b914-4f85-43ed-b174-5548271aaf62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08743578843948e1b9d8afccd720dd8f'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:36.055836 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-0df3b914-4f85-43ed-b174-5548271aaf62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08743578843948e1b9d8afccd720dd8f'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:36.134771 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-f1019076-227d-4d41-baa2-c8549f15efe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddba7a4e56954bf0a8c78196f930f63a', 'request_id': 'req-f1019076-227d-4d41-baa2-c8549f15efe2'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:36.140563 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-f1019076-227d-4d41-baa2-c8549f15efe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddba7a4e56954bf0a8c78196f930f63a', 'request_id': 'req-f1019076-227d-4d41-baa2-c8549f15efe2'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:36.146776 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-f1019076-227d-4d41-baa2-c8549f15efe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddba7a4e56954bf0a8c78196f930f63a', 'request_id': 'req-f1019076-227d-4d41-baa2-c8549f15efe2'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:36.151334 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1381/2767] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:43:35 2021] DELETE /identity/v3/users/08743578843948e1b9d8afccd720dd8f => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:43:36.214700 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-f1019076-227d-4d41-baa2-c8549f15efe2 admin admin] The token cache is being invalidate because project ddba7a4e56954bf0a8c78196f930f63a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:43:36.215137 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-f1019076-227d-4d41-baa2-c8549f15efe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:36.220873 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-f1019076-227d-4d41-baa2-c8549f15efe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:36.220873 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1387/2768] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:43:35 2021] DELETE /identity/v3/projects/ddba7a4e56954bf0a8c78196f930f63a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:43:36.223895 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7c82f-e654-4f5b-949c-e249b4d6e51b None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:36.224224 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7c82f-e654-4f5b-949c-e249b4d6e51b None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:36.224493 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7c82f-e654-4f5b-949c-e249b4d6e51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:36.243849 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-c2c7c82f-e654-4f5b-949c-e249b4d6e51b None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:36.244272 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-c2c7c82f-e654-4f5b-949c-e249b4d6e51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:36.302645 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1382/2769] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:43:36.311069 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9f30e-c8f8-45a3-8fe7-2a4e72045f74 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:36.311349 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9f30e-c8f8-45a3-8fe7-2a4e72045f74 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:36.311632 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9f30e-c8f8-45a3-8fe7-2a4e72045f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:36.329905 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-23a9f30e-c8f8-45a3-8fe7-2a4e72045f74 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:36.331095 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-23a9f30e-c8f8-45a3-8fe7-2a4e72045f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:36.339166 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1388/2770] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:43:36.343788 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7c82f-e654-4f5b-949c-e249b4d6e51b None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:36.353182 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7c82f-e654-4f5b-949c-e249b4d6e51b None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:36.358529 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df82ee-704f-4971-b6de-1e5aff859107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:36.359178 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df82ee-704f-4971-b6de-1e5aff859107 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:36.359464 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df82ee-704f-4971-b6de-1e5aff859107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:36.359729 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df82ee-704f-4971-b6de-1e5aff859107 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:36.360461 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df82ee-704f-4971-b6de-1e5aff859107 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:43:36.360766 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df82ee-704f-4971-b6de-1e5aff859107 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:36.362363 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df82ee-704f-4971-b6de-1e5aff859107 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:36.373748 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1383/2771] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:43:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:43:36.378091 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9f30e-c8f8-45a3-8fe7-2a4e72045f74 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:36.387237 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9f30e-c8f8-45a3-8fe7-2a4e72045f74 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:36.391976 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfdada-2a59-4ea8-b2c7-5c84c6bf7a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:36.392625 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfdada-2a59-4ea8-b2c7-5c84c6bf7a29 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:36.392905 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfdada-2a59-4ea8-b2c7-5c84c6bf7a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:36.393178 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfdada-2a59-4ea8-b2c7-5c84c6bf7a29 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:36.393897 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cfdada-2a59-4ea8-b2c7-5c84c6bf7a29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:36.395756 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cfdada-2a59-4ea8-b2c7-5c84c6bf7a29 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:36.490777 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1389/2772] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:43:36 2021] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:43:36.494887 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df82ee-704f-4971-b6de-1e5aff859107 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:36.505241 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df82ee-704f-4971-b6de-1e5aff859107 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:36.528238 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfdada-2a59-4ea8-b2c7-5c84c6bf7a29 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:36.530554 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-20cfdada-2a59-4ea8-b2c7-5c84c6bf7a29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:36.563762 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d7db6-4b98-4ad8-874d-3c69406b1cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:36.564542 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d7db6-4b98-4ad8-874d-3c69406b1cdf admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:36.564829 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d7db6-4b98-4ad8-874d-3c69406b1cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:36.565104 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d7db6-4b98-4ad8-874d-3c69406b1cdf admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:36.565843 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d7db6-4b98-4ad8-874d-3c69406b1cdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:36.567905 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d7db6-4b98-4ad8-874d-3c69406b1cdf admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:36.596271 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cfdada-2a59-4ea8-b2c7-5c84c6bf7a29 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:36.601030 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4429598-5576-45d3-b6c0-70a567d759fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:36.601991 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4429598-5576-45d3-b6c0-70a567d759fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:36.602281 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4429598-5576-45d3-b6c0-70a567d759fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:36.602562 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4429598-5576-45d3-b6c0-70a567d759fb admin admin] PATH_INFO: `/v3/projects/6c2482b3bc7e402e865a1358323f96a8` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:36.603824 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4429598-5576-45d3-b6c0-70a567d759fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c2482b3bc7e402e865a1358323f96a8)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:36.605937 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4429598-5576-45d3-b6c0-70a567d759fb admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:36.649052 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1384/2773] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:43:36 2021] POST /identity/v3/users => generated 291 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:43:36.652939 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d7db6-4b98-4ad8-874d-3c69406b1cdf admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:36.662603 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d7db6-4b98-4ad8-874d-3c69406b1cdf admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:36.667307 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676b699-1a94-437e-a5ad-720d192a7271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:36.668720 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676b699-1a94-437e-a5ad-720d192a7271 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:36.669267 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676b699-1a94-437e-a5ad-720d192a7271 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:36.669442 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676b699-1a94-437e-a5ad-720d192a7271 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:36.670126 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a676b699-1a94-437e-a5ad-720d192a7271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:36.671708 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a676b699-1a94-437e-a5ad-720d192a7271 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:36.681552 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1385/2774] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:43:36 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:43:36.686207 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676b699-1a94-437e-a5ad-720d192a7271 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:36.695423 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676b699-1a94-437e-a5ad-720d192a7271 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:36.700187 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21dc14-c850-4149-a8be-cad5472e09a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:36.700808 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21dc14-c850-4149-a8be-cad5472e09a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:36.701092 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21dc14-c850-4149-a8be-cad5472e09a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:36.701369 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21dc14-c850-4149-a8be-cad5472e09a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:36.702190 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21dc14-c850-4149-a8be-cad5472e09a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:36.703773 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21dc14-c850-4149-a8be-cad5472e09a7 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:36.714338 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1386/2775] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:43:36 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:43:36.717589 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-d4429598-5576-45d3-b6c0-70a567d759fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c2482b3bc7e402e865a1358323f96a8', 'request_id': 'req-d4429598-5576-45d3-b6c0-70a567d759fb'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:36.718335 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21dc14-c850-4149-a8be-cad5472e09a7 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:36.722881 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-d4429598-5576-45d3-b6c0-70a567d759fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c2482b3bc7e402e865a1358323f96a8', 'request_id': 'req-d4429598-5576-45d3-b6c0-70a567d759fb'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:36.727518 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21dc14-c850-4149-a8be-cad5472e09a7 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:36.729092 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-d4429598-5576-45d3-b6c0-70a567d759fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c2482b3bc7e402e865a1358323f96a8', 'request_id': 'req-d4429598-5576-45d3-b6c0-70a567d759fb'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:36.780418 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d31921-896e-43a9-8f6b-d9aa938e990c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:36.781247 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d31921-896e-43a9-8f6b-d9aa938e990c admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:36.781565 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d31921-896e-43a9-8f6b-d9aa938e990c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:36.787927 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d31921-896e-43a9-8f6b-d9aa938e990c admin admin] PATH_INFO: `/v3/projects/cea3f921f7a94706b50c69508b401262/users/5034d78ca4dc4f6785dd4ecf22180fd1/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:36.797112 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d31921-896e-43a9-8f6b-d9aa938e990c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cea3f921f7a94706b50c69508b401262, user_id=5034d78ca4dc4f6785dd4ecf22180fd1, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:36.799819 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d31921-896e-43a9-8f6b-d9aa938e990c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:36.808024 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-d4429598-5576-45d3-b6c0-70a567d759fb admin admin] The token cache is being invalidate because project 6c2482b3bc7e402e865a1358323f96a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:43:36.809314 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-d4429598-5576-45d3-b6c0-70a567d759fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:36.809643 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-d4429598-5576-45d3-b6c0-70a567d759fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:36.811526 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1390/2776] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:43:36 2021] DELETE /identity/v3/projects/6c2482b3bc7e402e865a1358323f96a8 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:43:36.816958 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792022eb-bf0c-42e6-bc1c-a98a3c8372f2 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:36.817245 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792022eb-bf0c-42e6-bc1c-a98a3c8372f2 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:36.817557 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792022eb-bf0c-42e6-bc1c-a98a3c8372f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:36.835332 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-792022eb-bf0c-42e6-bc1c-a98a3c8372f2 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:36.836522 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-792022eb-bf0c-42e6-bc1c-a98a3c8372f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:36.844395 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1391/2777] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:43:36.851621 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8fe21-fff3-429e-9866-c5202242f363 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:36.851910 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8fe21-fff3-429e-9866-c5202242f363 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:36.852185 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8fe21-fff3-429e-9866-c5202242f363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:36.861041 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1387/2778] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:43:36 2021] PUT /identity/v3/projects/cea3f921f7a94706b50c69508b401262/users/5034d78ca4dc4f6785dd4ecf22180fd1/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:43:36.870190 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-bea8fe21-fff3-429e-9866-c5202242f363 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:36.872226 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-bea8fe21-fff3-429e-9866-c5202242f363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:36.872427 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a429e5-1184-431f-b090-9daa6b68b104 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:36.872685 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a429e5-1184-431f-b090-9daa6b68b104 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:36.872962 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a429e5-1184-431f-b090-9daa6b68b104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:36.898750 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-b2a429e5-1184-431f-b090-9daa6b68b104 None None] MFA Rules not processed for user `5034d78ca4dc4f6785dd4ecf22180fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:36.899949 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-b2a429e5-1184-431f-b090-9daa6b68b104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:36.929806 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1392/2779] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:43:36.935430 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8fe21-fff3-429e-9866-c5202242f363 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:36.944148 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8fe21-fff3-429e-9866-c5202242f363 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:36.949037 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8336af-e5f6-48f8-8090-4be8de500f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:36.949888 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8336af-e5f6-48f8-8090-4be8de500f79 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:36.950117 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8336af-e5f6-48f8-8090-4be8de500f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:36.950433 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8336af-e5f6-48f8-8090-4be8de500f79 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:36.951160 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8336af-e5f6-48f8-8090-4be8de500f79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:43:36.951470 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8336af-e5f6-48f8-8090-4be8de500f79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:36.953034 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8336af-e5f6-48f8-8090-4be8de500f79 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:36.962811 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1388/2780] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:36 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:43:36.966431 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1393/2781] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:43:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:43:36.967247 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a429e5-1184-431f-b090-9daa6b68b104 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:36.968483 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8336af-e5f6-48f8-8090-4be8de500f79 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:36.968773 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-b2a429e5-1184-431f-b090-9daa6b68b104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:36.978664 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8336af-e5f6-48f8-8090-4be8de500f79 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:36.982450 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a429e5-1184-431f-b090-9daa6b68b104 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:36.984375 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59348749-8e5c-4ed1-96d5-d9674c9798bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:36.985012 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59348749-8e5c-4ed1-96d5-d9674c9798bd admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:36.985296 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59348749-8e5c-4ed1-96d5-d9674c9798bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:36.985601 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59348749-8e5c-4ed1-96d5-d9674c9798bd admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:36.986295 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59348749-8e5c-4ed1-96d5-d9674c9798bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:36.987402 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678ac21-3301-4a47-b612-f92cc2dd552e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:36.988052 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678ac21-3301-4a47-b612-f92cc2dd552e admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:36.988175 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59348749-8e5c-4ed1-96d5-d9674c9798bd admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:36.988380 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678ac21-3301-4a47-b612-f92cc2dd552e admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:36.988607 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678ac21-3301-4a47-b612-f92cc2dd552e admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:36.989366 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2678ac21-3301-4a47-b612-f92cc2dd552e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:36.991301 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2678ac21-3301-4a47-b612-f92cc2dd552e admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:37.072762 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1394/2782] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:43:36 2021] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:43:37.076863 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59348749-8e5c-4ed1-96d5-d9674c9798bd admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:37.102953 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1389/2783] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:43:36 2021] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:43:37.106918 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678ac21-3301-4a47-b612-f92cc2dd552e admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:37.141996 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59348749-8e5c-4ed1-96d5-d9674c9798bd admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:37.168081 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678ac21-3301-4a47-b612-f92cc2dd552e admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:37.173627 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ada47a-0e0f-45d1-8694-3f868070a9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:37.174285 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ada47a-0e0f-45d1-8694-3f868070a9ee admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:37.174562 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ada47a-0e0f-45d1-8694-3f868070a9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:37.174832 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ada47a-0e0f-45d1-8694-3f868070a9ee admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:37.175522 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ada47a-0e0f-45d1-8694-3f868070a9ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:37.177381 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ada47a-0e0f-45d1-8694-3f868070a9ee admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:37.196983 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c7920-80c7-4d91-bff9-20cbe88088a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:37.197687 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c7920-80c7-4d91-bff9-20cbe88088a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:37.197976 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c7920-80c7-4d91-bff9-20cbe88088a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:37.198252 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c7920-80c7-4d91-bff9-20cbe88088a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:37.198947 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c7920-80c7-4d91-bff9-20cbe88088a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:37.200870 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c7920-80c7-4d91-bff9-20cbe88088a9 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:37.277338 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1390/2784] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:43:37 2021] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:43:37.281958 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ada47a-0e0f-45d1-8694-3f868070a9ee admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:37.291257 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ada47a-0e0f-45d1-8694-3f868070a9ee admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:37.296838 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35ee1a-966a-4a8a-bc93-c5588b22916b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:37.297544 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35ee1a-966a-4a8a-bc93-c5588b22916b admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:37.297920 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35ee1a-966a-4a8a-bc93-c5588b22916b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:37.298200 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35ee1a-966a-4a8a-bc93-c5588b22916b admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:37.298928 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b35ee1a-966a-4a8a-bc93-c5588b22916b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:37.300503 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b35ee1a-966a-4a8a-bc93-c5588b22916b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:37.311760 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1391/2785] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:43:37 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:43:37.313567 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1395/2786] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:43:37 2021] POST /identity/v3/users => generated 291 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:43:37.320643 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35ee1a-966a-4a8a-bc93-c5588b22916b admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:37.322282 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c7920-80c7-4d91-bff9-20cbe88088a9 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:37.330886 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35ee1a-966a-4a8a-bc93-c5588b22916b admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:37.332380 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c7920-80c7-4d91-bff9-20cbe88088a9 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:37.335654 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df94cf-9114-42c2-831d-53f43fcd09c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:37.336530 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df94cf-9114-42c2-831d-53f43fcd09c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:37.336811 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df94cf-9114-42c2-831d-53f43fcd09c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:37.341177 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8c307-5889-41d5-9ba9-9646d75b6a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:37.341301 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df94cf-9114-42c2-831d-53f43fcd09c0 admin admin] PATH_INFO: `/v3/projects/c8966d34938c48cd9d31f162c7ec5880/users/6008e2ecab554824ae579dc009b5e5dc/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:37.341398 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8c307-5889-41d5-9ba9-9646d75b6a69 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:37.341398 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8c307-5889-41d5-9ba9-9646d75b6a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:37.341398 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8c307-5889-41d5-9ba9-9646d75b6a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:37.341398 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d8c307-5889-41d5-9ba9-9646d75b6a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:37.341398 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d8c307-5889-41d5-9ba9-9646d75b6a69 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:37.353867 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df94cf-9114-42c2-831d-53f43fcd09c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8966d34938c48cd9d31f162c7ec5880, user_id=6008e2ecab554824ae579dc009b5e5dc, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:37.355228 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1396/2787] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:43:37 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:43:37.356937 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8c307-5889-41d5-9ba9-9646d75b6a69 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:37.357424 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df94cf-9114-42c2-831d-53f43fcd09c0 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:37.367096 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8c307-5889-41d5-9ba9-9646d75b6a69 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:37.371665 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61073bf-2e03-4386-bdac-37f29b70b44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:37.372940 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61073bf-2e03-4386-bdac-37f29b70b44e admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:37.373227 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61073bf-2e03-4386-bdac-37f29b70b44e admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:37.375295 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61073bf-2e03-4386-bdac-37f29b70b44e admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:37.376029 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61073bf-2e03-4386-bdac-37f29b70b44e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:37.377612 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61073bf-2e03-4386-bdac-37f29b70b44e admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:37.388541 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1397/2788] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:43:37 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:43:37.392559 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61073bf-2e03-4386-bdac-37f29b70b44e admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:37.401871 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61073bf-2e03-4386-bdac-37f29b70b44e admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:37.407203 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f514e-1e98-42aa-997d-d4ce1bc753e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:37.408065 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f514e-1e98-42aa-997d-d4ce1bc753e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:37.409690 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f514e-1e98-42aa-997d-d4ce1bc753e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:37.409690 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f514e-1e98-42aa-997d-d4ce1bc753e2 admin admin] PATH_INFO: `/v3/projects/76370d14db874b45996645da629aa7b3/users/fa1f7668aba04b73b01d5eb68ae7659c/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:37.423354 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f514e-1e98-42aa-997d-d4ce1bc753e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76370d14db874b45996645da629aa7b3, user_id=fa1f7668aba04b73b01d5eb68ae7659c, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:37.426077 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f514e-1e98-42aa-997d-d4ce1bc753e2 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:37.428667 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1392/2789] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:43:37 2021] PUT /identity/v3/projects/c8966d34938c48cd9d31f162c7ec5880/users/6008e2ecab554824ae579dc009b5e5dc/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:43:37.432931 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df94cf-9114-42c2-831d-53f43fcd09c0 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:37.495525 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df94cf-9114-42c2-831d-53f43fcd09c0 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:37.502605 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1398/2790] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:43:37 2021] PUT /identity/v3/projects/76370d14db874b45996645da629aa7b3/users/fa1f7668aba04b73b01d5eb68ae7659c/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:43:37.514083 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896004bf-4eef-4ee1-b471-045dd3e9739a None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:37.514369 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896004bf-4eef-4ee1-b471-045dd3e9739a None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:37.514647 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896004bf-4eef-4ee1-b471-045dd3e9739a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:37.542252 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-896004bf-4eef-4ee1-b471-045dd3e9739a None None] MFA Rules not processed for user `fa1f7668aba04b73b01d5eb68ae7659c`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:37.543505 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-896004bf-4eef-4ee1-b471-045dd3e9739a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:37.556347 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523459d-884d-44ba-b8a5-ce80291eeafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:37.557599 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523459d-884d-44ba-b8a5-ce80291eeafd admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:37.558241 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523459d-884d-44ba-b8a5-ce80291eeafd admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:37.558755 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523459d-884d-44ba-b8a5-ce80291eeafd admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:37.560413 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523459d-884d-44ba-b8a5-ce80291eeafd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:37.563547 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523459d-884d-44ba-b8a5-ce80291eeafd admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:37.574566 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1393/2791] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:43:37 2021] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:43:37.579772 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523459d-884d-44ba-b8a5-ce80291eeafd admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:37.589604 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523459d-884d-44ba-b8a5-ce80291eeafd admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:37.596288 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168c127-4db1-4b1c-8828-5c0036d23e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:37.597169 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168c127-4db1-4b1c-8828-5c0036d23e74 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:37.597473 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168c127-4db1-4b1c-8828-5c0036d23e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:37.597751 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168c127-4db1-4b1c-8828-5c0036d23e74 admin admin] PATH_INFO: `/v3/projects/c8966d34938c48cd9d31f162c7ec5880/users/6008e2ecab554824ae579dc009b5e5dc/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:37.599775 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168c127-4db1-4b1c-8828-5c0036d23e74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8966d34938c48cd9d31f162c7ec5880, user_id=6008e2ecab554824ae579dc009b5e5dc, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:37.602501 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168c127-4db1-4b1c-8828-5c0036d23e74 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:37.611566 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1399/2792] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:37 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:43:37.613712 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1394/2793] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:43:37 2021] PUT /identity/v3/projects/c8966d34938c48cd9d31f162c7ec5880/users/6008e2ecab554824ae579dc009b5e5dc/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:43:37.615903 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896004bf-4eef-4ee1-b471-045dd3e9739a None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:37.623780 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f989f3-fc1c-4396-b7b8-5887f96052b0 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:37.624068 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f989f3-fc1c-4396-b7b8-5887f96052b0 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:37.624351 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f989f3-fc1c-4396-b7b8-5887f96052b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:37.626822 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896004bf-4eef-4ee1-b471-045dd3e9739a None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:37.650882 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-a8f989f3-fc1c-4396-b7b8-5887f96052b0 None None] MFA Rules not processed for user `6008e2ecab554824ae579dc009b5e5dc`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:37.652076 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-a8f989f3-fc1c-4396-b7b8-5887f96052b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:37.683115 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84139de9-316a-4ebb-a2f7-95fa36a68d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:37.683796 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84139de9-316a-4ebb-a2f7-95fa36a68d84 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:37.684083 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84139de9-316a-4ebb-a2f7-95fa36a68d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:37.684565 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84139de9-316a-4ebb-a2f7-95fa36a68d84 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:37.685545 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84139de9-316a-4ebb-a2f7-95fa36a68d84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:37.687438 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84139de9-316a-4ebb-a2f7-95fa36a68d84 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:37.719351 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1395/2794] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:37 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:43:37.724910 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f989f3-fc1c-4396-b7b8-5887f96052b0 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:37.734869 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f989f3-fc1c-4396-b7b8-5887f96052b0 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:37.739521 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673bb8f-4e17-47d3-a189-80b496f7bba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:37.740363 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673bb8f-4e17-47d3-a189-80b496f7bba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:37.740643 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673bb8f-4e17-47d3-a189-80b496f7bba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:37.740918 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673bb8f-4e17-47d3-a189-80b496f7bba7 admin admin] PATH_INFO: `/v3/users/5034d78ca4dc4f6785dd4ecf22180fd1` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:37.742107 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673bb8f-4e17-47d3-a189-80b496f7bba7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5034d78ca4dc4f6785dd4ecf22180fd1)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:37.744067 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673bb8f-4e17-47d3-a189-80b496f7bba7 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:37.771049 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1400/2795] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:43:37 2021] POST /identity/v3/projects => generated 381 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:43:37.774957 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84139de9-316a-4ebb-a2f7-95fa36a68d84 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:37.833795 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84139de9-316a-4ebb-a2f7-95fa36a68d84 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:37.838528 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736dd91-6b27-4641-99e4-58e573e0d655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:37.839213 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736dd91-6b27-4641-99e4-58e573e0d655 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:37.839491 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736dd91-6b27-4641-99e4-58e573e0d655 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:37.839813 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736dd91-6b27-4641-99e4-58e573e0d655 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:37.840474 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736dd91-6b27-4641-99e4-58e573e0d655 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:37.842373 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9736dd91-6b27-4641-99e4-58e573e0d655 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:37.913574 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-f673bb8f-4e17-47d3-a189-80b496f7bba7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5034d78ca4dc4f6785dd4ecf22180fd1'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:37.914252 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-f673bb8f-4e17-47d3-a189-80b496f7bba7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5034d78ca4dc4f6785dd4ecf22180fd1'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:37.921562 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-f673bb8f-4e17-47d3-a189-80b496f7bba7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5034d78ca4dc4f6785dd4ecf22180fd1'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:37.922276 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-f673bb8f-4e17-47d3-a189-80b496f7bba7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5034d78ca4dc4f6785dd4ecf22180fd1'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:37.923254 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1401/2796] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:43:37 2021] POST /identity/v3/users => generated 297 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:43:37.927107 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736dd91-6b27-4641-99e4-58e573e0d655 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:37.928766 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-9736dd91-6b27-4641-99e4-58e573e0d655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:37.936534 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-f673bb8f-4e17-47d3-a189-80b496f7bba7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5034d78ca4dc4f6785dd4ecf22180fd1'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:37.941295 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736dd91-6b27-4641-99e4-58e573e0d655 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:37.945902 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81c59b-520f-45bd-a9f7-c89fa71316f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:37.946544 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81c59b-520f-45bd-a9f7-c89fa71316f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:37.946822 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81c59b-520f-45bd-a9f7-c89fa71316f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:37.947097 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81c59b-520f-45bd-a9f7-c89fa71316f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:37.947823 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a81c59b-520f-45bd-a9f7-c89fa71316f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:37.949432 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a81c59b-520f-45bd-a9f7-c89fa71316f4 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:37.960026 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1402/2797] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:43:37 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:43:37.964278 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81c59b-520f-45bd-a9f7-c89fa71316f4 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:37.974026 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81c59b-520f-45bd-a9f7-c89fa71316f4 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:37.978672 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4553722c-e107-4538-a7e5-099d7a7b1fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:37.979570 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553722c-e107-4538-a7e5-099d7a7b1fc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:37.979881 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553722c-e107-4538-a7e5-099d7a7b1fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:37.980158 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553722c-e107-4538-a7e5-099d7a7b1fc0 admin admin] PATH_INFO: `/v3/projects/431af47064ec45749cc02f72b5433e0b/users/de367c08b41d404ab5a71a821cdfa20c/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:37.995015 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4553722c-e107-4538-a7e5-099d7a7b1fc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=431af47064ec45749cc02f72b5433e0b, user_id=de367c08b41d404ab5a71a821cdfa20c, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:37.997907 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1396/2798] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:43:37 2021] DELETE /identity/v3/users/5034d78ca4dc4f6785dd4ecf22180fd1 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:43:38.000574 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4553722c-e107-4538-a7e5-099d7a7b1fc0 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:38.002225 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460511f-e378-40a1-a3f6-62c0a74b91c1 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:38.002650 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460511f-e378-40a1-a3f6-62c0a74b91c1 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:38.002937 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460511f-e378-40a1-a3f6-62c0a74b91c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:38.019918 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-8460511f-e378-40a1-a3f6-62c0a74b91c1 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:38.023535 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-8460511f-e378-40a1-a3f6-62c0a74b91c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:38.077583 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1397/2799] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:43:38.077981 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1403/2800] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:43:37 2021] PUT /identity/v3/projects/431af47064ec45749cc02f72b5433e0b/users/de367c08b41d404ab5a71a821cdfa20c/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:43:38.081926 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460511f-e378-40a1-a3f6-62c0a74b91c1 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:38.087891 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4553722c-e107-4538-a7e5-099d7a7b1fc0 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:38.089669 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-4553722c-e107-4538-a7e5-099d7a7b1fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:38.091573 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460511f-e378-40a1-a3f6-62c0a74b91c1 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:38.145322 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4553722c-e107-4538-a7e5-099d7a7b1fc0 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:38.146574 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999fa2a-c9aa-4e4d-ac62-5657ab90fd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:38.147237 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999fa2a-c9aa-4e4d-ac62-5657ab90fd38 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:38.147522 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999fa2a-c9aa-4e4d-ac62-5657ab90fd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:38.147779 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999fa2a-c9aa-4e4d-ac62-5657ab90fd38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:38.148517 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999fa2a-c9aa-4e4d-ac62-5657ab90fd38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:38.149235 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b7798-ab84-445a-9573-00f7d7c908d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:38.149909 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b7798-ab84-445a-9573-00f7d7c908d5 service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:38.150142 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999fa2a-c9aa-4e4d-ac62-5657ab90fd38 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:38.150251 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b7798-ab84-445a-9573-00f7d7c908d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:38.150480 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b7798-ab84-445a-9573-00f7d7c908d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:38.159699 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b7798-ab84-445a-9573-00f7d7c908d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:38.163082 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1398/2801] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:43:38 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:43:38.163224 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b7798-ab84-445a-9573-00f7d7c908d5 service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:38.164039 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999fa2a-c9aa-4e4d-ac62-5657ab90fd38 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:38.171977 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1404/2802] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:43:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:43:38.174031 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999fa2a-c9aa-4e4d-ac62-5657ab90fd38 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:38.178698 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5614a2-2707-4796-8011-4c9cef282539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:38.179570 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5614a2-2707-4796-8011-4c9cef282539 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:38.179908 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5614a2-2707-4796-8011-4c9cef282539 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:38.180250 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5614a2-2707-4796-8011-4c9cef282539 admin admin] PATH_INFO: `/v3/projects/431af47064ec45749cc02f72b5433e0b/users/de367c08b41d404ab5a71a821cdfa20c/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:38.182411 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5614a2-2707-4796-8011-4c9cef282539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=431af47064ec45749cc02f72b5433e0b, user_id=de367c08b41d404ab5a71a821cdfa20c, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:38.185706 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5614a2-2707-4796-8011-4c9cef282539 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:38.196053 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1399/2803] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:43:38 2021] PUT /identity/v3/projects/431af47064ec45749cc02f72b5433e0b/users/de367c08b41d404ab5a71a821cdfa20c/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:43:38.206160 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d767f-a834-4c26-86d0-6100876dbf8f None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:38.207041 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d767f-a834-4c26-86d0-6100876dbf8f None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:38.207041 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d767f-a834-4c26-86d0-6100876dbf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:38.234122 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-186d767f-a834-4c26-86d0-6100876dbf8f None None] MFA Rules not processed for user `de367c08b41d404ab5a71a821cdfa20c`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:38.235608 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-186d767f-a834-4c26-86d0-6100876dbf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:38.303867 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1405/2804] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:38 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:43:38.314804 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5614a2-2707-4796-8011-4c9cef282539 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:38.316543 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-bd5614a2-2707-4796-8011-4c9cef282539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:38.375350 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5614a2-2707-4796-8011-4c9cef282539 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:38.378973 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d5003-9f73-44f8-85e5-06debb8271aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:38.379633 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d5003-9f73-44f8-85e5-06debb8271aa service cinder] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:38.379915 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d5003-9f73-44f8-85e5-06debb8271aa service cinder] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:38.380194 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d5003-9f73-44f8-85e5-06debb8271aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:38.391726 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d5003-9f73-44f8-85e5-06debb8271aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:38.393711 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d5003-9f73-44f8-85e5-06debb8271aa service cinder] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:38.403452 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1400/2805] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:43:38 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:43:38.504356 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d767f-a834-4c26-86d0-6100876dbf8f None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:38.514975 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d767f-a834-4c26-86d0-6100876dbf8f None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:38.518532 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1bdee-1d4a-42f9-bc40-a35e1a6c6cb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:38.519159 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1bdee-1d4a-42f9-bc40-a35e1a6c6cb9 service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:38.519438 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1bdee-1d4a-42f9-bc40-a35e1a6c6cb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:38.519711 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1bdee-1d4a-42f9-bc40-a35e1a6c6cb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:38.521483 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-caf1bdee-1d4a-42f9-bc40-a35e1a6c6cb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:38.565591 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d5003-9f73-44f8-85e5-06debb8271aa service cinder] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:38.567037 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-8a1d5003-9f73-44f8-85e5-06debb8271aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:38.581809 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1bdee-1d4a-42f9-bc40-a35e1a6c6cb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:38.583234 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1bdee-1d4a-42f9-bc40-a35e1a6c6cb9 service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:38.593021 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1406/2806] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:43:38 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:43:38.648020 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d5003-9f73-44f8-85e5-06debb8271aa service cinder] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:38.652581 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6321d8-0030-446f-9296-83aacec08580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:38.654519 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6321d8-0030-446f-9296-83aacec08580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:38.654799 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6321d8-0030-446f-9296-83aacec08580 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:38.655075 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6321d8-0030-446f-9296-83aacec08580 admin admin] PATH_INFO: `/v3/projects/cea3f921f7a94706b50c69508b401262` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:38.656280 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6321d8-0030-446f-9296-83aacec08580 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cea3f921f7a94706b50c69508b401262)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:38.658186 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6321d8-0030-446f-9296-83aacec08580 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:38.785417 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-3a6321d8-0030-446f-9296-83aacec08580 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cea3f921f7a94706b50c69508b401262', 'request_id': 'req-3a6321d8-0030-446f-9296-83aacec08580'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:38.791430 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-3a6321d8-0030-446f-9296-83aacec08580 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cea3f921f7a94706b50c69508b401262', 'request_id': 'req-3a6321d8-0030-446f-9296-83aacec08580'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:38.797494 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-3a6321d8-0030-446f-9296-83aacec08580 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cea3f921f7a94706b50c69508b401262', 'request_id': 'req-3a6321d8-0030-446f-9296-83aacec08580'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:38.860555 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-3a6321d8-0030-446f-9296-83aacec08580 admin admin] The token cache is being invalidate because project cea3f921f7a94706b50c69508b401262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:43:38.860845 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-3a6321d8-0030-446f-9296-83aacec08580 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:38.861531 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-3a6321d8-0030-446f-9296-83aacec08580 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:38.863070 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1401/2807] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:43:38 2021] DELETE /identity/v3/projects/cea3f921f7a94706b50c69508b401262 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:43:38.867043 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1bdee-1d4a-42f9-bc40-a35e1a6c6cb9 service cinder] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:38.878727 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1bdee-1d4a-42f9-bc40-a35e1a6c6cb9 service cinder] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:38.939624 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e520e7c-a1fa-4e05-bf11-fb9f64ae1096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:38.940504 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e520e7c-a1fa-4e05-bf11-fb9f64ae1096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:38.940821 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e520e7c-a1fa-4e05-bf11-fb9f64ae1096 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:38.941096 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e520e7c-a1fa-4e05-bf11-fb9f64ae1096 admin admin] PATH_INFO: `/v3/users/6008e2ecab554824ae579dc009b5e5dc` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:38.942388 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e520e7c-a1fa-4e05-bf11-fb9f64ae1096 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6008e2ecab554824ae579dc009b5e5dc)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:38.944948 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e520e7c-a1fa-4e05-bf11-fb9f64ae1096 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:39.097267 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-8e520e7c-a1fa-4e05-bf11-fb9f64ae1096 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6008e2ecab554824ae579dc009b5e5dc'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:39.097967 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-8e520e7c-a1fa-4e05-bf11-fb9f64ae1096 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6008e2ecab554824ae579dc009b5e5dc'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:39.157511 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-8e520e7c-a1fa-4e05-bf11-fb9f64ae1096 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6008e2ecab554824ae579dc009b5e5dc'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:39.158181 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-8e520e7c-a1fa-4e05-bf11-fb9f64ae1096 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6008e2ecab554824ae579dc009b5e5dc'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:39.171419 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-8e520e7c-a1fa-4e05-bf11-fb9f64ae1096 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6008e2ecab554824ae579dc009b5e5dc'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:39.183236 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1407/2808] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:43:38 2021] DELETE /identity/v3/users/6008e2ecab554824ae579dc009b5e5dc => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:43:39.564868 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6321d8-0030-446f-9296-83aacec08580 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:39.566447 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-3a6321d8-0030-446f-9296-83aacec08580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:39.586980 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6321d8-0030-446f-9296-83aacec08580 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:39.645877 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df2403-e003-4479-879c-40f372edcadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:39.646808 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df2403-e003-4479-879c-40f372edcadf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:39.647061 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df2403-e003-4479-879c-40f372edcadf admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:39.647338 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df2403-e003-4479-879c-40f372edcadf admin admin] PATH_INFO: `/v3/projects/c8966d34938c48cd9d31f162c7ec5880` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:39.648536 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df2403-e003-4479-879c-40f372edcadf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8966d34938c48cd9d31f162c7ec5880)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:39.650585 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df2403-e003-4479-879c-40f372edcadf admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:39.768415 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-61df2403-e003-4479-879c-40f372edcadf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8966d34938c48cd9d31f162c7ec5880', 'request_id': 'req-61df2403-e003-4479-879c-40f372edcadf'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:39.774451 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-61df2403-e003-4479-879c-40f372edcadf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8966d34938c48cd9d31f162c7ec5880', 'request_id': 'req-61df2403-e003-4479-879c-40f372edcadf'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:39.780429 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-61df2403-e003-4479-879c-40f372edcadf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8966d34938c48cd9d31f162c7ec5880', 'request_id': 'req-61df2403-e003-4479-879c-40f372edcadf'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:39.848602 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-61df2403-e003-4479-879c-40f372edcadf admin admin] The token cache is being invalidate because project c8966d34938c48cd9d31f162c7ec5880 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:43:39.848824 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-61df2403-e003-4479-879c-40f372edcadf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:39.849486 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-61df2403-e003-4479-879c-40f372edcadf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:39.851011 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1402/2809] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:43:39 2021] DELETE /identity/v3/projects/c8966d34938c48cd9d31f162c7ec5880 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:43:39.859972 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24b557-e543-40d3-899a-6c3685a62b2d None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:39.860265 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24b557-e543-40d3-899a-6c3685a62b2d None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:39.860543 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24b557-e543-40d3-899a-6c3685a62b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:39.878351 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-cd24b557-e543-40d3-899a-6c3685a62b2d None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:39.879539 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-cd24b557-e543-40d3-899a-6c3685a62b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:39.936861 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1408/2810] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:43:39.945798 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f8b97-7c5e-4d07-96f3-346598635de6 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:39.946089 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f8b97-7c5e-4d07-96f3-346598635de6 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:39.946369 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f8b97-7c5e-4d07-96f3-346598635de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:39.964575 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-9d3f8b97-7c5e-4d07-96f3-346598635de6 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:39.966507 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-9d3f8b97-7c5e-4d07-96f3-346598635de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:39.974605 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1403/2811] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:43:39.978673 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24b557-e543-40d3-899a-6c3685a62b2d None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:39.988850 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24b557-e543-40d3-899a-6c3685a62b2d None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:39.993354 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512019fa-c32b-4132-a704-cbf46f16f0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:39.994034 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512019fa-c32b-4132-a704-cbf46f16f0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:39.994315 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512019fa-c32b-4132-a704-cbf46f16f0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:39.994589 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512019fa-c32b-4132-a704-cbf46f16f0d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:39.995315 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512019fa-c32b-4132-a704-cbf46f16f0d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:43:39.995620 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512019fa-c32b-4132-a704-cbf46f16f0d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:39.998249 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512019fa-c32b-4132-a704-cbf46f16f0d7 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:40.009538 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1409/2812] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:43:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:43:40.013674 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f8b97-7c5e-4d07-96f3-346598635de6 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:40.022649 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f8b97-7c5e-4d07-96f3-346598635de6 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:40.027170 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97a841-bcb5-41bc-897c-812ae1044335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:40.027805 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97a841-bcb5-41bc-897c-812ae1044335 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:40.028725 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97a841-bcb5-41bc-897c-812ae1044335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:40.029228 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97a841-bcb5-41bc-897c-812ae1044335 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:40.029820 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97a841-bcb5-41bc-897c-812ae1044335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:40.031675 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97a841-bcb5-41bc-897c-812ae1044335 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:40.107130 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1404/2813] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:43:40 2021] POST /identity/v3/projects => generated 399 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:43:40.111262 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512019fa-c32b-4132-a704-cbf46f16f0d7 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:40.121005 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512019fa-c32b-4132-a704-cbf46f16f0d7 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:40.175421 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31679be-81bc-4d4b-a655-55162d8c125a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:40.176203 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31679be-81bc-4d4b-a655-55162d8c125a admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:40.176489 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31679be-81bc-4d4b-a655-55162d8c125a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:40.176763 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31679be-81bc-4d4b-a655-55162d8c125a admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:40.177514 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31679be-81bc-4d4b-a655-55162d8c125a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:40.179398 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31679be-81bc-4d4b-a655-55162d8c125a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:40.251777 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1410/2814] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:43:40 2021] POST /identity/v3/users => generated 300 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:43:40.253260 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97a841-bcb5-41bc-897c-812ae1044335 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:40.263822 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97a841-bcb5-41bc-897c-812ae1044335 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:40.268799 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b94f91-4d34-4b0b-aac7-e02bf185177b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:40.270927 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b94f91-4d34-4b0b-aac7-e02bf185177b admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:40.270927 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b94f91-4d34-4b0b-aac7-e02bf185177b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:40.270927 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b94f91-4d34-4b0b-aac7-e02bf185177b admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:40.270927 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b94f91-4d34-4b0b-aac7-e02bf185177b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:40.272501 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b94f91-4d34-4b0b-aac7-e02bf185177b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:40.287261 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1405/2815] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:43:40 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:43:40.290432 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31679be-81bc-4d4b-a655-55162d8c125a admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:40.302115 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31679be-81bc-4d4b-a655-55162d8c125a admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:40.307038 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf13c7-a673-4e94-a97f-cb36cd7c01d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:40.307729 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf13c7-a673-4e94-a97f-cb36cd7c01d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:40.308017 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf13c7-a673-4e94-a97f-cb36cd7c01d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:40.308297 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf13c7-a673-4e94-a97f-cb36cd7c01d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:40.309038 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf13c7-a673-4e94-a97f-cb36cd7c01d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:40.310983 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf13c7-a673-4e94-a97f-cb36cd7c01d9 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:40.324272 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1411/2816] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:43:40 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:43:40.327223 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b94f91-4d34-4b0b-aac7-e02bf185177b admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:40.336893 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b94f91-4d34-4b0b-aac7-e02bf185177b admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:40.342450 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b1693-4a07-4cc1-a09f-a6f080719cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:40.343323 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b1693-4a07-4cc1-a09f-a6f080719cfa admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:40.343600 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b1693-4a07-4cc1-a09f-a6f080719cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:40.343875 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b1693-4a07-4cc1-a09f-a6f080719cfa admin admin] PATH_INFO: `/v3/projects/0999014e99df4274b09d0714ca35bb91/users/ced4b3c9a9284d48933efc8e05b5f84c/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:40.358404 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b1693-4a07-4cc1-a09f-a6f080719cfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0999014e99df4274b09d0714ca35bb91, user_id=ced4b3c9a9284d48933efc8e05b5f84c, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:40.360990 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b1693-4a07-4cc1-a09f-a6f080719cfa admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:40.448164 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1406/2817] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:43:40 2021] PUT /identity/v3/projects/0999014e99df4274b09d0714ca35bb91/users/ced4b3c9a9284d48933efc8e05b5f84c/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:43:40.458826 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacf060-4317-4178-9ba9-00b44a4274b8 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:40.459122 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacf060-4317-4178-9ba9-00b44a4274b8 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:40.459405 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacf060-4317-4178-9ba9-00b44a4274b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:40.486514 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-adacf060-4317-4178-9ba9-00b44a4274b8 None None] MFA Rules not processed for user `ced4b3c9a9284d48933efc8e05b5f84c`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:40.487731 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-adacf060-4317-4178-9ba9-00b44a4274b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:40.556223 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1412/2818] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:40 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:43:40.567664 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b1693-4a07-4cc1-a09f-a6f080719cfa admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:40.629146 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b1693-4a07-4cc1-a09f-a6f080719cfa admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:40.633820 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42da3f-43c1-427c-843e-27b54e5a5fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:40.634468 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42da3f-43c1-427c-843e-27b54e5a5fde admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:40.634749 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42da3f-43c1-427c-843e-27b54e5a5fde admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:40.635025 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42da3f-43c1-427c-843e-27b54e5a5fde admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:40.635723 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec42da3f-43c1-427c-843e-27b54e5a5fde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:40.638320 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec42da3f-43c1-427c-843e-27b54e5a5fde admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:40.718604 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1407/2819] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:43:40 2021] POST /identity/v3/projects => generated 401 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:43:40.722658 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacf060-4317-4178-9ba9-00b44a4274b8 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:40.732945 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacf060-4317-4178-9ba9-00b44a4274b8 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:40.786777 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11471e33-6d7d-4983-b6a6-aa07b947e73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:40.787490 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11471e33-6d7d-4983-b6a6-aa07b947e73a admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:40.787788 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11471e33-6d7d-4983-b6a6-aa07b947e73a admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:40.788066 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11471e33-6d7d-4983-b6a6-aa07b947e73a admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:40.788771 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11471e33-6d7d-4983-b6a6-aa07b947e73a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:40.790706 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11471e33-6d7d-4983-b6a6-aa07b947e73a admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:40.877917 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1413/2820] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:43:40 2021] POST /identity/v3/users => generated 307 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:43:40.881942 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42da3f-43c1-427c-843e-27b54e5a5fde admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:40.893145 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42da3f-43c1-427c-843e-27b54e5a5fde admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:40.898076 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e4aa4-fded-4a12-b3f2-b1520f1e70cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:40.900018 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e4aa4-fded-4a12-b3f2-b1520f1e70cb admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:40.900018 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e4aa4-fded-4a12-b3f2-b1520f1e70cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:40.900018 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e4aa4-fded-4a12-b3f2-b1520f1e70cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:40.900018 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e4aa4-fded-4a12-b3f2-b1520f1e70cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:40.901749 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e4aa4-fded-4a12-b3f2-b1520f1e70cb admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:40.912691 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1408/2821] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:43:40 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:43:40.916798 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11471e33-6d7d-4983-b6a6-aa07b947e73a admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:40.927119 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11471e33-6d7d-4983-b6a6-aa07b947e73a admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:40.931729 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d63388-717a-4290-a16e-992dbcc307fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:40.932599 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d63388-717a-4290-a16e-992dbcc307fb admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:40.932879 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d63388-717a-4290-a16e-992dbcc307fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:40.933153 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d63388-717a-4290-a16e-992dbcc307fb admin admin] PATH_INFO: `/v3/projects/bf9eee4d000849c597ff03e081f9b696/users/0562b26cf1914dc5986c69e334c592d0/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:40.948597 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d63388-717a-4290-a16e-992dbcc307fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf9eee4d000849c597ff03e081f9b696, user_id=0562b26cf1914dc5986c69e334c592d0, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:40.951922 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d63388-717a-4290-a16e-992dbcc307fb admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:41.003090 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1414/2822] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:43:40 2021] PUT /identity/v3/projects/bf9eee4d000849c597ff03e081f9b696/users/0562b26cf1914dc5986c69e334c592d0/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:43:41.007127 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e4aa4-fded-4a12-b3f2-b1520f1e70cb admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:41.017604 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e4aa4-fded-4a12-b3f2-b1520f1e70cb admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:41.072394 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9577c-80b7-4752-89df-1e832701a929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:41.072971 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9577c-80b7-4752-89df-1e832701a929 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:41.073257 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9577c-80b7-4752-89df-1e832701a929 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:41.073562 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9577c-80b7-4752-89df-1e832701a929 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:41.074295 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a9577c-80b7-4752-89df-1e832701a929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:41.076048 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a9577c-80b7-4752-89df-1e832701a929 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:41.085599 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1409/2823] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:43:41 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:43:41.089865 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d63388-717a-4290-a16e-992dbcc307fb admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:41.100345 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d63388-717a-4290-a16e-992dbcc307fb admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:41.104810 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93a362-101c-4689-8aaa-984dfcc7966e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:41.105711 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93a362-101c-4689-8aaa-984dfcc7966e admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:41.105988 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93a362-101c-4689-8aaa-984dfcc7966e admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:41.106904 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93a362-101c-4689-8aaa-984dfcc7966e admin admin] PATH_INFO: `/v3/projects/bf9eee4d000849c597ff03e081f9b696/users/0562b26cf1914dc5986c69e334c592d0/roles/6d9a8878ffeb49fea19d854657c6b767` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:41.108845 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93a362-101c-4689-8aaa-984dfcc7966e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf9eee4d000849c597ff03e081f9b696, user_id=0562b26cf1914dc5986c69e334c592d0, role_id=6d9a8878ffeb49fea19d854657c6b767)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:41.111525 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93a362-101c-4689-8aaa-984dfcc7966e admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:41.121673 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1415/2824] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:43:41 2021] PUT /identity/v3/projects/bf9eee4d000849c597ff03e081f9b696/users/0562b26cf1914dc5986c69e334c592d0/roles/6d9a8878ffeb49fea19d854657c6b767 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:43:41.131927 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c6fcb-c5fa-4efb-a927-7677df475bee None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:41.132211 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c6fcb-c5fa-4efb-a927-7677df475bee None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:41.132484 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c6fcb-c5fa-4efb-a927-7677df475bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:41.158111 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-5a4c6fcb-c5fa-4efb-a927-7677df475bee None None] MFA Rules not processed for user `0562b26cf1914dc5986c69e334c592d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:41.159291 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-5a4c6fcb-c5fa-4efb-a927-7677df475bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:41.224639 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1410/2825] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:41 2021] POST /identity/v3/auth/tokens => generated 3335 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:43:41.235271 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93a362-101c-4689-8aaa-984dfcc7966e admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:41.236945 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-9a93a362-101c-4689-8aaa-984dfcc7966e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:41.290976 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93a362-101c-4689-8aaa-984dfcc7966e admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:41.295126 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688a42b-b677-473b-b032-6e632fc6dc02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:41.295756 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688a42b-b677-473b-b032-6e632fc6dc02 service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:41.296041 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688a42b-b677-473b-b032-6e632fc6dc02 service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:41.296317 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688a42b-b677-473b-b032-6e632fc6dc02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:41.305086 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688a42b-b677-473b-b032-6e632fc6dc02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:41.306534 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688a42b-b677-473b-b032-6e632fc6dc02 service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:41.316709 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1416/2826] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:43:41 2021] GET /identity/v3/auth/tokens => generated 3335 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:43:41.515956 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c6fcb-c5fa-4efb-a927-7677df475bee None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:41.525769 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c6fcb-c5fa-4efb-a927-7677df475bee None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:41.530344 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115391b2-6f57-465b-871b-08aea38ed9b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:41.531040 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115391b2-6f57-465b-871b-08aea38ed9b7 service cinder] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:41.531326 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115391b2-6f57-465b-871b-08aea38ed9b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:41.531601 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115391b2-6f57-465b-871b-08aea38ed9b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:41.572031 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688a42b-b677-473b-b032-6e632fc6dc02 service cinder] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:41.573607 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-9688a42b-b677-473b-b032-6e632fc6dc02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:41.589598 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115391b2-6f57-465b-871b-08aea38ed9b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:41.592208 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115391b2-6f57-465b-871b-08aea38ed9b7 service cinder] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:41.604976 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1411/2827] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:43:41 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:43:41.639812 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688a42b-b677-473b-b032-6e632fc6dc02 service cinder] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:41.644387 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04263eb-cdf1-4e31-9bef-abd4455b1a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:41.645250 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04263eb-cdf1-4e31-9bef-abd4455b1a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:41.645577 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04263eb-cdf1-4e31-9bef-abd4455b1a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:41.645853 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04263eb-cdf1-4e31-9bef-abd4455b1a9d admin admin] PATH_INFO: `/v3/users/fa1f7668aba04b73b01d5eb68ae7659c` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:41.647068 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04263eb-cdf1-4e31-9bef-abd4455b1a9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa1f7668aba04b73b01d5eb68ae7659c)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:41.649064 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04263eb-cdf1-4e31-9bef-abd4455b1a9d admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:41.827696 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-a04263eb-cdf1-4e31-9bef-abd4455b1a9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa1f7668aba04b73b01d5eb68ae7659c'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:41.828344 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-a04263eb-cdf1-4e31-9bef-abd4455b1a9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa1f7668aba04b73b01d5eb68ae7659c'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:41.900096 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-a04263eb-cdf1-4e31-9bef-abd4455b1a9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa1f7668aba04b73b01d5eb68ae7659c'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:41.900704 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-a04263eb-cdf1-4e31-9bef-abd4455b1a9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa1f7668aba04b73b01d5eb68ae7659c'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:41.913552 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-a04263eb-cdf1-4e31-9bef-abd4455b1a9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa1f7668aba04b73b01d5eb68ae7659c'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:41.925215 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1417/2828] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:43:41 2021] DELETE /identity/v3/users/fa1f7668aba04b73b01d5eb68ae7659c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:43:41.929746 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cac58-1c66-429a-a0ff-8b8031f2bd1a None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:41.930156 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cac58-1c66-429a-a0ff-8b8031f2bd1a None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:41.930294 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cac58-1c66-429a-a0ff-8b8031f2bd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:41.947006 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-0f7cac58-1c66-429a-a0ff-8b8031f2bd1a None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:41.948200 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-0f7cac58-1c66-429a-a0ff-8b8031f2bd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:42.007920 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1412/2829] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:43:42.018321 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04263eb-cdf1-4e31-9bef-abd4455b1a9d admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:42.019823 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-a04263eb-cdf1-4e31-9bef-abd4455b1a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:42.076962 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04263eb-cdf1-4e31-9bef-abd4455b1a9d admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:42.080597 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013d66a-61bc-44f2-a259-fce0145387ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:42.081221 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013d66a-61bc-44f2-a259-fce0145387ad service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:42.081530 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013d66a-61bc-44f2-a259-fce0145387ad service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:42.081803 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013d66a-61bc-44f2-a259-fce0145387ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:42.090760 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013d66a-61bc-44f2-a259-fce0145387ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:42.092211 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013d66a-61bc-44f2-a259-fce0145387ad service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:42.101376 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1418/2830] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:43:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:43:42.485260 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cac58-1c66-429a-a0ff-8b8031f2bd1a None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:42.486817 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-0f7cac58-1c66-429a-a0ff-8b8031f2bd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:42.499489 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cac58-1c66-429a-a0ff-8b8031f2bd1a None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:42.505081 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c41ce8-4aeb-4888-8a61-46dc098efb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:42.506351 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c41ce8-4aeb-4888-8a61-46dc098efb29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:42.506829 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c41ce8-4aeb-4888-8a61-46dc098efb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:42.507265 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c41ce8-4aeb-4888-8a61-46dc098efb29 admin admin] PATH_INFO: `/v3/projects/76370d14db874b45996645da629aa7b3` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:42.508678 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c41ce8-4aeb-4888-8a61-46dc098efb29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76370d14db874b45996645da629aa7b3)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:42.510697 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c41ce8-4aeb-4888-8a61-46dc098efb29 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:42.614150 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-a5c41ce8-4aeb-4888-8a61-46dc098efb29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76370d14db874b45996645da629aa7b3', 'request_id': 'req-a5c41ce8-4aeb-4888-8a61-46dc098efb29'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:42.620180 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-a5c41ce8-4aeb-4888-8a61-46dc098efb29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76370d14db874b45996645da629aa7b3', 'request_id': 'req-a5c41ce8-4aeb-4888-8a61-46dc098efb29'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:42.625563 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-a5c41ce8-4aeb-4888-8a61-46dc098efb29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76370d14db874b45996645da629aa7b3', 'request_id': 'req-a5c41ce8-4aeb-4888-8a61-46dc098efb29'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:42.693511 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-a5c41ce8-4aeb-4888-8a61-46dc098efb29 admin admin] The token cache is being invalidate because project 76370d14db874b45996645da629aa7b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:43:42.693802 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-a5c41ce8-4aeb-4888-8a61-46dc098efb29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:42.694460 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-a5c41ce8-4aeb-4888-8a61-46dc098efb29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:42.696017 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1413/2831] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:43:42 2021] DELETE /identity/v3/projects/76370d14db874b45996645da629aa7b3 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:43:42.701089 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013d66a-61bc-44f2-a259-fce0145387ad service neutron] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:42.710594 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013d66a-61bc-44f2-a259-fce0145387ad service neutron] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:42.766115 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede956d-5ac6-44cf-af36-a21a04c97cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:42.766902 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede956d-5ac6-44cf-af36-a21a04c97cfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:42.767181 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede956d-5ac6-44cf-af36-a21a04c97cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:42.767453 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede956d-5ac6-44cf-af36-a21a04c97cfb admin admin] PATH_INFO: `/v3/users/de367c08b41d404ab5a71a821cdfa20c` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:42.768634 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede956d-5ac6-44cf-af36-a21a04c97cfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=de367c08b41d404ab5a71a821cdfa20c)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:42.770526 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede956d-5ac6-44cf-af36-a21a04c97cfb admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:42.953013 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-0ede956d-5ac6-44cf-af36-a21a04c97cfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de367c08b41d404ab5a71a821cdfa20c'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:42.953693 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-0ede956d-5ac6-44cf-af36-a21a04c97cfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de367c08b41d404ab5a71a821cdfa20c'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:43.019837 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-0ede956d-5ac6-44cf-af36-a21a04c97cfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de367c08b41d404ab5a71a821cdfa20c'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:43.020390 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-0ede956d-5ac6-44cf-af36-a21a04c97cfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de367c08b41d404ab5a71a821cdfa20c'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:43.032314 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-0ede956d-5ac6-44cf-af36-a21a04c97cfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de367c08b41d404ab5a71a821cdfa20c'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:43.044268 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1419/2832] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:43:42 2021] DELETE /identity/v3/users/de367c08b41d404ab5a71a821cdfa20c => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:43:43.472660 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c41ce8-4aeb-4888-8a61-46dc098efb29 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:43.474195 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-a5c41ce8-4aeb-4888-8a61-46dc098efb29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:43.488370 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c41ce8-4aeb-4888-8a61-46dc098efb29 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:43.544896 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f66aa-5181-4fbe-a51a-2edbb0f6c564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:43.545695 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f66aa-5181-4fbe-a51a-2edbb0f6c564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:43.546005 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f66aa-5181-4fbe-a51a-2edbb0f6c564 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:43.546249 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f66aa-5181-4fbe-a51a-2edbb0f6c564 admin admin] PATH_INFO: `/v3/projects/431af47064ec45749cc02f72b5433e0b` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:43.547452 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f66aa-5181-4fbe-a51a-2edbb0f6c564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=431af47064ec45749cc02f72b5433e0b)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:43.549330 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f66aa-5181-4fbe-a51a-2edbb0f6c564 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:43.648997 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-7e7f66aa-5181-4fbe-a51a-2edbb0f6c564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '431af47064ec45749cc02f72b5433e0b', 'request_id': 'req-7e7f66aa-5181-4fbe-a51a-2edbb0f6c564'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:43.655255 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-7e7f66aa-5181-4fbe-a51a-2edbb0f6c564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '431af47064ec45749cc02f72b5433e0b', 'request_id': 'req-7e7f66aa-5181-4fbe-a51a-2edbb0f6c564'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:43.660629 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-7e7f66aa-5181-4fbe-a51a-2edbb0f6c564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '431af47064ec45749cc02f72b5433e0b', 'request_id': 'req-7e7f66aa-5181-4fbe-a51a-2edbb0f6c564'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:43.734143 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-7e7f66aa-5181-4fbe-a51a-2edbb0f6c564 admin admin] The token cache is being invalidate because project 431af47064ec45749cc02f72b5433e0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:43:43.734434 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-7e7f66aa-5181-4fbe-a51a-2edbb0f6c564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:43.735123 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-7e7f66aa-5181-4fbe-a51a-2edbb0f6c564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:43.739950 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1414/2833] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:43:43 2021] DELETE /identity/v3/projects/431af47064ec45749cc02f72b5433e0b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:43:43.746032 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c1baa-5f8d-48c7-bc7d-2a5371f43694 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:43.746397 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c1baa-5f8d-48c7-bc7d-2a5371f43694 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:43.747828 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c1baa-5f8d-48c7-bc7d-2a5371f43694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:43.767271 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-f89c1baa-5f8d-48c7-bc7d-2a5371f43694 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:43.768490 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-f89c1baa-5f8d-48c7-bc7d-2a5371f43694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:43.827066 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1420/2834] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:43:43.836097 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734984b-7384-4025-a531-55158b461e8b None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:43.836390 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734984b-7384-4025-a531-55158b461e8b None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:43.836669 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734984b-7384-4025-a531-55158b461e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:43.855632 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-0734984b-7384-4025-a531-55158b461e8b None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:43.857714 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-0734984b-7384-4025-a531-55158b461e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:43.865663 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1415/2835] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:43:43.870019 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c1baa-5f8d-48c7-bc7d-2a5371f43694 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:43.879599 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c1baa-5f8d-48c7-bc7d-2a5371f43694 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:43.884216 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce9112-66eb-4c06-8cb6-571502a5fc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:43.884878 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce9112-66eb-4c06-8cb6-571502a5fc6f admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:43.885155 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce9112-66eb-4c06-8cb6-571502a5fc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:43.885451 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce9112-66eb-4c06-8cb6-571502a5fc6f admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:43.886198 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce9112-66eb-4c06-8cb6-571502a5fc6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:43:43.886492 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce9112-66eb-4c06-8cb6-571502a5fc6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:43.888040 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce9112-66eb-4c06-8cb6-571502a5fc6f admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:43.899145 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1421/2836] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:43:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:43:43.904048 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734984b-7384-4025-a531-55158b461e8b None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:43.913710 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734984b-7384-4025-a531-55158b461e8b None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:43.918308 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a230d05-e549-47c8-8f77-97b1f684abe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:43.921375 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a230d05-e549-47c8-8f77-97b1f684abe6 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:43.921375 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a230d05-e549-47c8-8f77-97b1f684abe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:43.921375 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a230d05-e549-47c8-8f77-97b1f684abe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:43.921375 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a230d05-e549-47c8-8f77-97b1f684abe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:43.922660 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a230d05-e549-47c8-8f77-97b1f684abe6 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:43.993771 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1416/2837] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:43:43 2021] POST /identity/v3/projects => generated 367 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:43:43.996990 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce9112-66eb-4c06-8cb6-571502a5fc6f admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:44.006980 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce9112-66eb-4c06-8cb6-571502a5fc6f admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:44.061828 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db26e79-8b72-40a8-ab3c-67fa25840b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:44.062412 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db26e79-8b72-40a8-ab3c-67fa25840b6b admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:44.062693 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db26e79-8b72-40a8-ab3c-67fa25840b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:44.062965 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db26e79-8b72-40a8-ab3c-67fa25840b6b admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:44.063663 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db26e79-8b72-40a8-ab3c-67fa25840b6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:44.065600 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db26e79-8b72-40a8-ab3c-67fa25840b6b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:44.122407 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1422/2838] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:43:43 2021] POST /identity/v3/users => generated 284 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:43:44.126485 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a230d05-e549-47c8-8f77-97b1f684abe6 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:44.136925 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a230d05-e549-47c8-8f77-97b1f684abe6 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:44.143122 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fadecc-914b-4f95-9046-776f220a839c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:44.145219 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fadecc-914b-4f95-9046-776f220a839c admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:44.145219 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fadecc-914b-4f95-9046-776f220a839c admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:44.145219 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fadecc-914b-4f95-9046-776f220a839c admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:44.145539 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fadecc-914b-4f95-9046-776f220a839c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:44.146980 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fadecc-914b-4f95-9046-776f220a839c admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:44.158290 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1417/2839] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:43:44 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:43:44.162258 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db26e79-8b72-40a8-ab3c-67fa25840b6b admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:44.172264 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db26e79-8b72-40a8-ab3c-67fa25840b6b admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:44.176940 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78e8d3-720e-4843-b650-2e3113a4d615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:44.177629 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78e8d3-720e-4843-b650-2e3113a4d615 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:44.177916 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78e8d3-720e-4843-b650-2e3113a4d615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:44.178195 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78e8d3-720e-4843-b650-2e3113a4d615 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:44.178932 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e78e8d3-720e-4843-b650-2e3113a4d615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:44.180516 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e78e8d3-720e-4843-b650-2e3113a4d615 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:44.190846 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1423/2840] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:43:44 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:43:44.194796 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fadecc-914b-4f95-9046-776f220a839c admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:44.205305 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fadecc-914b-4f95-9046-776f220a839c admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:44.213166 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936937b-907c-4a10-a202-9babeb6c4c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:44.213166 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936937b-907c-4a10-a202-9babeb6c4c36 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:44.213166 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936937b-907c-4a10-a202-9babeb6c4c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:44.213166 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936937b-907c-4a10-a202-9babeb6c4c36 admin admin] PATH_INFO: `/v3/projects/3a244fb973624e6d88a80ea7d497d8e9/users/b8ce3574ce674b80885fa09c40cf18cc/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:44.226188 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5936937b-907c-4a10-a202-9babeb6c4c36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a244fb973624e6d88a80ea7d497d8e9, user_id=b8ce3574ce674b80885fa09c40cf18cc, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:44.228802 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5936937b-907c-4a10-a202-9babeb6c4c36 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:44.299619 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1418/2841] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:43:44 2021] PUT /identity/v3/projects/3a244fb973624e6d88a80ea7d497d8e9/users/b8ce3574ce674b80885fa09c40cf18cc/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:43:44.310131 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381b2ae-e1ac-4123-8ae1-a1cab9b4ee50 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:44.310495 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381b2ae-e1ac-4123-8ae1-a1cab9b4ee50 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:44.310782 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381b2ae-e1ac-4123-8ae1-a1cab9b4ee50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:44.337583 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-f381b2ae-e1ac-4123-8ae1-a1cab9b4ee50 None None] MFA Rules not processed for user `b8ce3574ce674b80885fa09c40cf18cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:44.338717 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-f381b2ae-e1ac-4123-8ae1-a1cab9b4ee50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:44.400220 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1424/2842] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:44 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:43:44.412758 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936937b-907c-4a10-a202-9babeb6c4c36 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:44.414511 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-5936937b-907c-4a10-a202-9babeb6c4c36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:44.469519 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936937b-907c-4a10-a202-9babeb6c4c36 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:44.473125 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23455b54-11a8-4c9e-932f-12c624281e08 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '544443ed44ef41bcaa86af52926bfd14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:44.473797 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23455b54-11a8-4c9e-932f-12c624281e08 service glance] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:44.474080 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23455b54-11a8-4c9e-932f-12c624281e08 service glance] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:44.474355 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23455b54-11a8-4c9e-932f-12c624281e08 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:44.483424 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23455b54-11a8-4c9e-932f-12c624281e08 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:44.484923 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23455b54-11a8-4c9e-932f-12c624281e08 service glance] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:44.493597 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1419/2843] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:43:44 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:43:46.426548 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381b2ae-e1ac-4123-8ae1-a1cab9b4ee50 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:46.427959 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-f381b2ae-e1ac-4123-8ae1-a1cab9b4ee50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:46.488917 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381b2ae-e1ac-4123-8ae1-a1cab9b4ee50 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:46.493302 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe2dd8-549e-4502-871a-2878ffa0c25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:46.494194 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe2dd8-549e-4502-871a-2878ffa0c25b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:46.494468 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe2dd8-549e-4502-871a-2878ffa0c25b admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:46.494743 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe2dd8-549e-4502-871a-2878ffa0c25b admin admin] PATH_INFO: `/v3/users/ced4b3c9a9284d48933efc8e05b5f84c` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:46.495921 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe2dd8-549e-4502-871a-2878ffa0c25b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ced4b3c9a9284d48933efc8e05b5f84c)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:46.498617 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe2dd8-549e-4502-871a-2878ffa0c25b admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:46.626583 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4fbe2dd8-549e-4502-871a-2878ffa0c25b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ced4b3c9a9284d48933efc8e05b5f84c'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:46.627225 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4fbe2dd8-549e-4502-871a-2878ffa0c25b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ced4b3c9a9284d48933efc8e05b5f84c'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:46.671676 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4fbe2dd8-549e-4502-871a-2878ffa0c25b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ced4b3c9a9284d48933efc8e05b5f84c'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:46.672496 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4fbe2dd8-549e-4502-871a-2878ffa0c25b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ced4b3c9a9284d48933efc8e05b5f84c'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:46.685640 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-4fbe2dd8-549e-4502-871a-2878ffa0c25b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ced4b3c9a9284d48933efc8e05b5f84c'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:46.697556 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1425/2844] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:43:46 2021] DELETE /identity/v3/users/ced4b3c9a9284d48933efc8e05b5f84c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:43:46.702193 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb72ef3-fb43-467f-b97e-c1bad3f4b888 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:46.702682 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb72ef3-fb43-467f-b97e-c1bad3f4b888 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:46.702815 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb72ef3-fb43-467f-b97e-c1bad3f4b888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:46.719363 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-2fb72ef3-fb43-467f-b97e-c1bad3f4b888 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:46.720576 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-2fb72ef3-fb43-467f-b97e-c1bad3f4b888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:46.776108 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1420/2845] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:43:46.786518 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe2dd8-549e-4502-871a-2878ffa0c25b admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:46.788030 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-4fbe2dd8-549e-4502-871a-2878ffa0c25b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:46.843177 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe2dd8-549e-4502-871a-2878ffa0c25b admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:46.846888 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c039ef-0c91-4315-85e2-17b2d1e2d03b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:46.847526 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c039ef-0c91-4315-85e2-17b2d1e2d03b service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:46.847810 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c039ef-0c91-4315-85e2-17b2d1e2d03b service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:46.848089 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c039ef-0c91-4315-85e2-17b2d1e2d03b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:46.857390 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c039ef-0c91-4315-85e2-17b2d1e2d03b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:46.858816 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c039ef-0c91-4315-85e2-17b2d1e2d03b service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:46.868026 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1426/2846] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:43:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:43:47.226985 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb72ef3-fb43-467f-b97e-c1bad3f4b888 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:47.228395 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-2fb72ef3-fb43-467f-b97e-c1bad3f4b888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:47.242440 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb72ef3-fb43-467f-b97e-c1bad3f4b888 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:47.249288 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83721ead-ed38-421e-ae0b-0fd873328dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:47.250254 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83721ead-ed38-421e-ae0b-0fd873328dba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:47.250594 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83721ead-ed38-421e-ae0b-0fd873328dba admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:47.250876 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83721ead-ed38-421e-ae0b-0fd873328dba admin admin] PATH_INFO: `/v3/projects/0999014e99df4274b09d0714ca35bb91` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:47.259282 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83721ead-ed38-421e-ae0b-0fd873328dba admin admin] RBAC: Authorizing `identity:delete_project(project_id=0999014e99df4274b09d0714ca35bb91)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:47.261246 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83721ead-ed38-421e-ae0b-0fd873328dba admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:47.347007 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-83721ead-ed38-421e-ae0b-0fd873328dba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0999014e99df4274b09d0714ca35bb91', 'request_id': 'req-83721ead-ed38-421e-ae0b-0fd873328dba'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:47.353695 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-83721ead-ed38-421e-ae0b-0fd873328dba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0999014e99df4274b09d0714ca35bb91', 'request_id': 'req-83721ead-ed38-421e-ae0b-0fd873328dba'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:47.361056 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-83721ead-ed38-421e-ae0b-0fd873328dba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0999014e99df4274b09d0714ca35bb91', 'request_id': 'req-83721ead-ed38-421e-ae0b-0fd873328dba'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:47.425495 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-83721ead-ed38-421e-ae0b-0fd873328dba admin admin] The token cache is being invalidate because project 0999014e99df4274b09d0714ca35bb91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:43:47.425785 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-83721ead-ed38-421e-ae0b-0fd873328dba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:47.426404 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-83721ead-ed38-421e-ae0b-0fd873328dba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:47.427921 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1421/2847] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:43:47 2021] DELETE /identity/v3/projects/0999014e99df4274b09d0714ca35bb91 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:43:47.431908 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c039ef-0c91-4315-85e2-17b2d1e2d03b service neutron] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:47.442192 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c039ef-0c91-4315-85e2-17b2d1e2d03b service neutron] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:47.498462 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a343dc-1ece-4017-9205-549af1985ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:47.499256 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a343dc-1ece-4017-9205-549af1985ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:47.499535 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a343dc-1ece-4017-9205-549af1985ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:47.499847 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a343dc-1ece-4017-9205-549af1985ec1 admin admin] PATH_INFO: `/v3/users/0562b26cf1914dc5986c69e334c592d0` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:47.501053 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a343dc-1ece-4017-9205-549af1985ec1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0562b26cf1914dc5986c69e334c592d0)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:47.502989 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a343dc-1ece-4017-9205-549af1985ec1 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:47.707517 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-b2a343dc-1ece-4017-9205-549af1985ec1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0562b26cf1914dc5986c69e334c592d0'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:47.708176 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-b2a343dc-1ece-4017-9205-549af1985ec1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0562b26cf1914dc5986c69e334c592d0'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:47.774167 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-b2a343dc-1ece-4017-9205-549af1985ec1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0562b26cf1914dc5986c69e334c592d0'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:47.774750 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-b2a343dc-1ece-4017-9205-549af1985ec1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0562b26cf1914dc5986c69e334c592d0'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:47.786955 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-b2a343dc-1ece-4017-9205-549af1985ec1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0562b26cf1914dc5986c69e334c592d0'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:47.798686 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1427/2848] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:43:47 2021] DELETE /identity/v3/users/0562b26cf1914dc5986c69e334c592d0 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:43:48.153138 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83721ead-ed38-421e-ae0b-0fd873328dba admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:48.154762 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-83721ead-ed38-421e-ae0b-0fd873328dba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:48.168797 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83721ead-ed38-421e-ae0b-0fd873328dba admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:48.224499 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348449f-0526-4dfa-b33f-9901bad27d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:48.225362 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348449f-0526-4dfa-b33f-9901bad27d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:48.225676 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348449f-0526-4dfa-b33f-9901bad27d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:48.225959 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348449f-0526-4dfa-b33f-9901bad27d6f admin admin] PATH_INFO: `/v3/projects/bf9eee4d000849c597ff03e081f9b696` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:48.227139 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348449f-0526-4dfa-b33f-9901bad27d6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf9eee4d000849c597ff03e081f9b696)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:48.229036 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348449f-0526-4dfa-b33f-9901bad27d6f admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:48.316962 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-5348449f-0526-4dfa-b33f-9901bad27d6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf9eee4d000849c597ff03e081f9b696', 'request_id': 'req-5348449f-0526-4dfa-b33f-9901bad27d6f'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:48.322970 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-5348449f-0526-4dfa-b33f-9901bad27d6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf9eee4d000849c597ff03e081f9b696', 'request_id': 'req-5348449f-0526-4dfa-b33f-9901bad27d6f'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:48.328343 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-5348449f-0526-4dfa-b33f-9901bad27d6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf9eee4d000849c597ff03e081f9b696', 'request_id': 'req-5348449f-0526-4dfa-b33f-9901bad27d6f'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:48.408058 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-5348449f-0526-4dfa-b33f-9901bad27d6f admin admin] The token cache is being invalidate because project bf9eee4d000849c597ff03e081f9b696 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:43:48.408361 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-5348449f-0526-4dfa-b33f-9901bad27d6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:48.409127 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-5348449f-0526-4dfa-b33f-9901bad27d6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:43:48.410638 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1422/2849] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:43:48 2021] DELETE /identity/v3/projects/bf9eee4d000849c597ff03e081f9b696 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:43:48.416866 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29839e54-dad9-4274-ba3a-5e96343932af None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:48.417207 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29839e54-dad9-4274-ba3a-5e96343932af None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:48.417645 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29839e54-dad9-4274-ba3a-5e96343932af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:48.440850 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-29839e54-dad9-4274-ba3a-5e96343932af None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:48.442100 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-29839e54-dad9-4274-ba3a-5e96343932af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:48.500661 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1428/2850] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:43:48.517725 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d22fd-99eb-46f0-98b0-9fee6f66faee None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:48.518018 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d22fd-99eb-46f0-98b0-9fee6f66faee None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:48.518300 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d22fd-99eb-46f0-98b0-9fee6f66faee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:48.537548 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-312d22fd-99eb-46f0-98b0-9fee6f66faee None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:48.538747 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-312d22fd-99eb-46f0-98b0-9fee6f66faee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:48.546828 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1423/2851] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:43:48.550875 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29839e54-dad9-4274-ba3a-5e96343932af None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:48.561508 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29839e54-dad9-4274-ba3a-5e96343932af None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:48.566049 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62abbda-b3ae-4f81-ae17-101e30eccb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:48.566687 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62abbda-b3ae-4f81-ae17-101e30eccb34 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:48.567092 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62abbda-b3ae-4f81-ae17-101e30eccb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:48.567375 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62abbda-b3ae-4f81-ae17-101e30eccb34 admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:48.568105 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62abbda-b3ae-4f81-ae17-101e30eccb34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:43:48.568412 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62abbda-b3ae-4f81-ae17-101e30eccb34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:48.570015 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62abbda-b3ae-4f81-ae17-101e30eccb34 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:48.581825 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1429/2852] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:43:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:43:48.585937 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d22fd-99eb-46f0-98b0-9fee6f66faee None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:48.595188 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d22fd-99eb-46f0-98b0-9fee6f66faee None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:48.599792 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc538f9-14b4-4fa8-bebe-6c9847bfe76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:48.600430 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc538f9-14b4-4fa8-bebe-6c9847bfe76f admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:48.600712 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc538f9-14b4-4fa8-bebe-6c9847bfe76f admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:48.600987 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc538f9-14b4-4fa8-bebe-6c9847bfe76f admin admin] PATH_INFO: `/v3/projects` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:48.601722 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc538f9-14b4-4fa8-bebe-6c9847bfe76f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:48.603617 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc538f9-14b4-4fa8-bebe-6c9847bfe76f admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:48.683590 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1424/2853] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:43:48 2021] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:43:48.688667 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62abbda-b3ae-4f81-ae17-101e30eccb34 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:48.698398 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62abbda-b3ae-4f81-ae17-101e30eccb34 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:48.752354 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bbbf12-8732-4b80-822b-1d0ccef5e8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:48.753015 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbbf12-8732-4b80-822b-1d0ccef5e8e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:48.753298 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbbf12-8732-4b80-822b-1d0ccef5e8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:48.753602 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbbf12-8732-4b80-822b-1d0ccef5e8e5 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:48.754302 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bbbf12-8732-4b80-822b-1d0ccef5e8e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:48.756170 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bbbf12-8732-4b80-822b-1d0ccef5e8e5 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:48.827099 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1430/2854] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:43:48 2021] POST /identity/v3/users => generated 283 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:43:48.831079 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc538f9-14b4-4fa8-bebe-6c9847bfe76f admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:48.842237 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc538f9-14b4-4fa8-bebe-6c9847bfe76f admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:48.846864 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3edded5-19aa-4d07-81cc-3ce1b8dcf7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:48.847516 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edded5-19aa-4d07-81cc-3ce1b8dcf7f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:48.847799 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edded5-19aa-4d07-81cc-3ce1b8dcf7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:48.848185 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edded5-19aa-4d07-81cc-3ce1b8dcf7f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:48.848933 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3edded5-19aa-4d07-81cc-3ce1b8dcf7f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:48.850659 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3edded5-19aa-4d07-81cc-3ce1b8dcf7f3 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:48.861042 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1425/2855] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:43:48 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:43:48.864893 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bbbf12-8732-4b80-822b-1d0ccef5e8e5 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:48.874999 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bbbf12-8732-4b80-822b-1d0ccef5e8e5 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:48.879590 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d173432d-2723-493d-bb11-db4ee0d726d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:48.880284 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173432d-2723-493d-bb11-db4ee0d726d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:48.880569 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173432d-2723-493d-bb11-db4ee0d726d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:48.880845 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173432d-2723-493d-bb11-db4ee0d726d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:48.881610 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d173432d-2723-493d-bb11-db4ee0d726d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:48.883163 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d173432d-2723-493d-bb11-db4ee0d726d9 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:48.893997 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1431/2856] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:43:48 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:43:48.897928 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3edded5-19aa-4d07-81cc-3ce1b8dcf7f3 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:48.908422 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3edded5-19aa-4d07-81cc-3ce1b8dcf7f3 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:48.912947 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b3d80-f3b8-4239-9aac-55da69f84260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:48.913841 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b3d80-f3b8-4239-9aac-55da69f84260 admin admin] REQUEST_METHOD: `PUT` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:48.914126 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b3d80-f3b8-4239-9aac-55da69f84260 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:48.914401 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b3d80-f3b8-4239-9aac-55da69f84260 admin admin] PATH_INFO: `/v3/projects/49db545fc0964ddba65674a055afb097/users/ce087282f5424d45974f55294c65d649/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:48.928516 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b3d80-f3b8-4239-9aac-55da69f84260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49db545fc0964ddba65674a055afb097, user_id=ce087282f5424d45974f55294c65d649, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:48.931154 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b3d80-f3b8-4239-9aac-55da69f84260 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:48.986604 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1426/2857] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:43:48 2021] PUT /identity/v3/projects/49db545fc0964ddba65674a055afb097/users/ce087282f5424d45974f55294c65d649/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:43:48.998110 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c00ec9-6c77-47ee-a903-85c04a023413 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:48.998469 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c00ec9-6c77-47ee-a903-85c04a023413 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:48.998711 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c00ec9-6c77-47ee-a903-85c04a023413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:49.026883 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-a8c00ec9-6c77-47ee-a903-85c04a023413 None None] MFA Rules not processed for user `ce087282f5424d45974f55294c65d649`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:43:49.028097 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-a8c00ec9-6c77-47ee-a903-85c04a023413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:49.092698 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1432/2858] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:43:48 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:43:49.104945 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b3d80-f3b8-4239-9aac-55da69f84260 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:43:49.107768 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-387b3d80-f3b8-4239-9aac-55da69f84260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:43:49.164959 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b3d80-f3b8-4239-9aac-55da69f84260 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:43:49.168655 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b9a18-c13f-44b9-be1f-c82b33544284 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:43:49.169920 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b9a18-c13f-44b9-be1f-c82b33544284 service cinder] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:43:49.170198 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b9a18-c13f-44b9-be1f-c82b33544284 service cinder] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:43:49.170470 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b9a18-c13f-44b9-be1f-c82b33544284 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:43:49.178500 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b9a18-c13f-44b9-be1f-c82b33544284 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:43:49.179909 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b9a18-c13f-44b9-be1f-c82b33544284 service cinder] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:43:49.188684 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1427/2859] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:43:49 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:44:13.126585 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c00ec9-6c77-47ee-a903-85c04a023413 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:44:13.128033 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-a8c00ec9-6c77-47ee-a903-85c04a023413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:44:13.204982 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c00ec9-6c77-47ee-a903-85c04a023413 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:44:13.212691 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d15ace-2f7e-486d-ab4e-709a615be278 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d91fe7f996b48b0bc28e1eadc4f8869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:44:13.212691 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d15ace-2f7e-486d-ab4e-709a615be278 service nova] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:13.212691 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d15ace-2f7e-486d-ab4e-709a615be278 service nova] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:13.212691 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d15ace-2f7e-486d-ab4e-709a615be278 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:13.214193 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-59d15ace-2f7e-486d-ab4e-709a615be278 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:44:13.227878 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d15ace-2f7e-486d-ab4e-709a615be278 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:44:13.229602 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d15ace-2f7e-486d-ab4e-709a615be278 service nova] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:44:13.241047 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1433/2860] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:44:13 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:44:13.306093 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b9a18-c13f-44b9-be1f-c82b33544284 service cinder] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:44:13.308162 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-bb8b9a18-c13f-44b9-be1f-c82b33544284 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:44:13.372872 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b9a18-c13f-44b9-be1f-c82b33544284 service cinder] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:44:13.378190 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b554c73-530e-4013-882a-0d5ca487cdaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:44:13.379303 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b554c73-530e-4013-882a-0d5ca487cdaa service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:13.379590 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b554c73-530e-4013-882a-0d5ca487cdaa service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:13.379873 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b554c73-530e-4013-882a-0d5ca487cdaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:13.381733 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-3b554c73-530e-4013-882a-0d5ca487cdaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:44:13.392207 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b554c73-530e-4013-882a-0d5ca487cdaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:44:13.394593 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b554c73-530e-4013-882a-0d5ca487cdaa service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:44:13.404445 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1428/2861] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:44:13 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:44:13.531180 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d15ace-2f7e-486d-ab4e-709a615be278 service nova] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:44:13.532870 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-59d15ace-2f7e-486d-ab4e-709a615be278 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:44:13.544510 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d15ace-2f7e-486d-ab4e-709a615be278 service nova] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:44:13.550411 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97887102-3c4f-4332-88e9-a74519a12100 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:44:13.551060 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97887102-3c4f-4332-88e9-a74519a12100 service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:13.551343 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97887102-3c4f-4332-88e9-a74519a12100 service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:13.551618 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97887102-3c4f-4332-88e9-a74519a12100 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:13.553373 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-97887102-3c4f-4332-88e9-a74519a12100 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:44:13.568785 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97887102-3c4f-4332-88e9-a74519a12100 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:44:13.570238 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97887102-3c4f-4332-88e9-a74519a12100 service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:44:13.581819 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1434/2862] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:44:13 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:44:28.127846 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b554c73-530e-4013-882a-0d5ca487cdaa service neutron] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:44:28.129334 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-3b554c73-530e-4013-882a-0d5ca487cdaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:44:28.194548 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b554c73-530e-4013-882a-0d5ca487cdaa service neutron] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:44:28.199182 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8a2aa-9cdf-4bb2-86e7-4e806134dc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:44:28.200089 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8a2aa-9cdf-4bb2-86e7-4e806134dc42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:28.200385 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8a2aa-9cdf-4bb2-86e7-4e806134dc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:28.200657 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8a2aa-9cdf-4bb2-86e7-4e806134dc42 admin admin] PATH_INFO: `/v3/users/b8ce3574ce674b80885fa09c40cf18cc` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:28.201882 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b8a2aa-9cdf-4bb2-86e7-4e806134dc42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8ce3574ce674b80885fa09c40cf18cc)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:44:28.203807 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b8a2aa-9cdf-4bb2-86e7-4e806134dc42 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:44:28.317386 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-88b8a2aa-9cdf-4bb2-86e7-4e806134dc42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8ce3574ce674b80885fa09c40cf18cc'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:28.318081 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-88b8a2aa-9cdf-4bb2-86e7-4e806134dc42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8ce3574ce674b80885fa09c40cf18cc'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:28.324684 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-88b8a2aa-9cdf-4bb2-86e7-4e806134dc42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8ce3574ce674b80885fa09c40cf18cc'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:28.327043 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-88b8a2aa-9cdf-4bb2-86e7-4e806134dc42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8ce3574ce674b80885fa09c40cf18cc'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:28.337363 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-88b8a2aa-9cdf-4bb2-86e7-4e806134dc42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8ce3574ce674b80885fa09c40cf18cc'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:28.389811 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1429/2863] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:44:28 2021] DELETE /identity/v3/users/b8ce3574ce674b80885fa09c40cf18cc => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:44:28.394451 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd732e20-a1b8-4512-b480-5d0813bb99b3 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:28.395861 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd732e20-a1b8-4512-b480-5d0813bb99b3 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:28.395861 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd732e20-a1b8-4512-b480-5d0813bb99b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:28.411873 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-dd732e20-a1b8-4512-b480-5d0813bb99b3 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:44:28.413071 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-dd732e20-a1b8-4512-b480-5d0813bb99b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:44:28.476184 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1435/2864] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:44:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:44:28.487395 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8a2aa-9cdf-4bb2-86e7-4e806134dc42 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:44:28.488937 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-88b8a2aa-9cdf-4bb2-86e7-4e806134dc42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:44:28.554202 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8a2aa-9cdf-4bb2-86e7-4e806134dc42 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:44:28.559179 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6dd2f9-86d5-47a4-85d9-b6181cdc3bf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:44:28.559468 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dd2f9-86d5-47a4-85d9-b6181cdc3bf5 service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:28.559744 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dd2f9-86d5-47a4-85d9-b6181cdc3bf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:28.560025 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dd2f9-86d5-47a4-85d9-b6181cdc3bf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:28.570162 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6dd2f9-86d5-47a4-85d9-b6181cdc3bf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:44:28.571588 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6dd2f9-86d5-47a4-85d9-b6181cdc3bf5 service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:44:28.581758 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1430/2865] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:44:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:44:29.027107 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd732e20-a1b8-4512-b480-5d0813bb99b3 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:44:29.028524 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-dd732e20-a1b8-4512-b480-5d0813bb99b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:44:29.043437 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd732e20-a1b8-4512-b480-5d0813bb99b3 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:44:29.048110 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c9958-af89-46d4-ab6b-4d8e301d8994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:44:29.050242 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c9958-af89-46d4-ab6b-4d8e301d8994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:29.050576 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c9958-af89-46d4-ab6b-4d8e301d8994 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:29.050842 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c9958-af89-46d4-ab6b-4d8e301d8994 admin admin] PATH_INFO: `/v3/projects/3a244fb973624e6d88a80ea7d497d8e9` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:29.052112 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8c9958-af89-46d4-ab6b-4d8e301d8994 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a244fb973624e6d88a80ea7d497d8e9)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:44:29.054190 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8c9958-af89-46d4-ab6b-4d8e301d8994 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:44:29.162780 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-0b8c9958-af89-46d4-ab6b-4d8e301d8994 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a244fb973624e6d88a80ea7d497d8e9', 'request_id': 'req-0b8c9958-af89-46d4-ab6b-4d8e301d8994'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:29.167996 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-0b8c9958-af89-46d4-ab6b-4d8e301d8994 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a244fb973624e6d88a80ea7d497d8e9', 'request_id': 'req-0b8c9958-af89-46d4-ab6b-4d8e301d8994'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:29.174073 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-0b8c9958-af89-46d4-ab6b-4d8e301d8994 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a244fb973624e6d88a80ea7d497d8e9', 'request_id': 'req-0b8c9958-af89-46d4-ab6b-4d8e301d8994'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:29.263616 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-0b8c9958-af89-46d4-ab6b-4d8e301d8994 admin admin] The token cache is being invalidate because project 3a244fb973624e6d88a80ea7d497d8e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:44:29.263906 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-0b8c9958-af89-46d4-ab6b-4d8e301d8994 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:29.264520 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-0b8c9958-af89-46d4-ab6b-4d8e301d8994 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:29.266208 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1436/2866] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:44:29 2021] DELETE /identity/v3/projects/3a244fb973624e6d88a80ea7d497d8e9 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:44:29.277394 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ef064-abee-438e-a34e-00b744bd46ce None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:29.277394 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ef064-abee-438e-a34e-00b744bd46ce None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:29.277394 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ef064-abee-438e-a34e-00b744bd46ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:29.292771 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-4c4ef064-abee-438e-a34e-00b744bd46ce None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:44:29.298886 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-4c4ef064-abee-438e-a34e-00b744bd46ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:44:29.358493 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1431/2867] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:44:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:44:29.366637 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579680d-f8ac-4efa-a20f-67b4b25a17bd None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:29.366929 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579680d-f8ac-4efa-a20f-67b4b25a17bd None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:29.367206 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579680d-f8ac-4efa-a20f-67b4b25a17bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:29.389582 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-e579680d-f8ac-4efa-a20f-67b4b25a17bd None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:44:29.389582 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-e579680d-f8ac-4efa-a20f-67b4b25a17bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:44:29.398294 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1437/2868] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:44:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:44:29.403455 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ef064-abee-438e-a34e-00b744bd46ce None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:44:29.413696 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ef064-abee-438e-a34e-00b744bd46ce None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:44:29.423649 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869662a-c262-4cb6-8269-f02f19195cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:44:29.423649 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869662a-c262-4cb6-8269-f02f19195cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:29.423649 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869662a-c262-4cb6-8269-f02f19195cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:29.423649 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869662a-c262-4cb6-8269-f02f19195cc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:29.424171 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869662a-c262-4cb6-8269-f02f19195cc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:44:29.424171 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869662a-c262-4cb6-8269-f02f19195cc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:44:29.424171 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869662a-c262-4cb6-8269-f02f19195cc4 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:44:29.433644 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1432/2869] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:44:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 23 19:44:29.438327 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579680d-f8ac-4efa-a20f-67b4b25a17bd None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:44:29.448524 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579680d-f8ac-4efa-a20f-67b4b25a17bd None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:44:29.457980 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b865c-5ac7-4f0b-9461-63ac6afb60b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:44:29.457980 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b865c-5ac7-4f0b-9461-63ac6afb60b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:29.457980 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b865c-5ac7-4f0b-9461-63ac6afb60b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:29.457980 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b865c-5ac7-4f0b-9461-63ac6afb60b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:29.458395 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b865c-5ac7-4f0b-9461-63ac6afb60b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:44:29.458395 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b865c-5ac7-4f0b-9461-63ac6afb60b2 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:44:29.609662 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1438/2870] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:44:29 2021] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:44:29.614952 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869662a-c262-4cb6-8269-f02f19195cc4 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:44:29.625709 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869662a-c262-4cb6-8269-f02f19195cc4 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:44:29.682620 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a56cb-c824-4197-ae48-122889301c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:44:29.683358 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a56cb-c824-4197-ae48-122889301c04 admin admin] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:29.683657 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a56cb-c824-4197-ae48-122889301c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:29.684255 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a56cb-c824-4197-ae48-122889301c04 admin admin] PATH_INFO: `/v3/users` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:29.684975 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a56cb-c824-4197-ae48-122889301c04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:44:29.686918 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a56cb-c824-4197-ae48-122889301c04 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:44:29.783087 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1433/2871] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:44:29 2021] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 23 19:44:29.791584 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b865c-5ac7-4f0b-9461-63ac6afb60b2 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:44:29.807961 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b865c-5ac7-4f0b-9461-63ac6afb60b2 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:44:29.813784 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74c7ec-7dc6-42b4-a029-1c61ecd4c171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:44:29.814630 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74c7ec-7dc6-42b4-a029-1c61ecd4c171 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:29.814917 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74c7ec-7dc6-42b4-a029-1c61ecd4c171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:29.815195 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74c7ec-7dc6-42b4-a029-1c61ecd4c171 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:29.817202 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74c7ec-7dc6-42b4-a029-1c61ecd4c171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:44:29.818823 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74c7ec-7dc6-42b4-a029-1c61ecd4c171 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:44:29.829472 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1439/2872] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:44:29 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:44:29.834127 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a56cb-c824-4197-ae48-122889301c04 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:44:29.844124 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a56cb-c824-4197-ae48-122889301c04 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:44:29.851109 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a763c0-3cf0-4897-91a8-2bbfc447bf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:44:29.851870 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a763c0-3cf0-4897-91a8-2bbfc447bf91 admin admin] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:29.852158 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a763c0-3cf0-4897-91a8-2bbfc447bf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:29.852436 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a763c0-3cf0-4897-91a8-2bbfc447bf91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:29.853185 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a763c0-3cf0-4897-91a8-2bbfc447bf91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:44:29.854808 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a763c0-3cf0-4897-91a8-2bbfc447bf91 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:44:29.865817 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1434/2873] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:44:29 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 23 19:44:29.869999 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74c7ec-7dc6-42b4-a029-1c61ecd4c171 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:44:29.881335 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74c7ec-7dc6-42b4-a029-1c61ecd4c171 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:44:29.886036 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f256b8-aad8-4f80-a738-cd21a5fffc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:44:29.886907 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f256b8-aad8-4f80-a738-cd21a5fffc98 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:29.887194 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f256b8-aad8-4f80-a738-cd21a5fffc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:29.887467 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f256b8-aad8-4f80-a738-cd21a5fffc98 admin admin] PATH_INFO: `/v3/projects/1f3bd29020594feab39f27e8cd84faf9/users/c25b05ef621b4bd5a35b40a016396a07/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:29.902442 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f256b8-aad8-4f80-a738-cd21a5fffc98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f3bd29020594feab39f27e8cd84faf9, user_id=c25b05ef621b4bd5a35b40a016396a07, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:44:29.905093 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f256b8-aad8-4f80-a738-cd21a5fffc98 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:44:29.968156 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1440/2874] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:44:29 2021] PUT /identity/v3/projects/1f3bd29020594feab39f27e8cd84faf9/users/c25b05ef621b4bd5a35b40a016396a07/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:44:29.978331 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e8d9d-10aa-4d69-b0f5-280ddb73ebeb None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:29.978624 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e8d9d-10aa-4d69-b0f5-280ddb73ebeb None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:29.978925 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e8d9d-10aa-4d69-b0f5-280ddb73ebeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:30.006524 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-126e8d9d-10aa-4d69-b0f5-280ddb73ebeb None None] MFA Rules not processed for user `c25b05ef621b4bd5a35b40a016396a07`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:44:30.007728 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-126e8d9d-10aa-4d69-b0f5-280ddb73ebeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:44:30.072745 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1435/2875] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:44:29 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:44:30.083973 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f256b8-aad8-4f80-a738-cd21a5fffc98 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:44:30.085746 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-b0f256b8-aad8-4f80-a738-cd21a5fffc98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:44:30.144752 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f256b8-aad8-4f80-a738-cd21a5fffc98 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:44:30.148620 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a1660-ce80-42b1-99c8-6077d2cf4803 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9845615593004371a592e46701b5ece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:44:30.149264 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a1660-ce80-42b1-99c8-6077d2cf4803 service cinder] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:30.149580 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a1660-ce80-42b1-99c8-6077d2cf4803 service cinder] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:30.149866 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a1660-ce80-42b1-99c8-6077d2cf4803 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:30.160440 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a1660-ce80-42b1-99c8-6077d2cf4803 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:44:30.161887 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a1660-ce80-42b1-99c8-6077d2cf4803 service cinder] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:44:30.170928 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1441/2876] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:44:30 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:44:31.919635 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e8d9d-10aa-4d69-b0f5-280ddb73ebeb None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:44:31.921168 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-126e8d9d-10aa-4d69-b0f5-280ddb73ebeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:44:31.985246 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e8d9d-10aa-4d69-b0f5-280ddb73ebeb None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:44:31.989428 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3d7bf-3604-4492-8455-b03134eaf757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:44:31.990103 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3d7bf-3604-4492-8455-b03134eaf757 service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:31.990389 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3d7bf-3604-4492-8455-b03134eaf757 service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:31.990723 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3d7bf-3604-4492-8455-b03134eaf757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:31.992687 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-0cb3d7bf-3604-4492-8455-b03134eaf757 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:44:32.056474 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb3d7bf-3604-4492-8455-b03134eaf757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:44:32.057946 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb3d7bf-3604-4492-8455-b03134eaf757 service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:44:32.068130 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1436/2877] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:44:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:44:33.243026 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a1660-ce80-42b1-99c8-6077d2cf4803 service cinder] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:44:33.254167 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a1660-ce80-42b1-99c8-6077d2cf4803 service cinder] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:44:33.259022 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e61fb0-ee6a-4cba-b8e6-13ba40eb8aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:44:33.264359 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e61fb0-ee6a-4cba-b8e6-13ba40eb8aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:33.264359 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e61fb0-ee6a-4cba-b8e6-13ba40eb8aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:33.264359 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e61fb0-ee6a-4cba-b8e6-13ba40eb8aaa admin admin] PATH_INFO: `/v3/users/c25b05ef621b4bd5a35b40a016396a07` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:33.264359 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e61fb0-ee6a-4cba-b8e6-13ba40eb8aaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=c25b05ef621b4bd5a35b40a016396a07)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:44:33.264359 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e61fb0-ee6a-4cba-b8e6-13ba40eb8aaa admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:44:33.451392 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-48e61fb0-ee6a-4cba-b8e6-13ba40eb8aaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c25b05ef621b4bd5a35b40a016396a07'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:33.452220 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-48e61fb0-ee6a-4cba-b8e6-13ba40eb8aaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c25b05ef621b4bd5a35b40a016396a07'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:33.510643 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-48e61fb0-ee6a-4cba-b8e6-13ba40eb8aaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c25b05ef621b4bd5a35b40a016396a07'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:33.521645 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-48e61fb0-ee6a-4cba-b8e6-13ba40eb8aaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c25b05ef621b4bd5a35b40a016396a07'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:33.527368 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-48e61fb0-ee6a-4cba-b8e6-13ba40eb8aaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c25b05ef621b4bd5a35b40a016396a07'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:33.544351 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1442/2878] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:44:33 2021] DELETE /identity/v3/users/c25b05ef621b4bd5a35b40a016396a07 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:44:33.547192 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91d203-5690-4223-bdda-607edad616f0 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:33.547672 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91d203-5690-4223-bdda-607edad616f0 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:33.547761 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91d203-5690-4223-bdda-607edad616f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:33.567065 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-9a91d203-5690-4223-bdda-607edad616f0 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:44:33.568420 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-9a91d203-5690-4223-bdda-607edad616f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:44:33.629126 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1437/2879] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:44:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:44:33.639126 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e61fb0-ee6a-4cba-b8e6-13ba40eb8aaa admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:44:33.642356 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-48e61fb0-ee6a-4cba-b8e6-13ba40eb8aaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:44:33.698395 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e61fb0-ee6a-4cba-b8e6-13ba40eb8aaa admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:44:33.702377 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f218e-2808-4299-8abb-677b4e32175c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:44:33.703039 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f218e-2808-4299-8abb-677b4e32175c service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:33.703400 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f218e-2808-4299-8abb-677b4e32175c service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:33.703682 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f218e-2808-4299-8abb-677b4e32175c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:33.713994 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f218e-2808-4299-8abb-677b4e32175c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:44:33.715539 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f218e-2808-4299-8abb-677b4e32175c service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:44:33.726545 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1443/2880] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:44:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:44:34.123318 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91d203-5690-4223-bdda-607edad616f0 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:44:34.124855 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-9a91d203-5690-4223-bdda-607edad616f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:44:34.138498 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91d203-5690-4223-bdda-607edad616f0 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:44:34.143357 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc24fb-c80a-48d7-981a-c9f22188d405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:44:34.145108 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc24fb-c80a-48d7-981a-c9f22188d405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:34.145545 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc24fb-c80a-48d7-981a-c9f22188d405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:34.152057 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc24fb-c80a-48d7-981a-c9f22188d405 admin admin] PATH_INFO: `/v3/projects/1f3bd29020594feab39f27e8cd84faf9` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:34.152057 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc24fb-c80a-48d7-981a-c9f22188d405 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f3bd29020594feab39f27e8cd84faf9)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:44:34.152057 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc24fb-c80a-48d7-981a-c9f22188d405 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:44:34.256396 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-7bcc24fb-c80a-48d7-981a-c9f22188d405 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f3bd29020594feab39f27e8cd84faf9', 'request_id': 'req-7bcc24fb-c80a-48d7-981a-c9f22188d405'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:34.266047 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-7bcc24fb-c80a-48d7-981a-c9f22188d405 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f3bd29020594feab39f27e8cd84faf9', 'request_id': 'req-7bcc24fb-c80a-48d7-981a-c9f22188d405'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:34.274143 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-7bcc24fb-c80a-48d7-981a-c9f22188d405 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f3bd29020594feab39f27e8cd84faf9', 'request_id': 'req-7bcc24fb-c80a-48d7-981a-c9f22188d405'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:34.378403 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-7bcc24fb-c80a-48d7-981a-c9f22188d405 admin admin] The token cache is being invalidate because project 1f3bd29020594feab39f27e8cd84faf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:44:34.378793 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-7bcc24fb-c80a-48d7-981a-c9f22188d405 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:34.379384 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-7bcc24fb-c80a-48d7-981a-c9f22188d405 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:34.381422 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1438/2881] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:44:34 2021] DELETE /identity/v3/projects/1f3bd29020594feab39f27e8cd84faf9 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:44:34.387232 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b0025-3d5f-4a57-a2e5-8df4ee9c96eb None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:34.388503 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b0025-3d5f-4a57-a2e5-8df4ee9c96eb None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:34.388847 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b0025-3d5f-4a57-a2e5-8df4ee9c96eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:34.410032 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-064b0025-3d5f-4a57-a2e5-8df4ee9c96eb None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:44:34.411562 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-064b0025-3d5f-4a57-a2e5-8df4ee9c96eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:44:34.414906 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc24fb-c80a-48d7-981a-c9f22188d405 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:44:34.416534 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-7bcc24fb-c80a-48d7-981a-c9f22188d405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:44:34.482410 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1444/2882] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:44:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:44:34.485877 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc24fb-c80a-48d7-981a-c9f22188d405 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:44:34.490906 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87229c72-6688-43df-b09f-731fb8820ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:44:34.491340 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e10ec-8623-4e13-91f2-bc33f1c34638 None None] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:34.491727 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e10ec-8623-4e13-91f2-bc33f1c34638 None None] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:34.491856 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87229c72-6688-43df-b09f-731fb8820ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:34.491955 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e10ec-8623-4e13-91f2-bc33f1c34638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:34.492056 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87229c72-6688-43df-b09f-731fb8820ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:34.492290 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87229c72-6688-43df-b09f-731fb8820ac5 admin admin] PATH_INFO: `/v3/users/ce087282f5424d45974f55294c65d649` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:34.493522 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87229c72-6688-43df-b09f-731fb8820ac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce087282f5424d45974f55294c65d649)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:44:34.495411 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87229c72-6688-43df-b09f-731fb8820ac5 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:44:34.510040 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.auth.core [None req-0f7e10ec-8623-4e13-91f2-bc33f1c34638 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:44:34.511247 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-0f7e10ec-8623-4e13-91f2-bc33f1c34638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:44:34.519906 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1445/2883] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:44:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:44:34.524062 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e10ec-8623-4e13-91f2-bc33f1c34638 None None] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:44:34.532989 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e10ec-8623-4e13-91f2-bc33f1c34638 None None] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:44:34.538588 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76a2c4-6404-45c2-a3ed-ff5de174a4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:44:34.539225 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76a2c4-6404-45c2-a3ed-ff5de174a4fb admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:34.539510 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76a2c4-6404-45c2-a3ed-ff5de174a4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:34.539786 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76a2c4-6404-45c2-a3ed-ff5de174a4fb admin admin] PATH_INFO: `/v3/domains` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:34.540512 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a76a2c4-6404-45c2-a3ed-ff5de174a4fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 23 19:44:34.540817 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a76a2c4-6404-45c2-a3ed-ff5de174a4fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:44:34.542496 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a76a2c4-6404-45c2-a3ed-ff5de174a4fb admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:44:34.554328 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1446/2884] 10.222.0.62 () {58 vars in 1152 bytes} [Tue Nov 23 19:44:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 23 19:44:34.558336 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76a2c4-6404-45c2-a3ed-ff5de174a4fb admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:44:34.569619 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76a2c4-6404-45c2-a3ed-ff5de174a4fb admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:44:34.574607 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63c797-c053-4148-86bd-2e61041ace76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:44:34.575331 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63c797-c053-4148-86bd-2e61041ace76 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:34.575646 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63c797-c053-4148-86bd-2e61041ace76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:34.575957 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63c797-c053-4148-86bd-2e61041ace76 admin admin] PATH_INFO: `/v3/projects` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:34.576711 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e63c797-c053-4148-86bd-2e61041ace76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:44:34.578702 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e63c797-c053-4148-86bd-2e61041ace76 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:44:34.650410 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1447/2885] 10.222.0.62 () {60 vars in 1152 bytes} [Tue Nov 23 19:44:34 2021] POST /identity/v3/projects => generated 371 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:44:34.654356 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63c797-c053-4148-86bd-2e61041ace76 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:44:34.719367 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-87229c72-6688-43df-b09f-731fb8820ac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce087282f5424d45974f55294c65d649'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:34.722679 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-87229c72-6688-43df-b09f-731fb8820ac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce087282f5424d45974f55294c65d649'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:34.728016 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63c797-c053-4148-86bd-2e61041ace76 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:44:34.730955 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-87229c72-6688-43df-b09f-731fb8820ac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce087282f5424d45974f55294c65d649'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:34.732056 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-87229c72-6688-43df-b09f-731fb8820ac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce087282f5424d45974f55294c65d649'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:34.735649 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bc594-5925-47d4-91e7-7ff6119b5850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:44:34.736466 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bc594-5925-47d4-91e7-7ff6119b5850 admin admin] REQUEST_METHOD: `POST` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:34.736938 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bc594-5925-47d4-91e7-7ff6119b5850 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:34.737447 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bc594-5925-47d4-91e7-7ff6119b5850 admin admin] PATH_INFO: `/v3/users` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:34.738718 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904bc594-5925-47d4-91e7-7ff6119b5850 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:44:34.741500 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904bc594-5925-47d4-91e7-7ff6119b5850 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:44:34.748682 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-87229c72-6688-43df-b09f-731fb8820ac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce087282f5424d45974f55294c65d649'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:34.811838 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1448/2886] 10.222.0.62 () {60 vars in 1143 bytes} [Tue Nov 23 19:44:34 2021] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 23 19:44:34.812391 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bc594-5925-47d4-91e7-7ff6119b5850 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:44:34.814015 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-904bc594-5925-47d4-91e7-7ff6119b5850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:44:34.819624 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1439/2887] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:44:34 2021] DELETE /identity/v3/users/ce087282f5424d45974f55294c65d649 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:44:34.824146 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f7128-86d4-4ae0-98b0-f15e8467fb71 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:34.824455 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f7128-86d4-4ae0-98b0-f15e8467fb71 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:34.824714 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f7128-86d4-4ae0-98b0-f15e8467fb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:34.827197 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bc594-5925-47d4-91e7-7ff6119b5850 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:44:34.842106 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-b17f7128-86d4-4ae0-98b0-f15e8467fb71 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:44:34.843331 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-b17f7128-86d4-4ae0-98b0-f15e8467fb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:44:34.888712 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e2ad2-b016-4ae4-99d0-7bb3d798ca86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:44:34.889574 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e2ad2-b016-4ae4-99d0-7bb3d798ca86 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:34.889966 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e2ad2-b016-4ae4-99d0-7bb3d798ca86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:34.890337 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e2ad2-b016-4ae4-99d0-7bb3d798ca86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:34.891177 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e2ad2-b016-4ae4-99d0-7bb3d798ca86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:44:34.892912 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e2ad2-b016-4ae4-99d0-7bb3d798ca86 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:44:34.903812 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1440/2888] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:44:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 23 19:44:34.906985 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1449/2889] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:44:34 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:44:34.907894 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e2ad2-b016-4ae4-99d0-7bb3d798ca86 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:44:34.917909 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f7128-86d4-4ae0-98b0-f15e8467fb71 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:44:34.918692 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e2ad2-b016-4ae4-99d0-7bb3d798ca86 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:44:34.919498 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-b17f7128-86d4-4ae0-98b0-f15e8467fb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:44:34.922954 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9c1d7-69ca-4e44-b4ae-2cee7ddbb614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:44:34.923609 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9c1d7-69ca-4e44-b4ae-2cee7ddbb614 admin admin] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:34.923890 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9c1d7-69ca-4e44-b4ae-2cee7ddbb614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:34.924160 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9c1d7-69ca-4e44-b4ae-2cee7ddbb614 admin admin] PATH_INFO: `/v3/roles` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:34.925518 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e9c1d7-69ca-4e44-b4ae-2cee7ddbb614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:44:34.927197 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e9c1d7-69ca-4e44-b4ae-2cee7ddbb614 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:44:34.938610 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1450/2890] 10.222.0.62 () {58 vars in 1121 bytes} [Tue Nov 23 19:44:34 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 23 19:44:34.942616 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9c1d7-69ca-4e44-b4ae-2cee7ddbb614 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:44:34.952363 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9c1d7-69ca-4e44-b4ae-2cee7ddbb614 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:44:34.958305 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4168f-a49b-4244-9dd4-4fb81d4e3fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:44:34.959189 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4168f-a49b-4244-9dd4-4fb81d4e3fe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:34.959468 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4168f-a49b-4244-9dd4-4fb81d4e3fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:34.960146 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4168f-a49b-4244-9dd4-4fb81d4e3fe6 admin admin] PATH_INFO: `/v3/projects/ca3f87d08ab34bc9b71a9ba8c20bf15c/users/6b4d76b569314959a42e2e9abb01e363/roles/f8b0ca7636ad450b94f68df7bc4497aa` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:34.975249 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c4168f-a49b-4244-9dd4-4fb81d4e3fe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca3f87d08ab34bc9b71a9ba8c20bf15c, user_id=6b4d76b569314959a42e2e9abb01e363, role_id=f8b0ca7636ad450b94f68df7bc4497aa)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:44:34.978131 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c4168f-a49b-4244-9dd4-4fb81d4e3fe6 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:44:34.981532 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f7128-86d4-4ae0-98b0-f15e8467fb71 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:44:34.985651 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e788e-be87-466b-ad6f-36d39d06331a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:44:34.986301 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e788e-be87-466b-ad6f-36d39d06331a service neutron] REQUEST_METHOD: `GET` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:34.986584 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e788e-be87-466b-ad6f-36d39d06331a service neutron] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:34.986859 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e788e-be87-466b-ad6f-36d39d06331a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:34.996967 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e788e-be87-466b-ad6f-36d39d06331a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:44:34.998418 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e788e-be87-466b-ad6f-36d39d06331a service neutron] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:44:35.010890 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1441/2891] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:44:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:44:35.099191 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1451/2892] 10.222.0.62 () {60 vars in 1482 bytes} [Tue Nov 23 19:44:34 2021] PUT /identity/v3/projects/ca3f87d08ab34bc9b71a9ba8c20bf15c/users/6b4d76b569314959a42e2e9abb01e363/roles/f8b0ca7636ad450b94f68df7bc4497aa => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 23 19:44:35.115365 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59f3d0-cfb1-494a-b094-bb0e6f965fed None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:35.115682 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59f3d0-cfb1-494a-b094-bb0e6f965fed None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:35.115932 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59f3d0-cfb1-494a-b094-bb0e6f965fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:35.148125 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-ce59f3d0-cfb1-494a-b094-bb0e6f965fed None None] MFA Rules not processed for user `6b4d76b569314959a42e2e9abb01e363`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:44:35.149448 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-ce59f3d0-cfb1-494a-b094-bb0e6f965fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:44:35.214832 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1442/2893] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:44:35 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:44:35.227866 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4168f-a49b-4244-9dd4-4fb81d4e3fe6 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:44:35.229954 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-a7c4168f-a49b-4244-9dd4-4fb81d4e3fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:44:35.326183 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4168f-a49b-4244-9dd4-4fb81d4e3fe6 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:44:35.330127 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a396f50-4a66-48fd-8b9c-805cb1d87bd6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '544443ed44ef41bcaa86af52926bfd14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:44:35.330782 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a396f50-4a66-48fd-8b9c-805cb1d87bd6 service glance] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:35.331147 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a396f50-4a66-48fd-8b9c-805cb1d87bd6 service glance] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:35.331567 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a396f50-4a66-48fd-8b9c-805cb1d87bd6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:35.340921 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a396f50-4a66-48fd-8b9c-805cb1d87bd6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:44:35.342535 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a396f50-4a66-48fd-8b9c-805cb1d87bd6 service glance] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:44:35.354337 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1452/2894] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:44:35 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 23 19:44:35.717280 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59f3d0-cfb1-494a-b094-bb0e6f965fed None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:44:35.718777 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-ce59f3d0-cfb1-494a-b094-bb0e6f965fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:44:35.787582 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59f3d0-cfb1-494a-b094-bb0e6f965fed None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:44:35.792321 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b11cc-a3c5-46c8-a5fb-7b28ee412d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:44:35.793180 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b11cc-a3c5-46c8-a5fb-7b28ee412d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:35.793493 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b11cc-a3c5-46c8-a5fb-7b28ee412d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:35.793773 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b11cc-a3c5-46c8-a5fb-7b28ee412d66 admin admin] PATH_INFO: `/v3/projects/49db545fc0964ddba65674a055afb097` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:35.795181 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b11cc-a3c5-46c8-a5fb-7b28ee412d66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49db545fc0964ddba65674a055afb097)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:44:35.797065 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b11cc-a3c5-46c8-a5fb-7b28ee412d66 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:44:35.905880 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-bc7b11cc-a3c5-46c8-a5fb-7b28ee412d66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49db545fc0964ddba65674a055afb097', 'request_id': 'req-bc7b11cc-a3c5-46c8-a5fb-7b28ee412d66'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:35.912555 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-bc7b11cc-a3c5-46c8-a5fb-7b28ee412d66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49db545fc0964ddba65674a055afb097', 'request_id': 'req-bc7b11cc-a3c5-46c8-a5fb-7b28ee412d66'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:35.918215 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-bc7b11cc-a3c5-46c8-a5fb-7b28ee412d66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49db545fc0964ddba65674a055afb097', 'request_id': 'req-bc7b11cc-a3c5-46c8-a5fb-7b28ee412d66'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:35.995832 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-bc7b11cc-a3c5-46c8-a5fb-7b28ee412d66 admin admin] The token cache is being invalidate because project 49db545fc0964ddba65674a055afb097 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:44:35.995832 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-bc7b11cc-a3c5-46c8-a5fb-7b28ee412d66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:35.995832 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-bc7b11cc-a3c5-46c8-a5fb-7b28ee412d66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:35.995832 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1443/2895] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:44:35 2021] DELETE /identity/v3/projects/49db545fc0964ddba65674a055afb097 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:44:39.947157 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a396f50-4a66-48fd-8b9c-805cb1d87bd6 service glance] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:44:39.948188 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-0a396f50-4a66-48fd-8b9c-805cb1d87bd6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:44:39.964326 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a396f50-4a66-48fd-8b9c-805cb1d87bd6 service glance] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:44:40.021716 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8bbbe2-b005-4112-930b-a5a9fb61aae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:44:40.022589 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8bbbe2-b005-4112-930b-a5a9fb61aae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:40.022960 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8bbbe2-b005-4112-930b-a5a9fb61aae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:40.023242 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8bbbe2-b005-4112-930b-a5a9fb61aae4 admin admin] PATH_INFO: `/v3/users/ecaf914ba335477182e4e1153d0d3f71` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:40.024468 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8bbbe2-b005-4112-930b-a5a9fb61aae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecaf914ba335477182e4e1153d0d3f71)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:44:40.026400 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8bbbe2-b005-4112-930b-a5a9fb61aae4 admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:44:40.146695 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-fc8bbbe2-b005-4112-930b-a5a9fb61aae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecaf914ba335477182e4e1153d0d3f71'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:40.147277 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-fc8bbbe2-b005-4112-930b-a5a9fb61aae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecaf914ba335477182e4e1153d0d3f71'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:40.201177 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-fc8bbbe2-b005-4112-930b-a5a9fb61aae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecaf914ba335477182e4e1153d0d3f71'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:40.201831 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-fc8bbbe2-b005-4112-930b-a5a9fb61aae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecaf914ba335477182e4e1153d0d3f71'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:40.215681 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-fc8bbbe2-b005-4112-930b-a5a9fb61aae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecaf914ba335477182e4e1153d0d3f71'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:40.229492 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1453/2896] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:44:39 2021] DELETE /identity/v3/users/ecaf914ba335477182e4e1153d0d3f71 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:44:40.472210 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b11cc-a3c5-46c8-a5fb-7b28ee412d66 admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:44:40.473703 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-bc7b11cc-a3c5-46c8-a5fb-7b28ee412d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:44:40.489807 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b11cc-a3c5-46c8-a5fb-7b28ee412d66 admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:44:40.555337 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711ae80-04c0-4227-9445-fe31012c611d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:44:40.556222 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711ae80-04c0-4227-9445-fe31012c611d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:40.556539 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711ae80-04c0-4227-9445-fe31012c611d admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:40.556838 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711ae80-04c0-4227-9445-fe31012c611d admin admin] PATH_INFO: `/v3/projects/257b0b2e531441b4bb745e99cfd799f3` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:40.558059 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2711ae80-04c0-4227-9445-fe31012c611d admin admin] RBAC: Authorizing `identity:delete_project(project_id=257b0b2e531441b4bb745e99cfd799f3)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:44:40.560224 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2711ae80-04c0-4227-9445-fe31012c611d admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:44:40.645911 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-2711ae80-04c0-4227-9445-fe31012c611d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '257b0b2e531441b4bb745e99cfd799f3', 'request_id': 'req-2711ae80-04c0-4227-9445-fe31012c611d'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:40.651793 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-2711ae80-04c0-4227-9445-fe31012c611d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '257b0b2e531441b4bb745e99cfd799f3', 'request_id': 'req-2711ae80-04c0-4227-9445-fe31012c611d'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:40.657173 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-2711ae80-04c0-4227-9445-fe31012c611d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '257b0b2e531441b4bb745e99cfd799f3', 'request_id': 'req-2711ae80-04c0-4227-9445-fe31012c611d'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:40.709853 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-2711ae80-04c0-4227-9445-fe31012c611d admin admin] The token cache is being invalidate because project 257b0b2e531441b4bb745e99cfd799f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:44:40.710136 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-2711ae80-04c0-4227-9445-fe31012c611d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:40.710743 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-2711ae80-04c0-4227-9445-fe31012c611d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:40.712290 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1444/2897] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:44:40 2021] DELETE /identity/v3/projects/257b0b2e531441b4bb745e99cfd799f3 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:44:40.716318 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8bbbe2-b005-4112-930b-a5a9fb61aae4 admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:44:40.717731 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-fc8bbbe2-b005-4112-930b-a5a9fb61aae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:44:40.731315 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8bbbe2-b005-4112-930b-a5a9fb61aae4 admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:44:40.786070 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa07ccc-ee19-4b92-884d-d662eb8054eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:44:40.786967 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa07ccc-ee19-4b92-884d-d662eb8054eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:40.787256 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa07ccc-ee19-4b92-884d-d662eb8054eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:40.787533 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa07ccc-ee19-4b92-884d-d662eb8054eb admin admin] PATH_INFO: `/v3/users/c0cfffaa6c7e464faeb2aca43d570045` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:40.788775 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa07ccc-ee19-4b92-884d-d662eb8054eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0cfffaa6c7e464faeb2aca43d570045)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:44:40.790734 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa07ccc-ee19-4b92-884d-d662eb8054eb admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:44:40.963918 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-7aa07ccc-ee19-4b92-884d-d662eb8054eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0cfffaa6c7e464faeb2aca43d570045'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:40.964605 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-7aa07ccc-ee19-4b92-884d-d662eb8054eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0cfffaa6c7e464faeb2aca43d570045'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:41.024852 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-7aa07ccc-ee19-4b92-884d-d662eb8054eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0cfffaa6c7e464faeb2aca43d570045'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:41.025385 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-7aa07ccc-ee19-4b92-884d-d662eb8054eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0cfffaa6c7e464faeb2aca43d570045'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:41.038566 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-7aa07ccc-ee19-4b92-884d-d662eb8054eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0cfffaa6c7e464faeb2aca43d570045'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:41.050783 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1454/2898] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:44:40 2021] DELETE /identity/v3/users/c0cfffaa6c7e464faeb2aca43d570045 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:44:41.294745 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711ae80-04c0-4227-9445-fe31012c611d admin admin] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:44:41.296177 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-2711ae80-04c0-4227-9445-fe31012c611d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:44:41.310645 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711ae80-04c0-4227-9445-fe31012c611d admin admin] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:44:41.369043 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c1434-ae61-4cb5-98c8-9aab18b3a6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:44:41.369942 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c1434-ae61-4cb5-98c8-9aab18b3a6f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:44:41.370226 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c1434-ae61-4cb5-98c8-9aab18b3a6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:44:41.370531 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c1434-ae61-4cb5-98c8-9aab18b3a6f5 admin admin] PATH_INFO: `/v3/projects/1e70ae5f657c4aebb6c283d99f5ccde0` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:44:41.371851 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c1434-ae61-4cb5-98c8-9aab18b3a6f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e70ae5f657c4aebb6c283d99f5ccde0)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:44:41.373830 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c1434-ae61-4cb5-98c8-9aab18b3a6f5 admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:44:41.493447 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-2a8c1434-ae61-4cb5-98c8-9aab18b3a6f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e70ae5f657c4aebb6c283d99f5ccde0', 'request_id': 'req-2a8c1434-ae61-4cb5-98c8-9aab18b3a6f5'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:41.499423 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-2a8c1434-ae61-4cb5-98c8-9aab18b3a6f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e70ae5f657c4aebb6c283d99f5ccde0', 'request_id': 'req-2a8c1434-ae61-4cb5-98c8-9aab18b3a6f5'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:41.505103 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-2a8c1434-ae61-4cb5-98c8-9aab18b3a6f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e70ae5f657c4aebb6c283d99f5ccde0', 'request_id': 'req-2a8c1434-ae61-4cb5-98c8-9aab18b3a6f5'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:41.573477 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-2a8c1434-ae61-4cb5-98c8-9aab18b3a6f5 admin admin] The token cache is being invalidate because project 1e70ae5f657c4aebb6c283d99f5ccde0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:44:41.573702 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-2a8c1434-ae61-4cb5-98c8-9aab18b3a6f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:41.574380 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-2a8c1434-ae61-4cb5-98c8-9aab18b3a6f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:44:41.575898 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1445/2899] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:44:41 2021] DELETE /identity/v3/projects/1e70ae5f657c4aebb6c283d99f5ccde0 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:45:07.512264 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa07ccc-ee19-4b92-884d-d662eb8054eb admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:45:07.513782 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-7aa07ccc-ee19-4b92-884d-d662eb8054eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:45:07.526287 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa07ccc-ee19-4b92-884d-d662eb8054eb admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:45:07.580490 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee8ab1-c237-40d4-a991-5ad5b7288fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:45:07.581354 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee8ab1-c237-40d4-a991-5ad5b7288fdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:45:07.581662 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee8ab1-c237-40d4-a991-5ad5b7288fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:45:07.581935 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee8ab1-c237-40d4-a991-5ad5b7288fdd admin admin] PATH_INFO: `/v3/users/6b4d76b569314959a42e2e9abb01e363` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:45:07.583135 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee8ab1-c237-40d4-a991-5ad5b7288fdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b4d76b569314959a42e2e9abb01e363)` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:45:07.585045 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee8ab1-c237-40d4-a991-5ad5b7288fdd admin admin] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:45:07.705536 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-94ee8ab1-c237-40d4-a991-5ad5b7288fdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b4d76b569314959a42e2e9abb01e363'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:45:07.706183 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-94ee8ab1-c237-40d4-a991-5ad5b7288fdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b4d76b569314959a42e2e9abb01e363'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:45:07.749668 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-94ee8ab1-c237-40d4-a991-5ad5b7288fdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b4d76b569314959a42e2e9abb01e363'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:45:07.750222 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-94ee8ab1-c237-40d4-a991-5ad5b7288fdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b4d76b569314959a42e2e9abb01e363'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:45:07.762246 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.notifications [None req-94ee8ab1-c237-40d4-a991-5ad5b7288fdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b4d76b569314959a42e2e9abb01e363'} {{(pid=79232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:45:07.774273 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1455/2900] 10.222.0.62 () {58 vars in 1223 bytes} [Tue Nov 23 19:45:07 2021] DELETE /identity/v3/users/6b4d76b569314959a42e2e9abb01e363 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:45:07.778806 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788a707-fff8-4c76-b389-93df0a87c366 None None] REQUEST_METHOD: `POST` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:45:07.779320 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788a707-fff8-4c76-b389-93df0a87c366 None None] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:45:07.779444 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788a707-fff8-4c76-b389-93df0a87c366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:45:07.797674 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.auth.core [None req-7788a707-fff8-4c76-b389-93df0a87c366 None None] MFA Rules not processed for user `992e61bfb655451f80bb04b469d3594e`. Rule list: `[]` (Enabled: `True`). {{(pid=79233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 23 19:45:07.798904 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-7788a707-fff8-4c76-b389-93df0a87c366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:45:07.856633 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1446/2901] 10.222.0.62 () {58 vars in 957 bytes} [Tue Nov 23 19:45:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 23 19:45:07.867135 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee8ab1-c237-40d4-a991-5ad5b7288fdd admin admin] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:45:07.868558 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-94ee8ab1-c237-40d4-a991-5ad5b7288fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:45:07.923980 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee8ab1-c237-40d4-a991-5ad5b7288fdd admin admin] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:45:07.927883 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b9225-ef59-44c0-9d3f-afbdb599e00d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1ef2ac0a788451eb50fa80f559f808f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:45:07.928524 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b9225-ef59-44c0-9d3f-afbdb599e00d service neutron] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:45:07.928806 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b9225-ef59-44c0-9d3f-afbdb599e00d service neutron] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:45:07.929082 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b9225-ef59-44c0-9d3f-afbdb599e00d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:45:07.938330 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b9225-ef59-44c0-9d3f-afbdb599e00d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:45:07.939728 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b9225-ef59-44c0-9d3f-afbdb599e00d service neutron] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:45:07.948958 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1456/2902] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:45:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 23 19:45:08.340911 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788a707-fff8-4c76-b389-93df0a87c366 None None] Authenticating user token {{(pid=79233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:45:08.342384 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.fernet_utils [None req-7788a707-fff8-4c76-b389-93df0a87c366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:45:08.355175 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788a707-fff8-4c76-b389-93df0a87c366 None None] Validating token access rules against request {{(pid=79233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:45:08.359928 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966dd51-ae6d-4260-a8d0-6b30517df61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992e61bfb655451f80bb04b469d3594e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbbece3b7f8c49dc96e2d01b1a42f43c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:45:08.360786 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966dd51-ae6d-4260-a8d0-6b30517df61b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:45:08.361120 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966dd51-ae6d-4260-a8d0-6b30517df61b admin admin] SCRIPT_NAME: `/identity` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:45:08.361398 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966dd51-ae6d-4260-a8d0-6b30517df61b admin admin] PATH_INFO: `/v3/projects/ca3f87d08ab34bc9b71a9ba8c20bf15c` {{(pid=79233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:45:08.362639 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966dd51-ae6d-4260-a8d0-6b30517df61b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca3f87d08ab34bc9b71a9ba8c20bf15c)` {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:45:08.364661 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966dd51-ae6d-4260-a8d0-6b30517df61b admin admin] RBAC: Authorization granted {{(pid=79233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:45:08.480474 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-2966dd51-ae6d-4260-a8d0-6b30517df61b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca3f87d08ab34bc9b71a9ba8c20bf15c', 'request_id': 'req-2966dd51-ae6d-4260-a8d0-6b30517df61b'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:45:08.486435 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-2966dd51-ae6d-4260-a8d0-6b30517df61b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca3f87d08ab34bc9b71a9ba8c20bf15c', 'request_id': 'req-2966dd51-ae6d-4260-a8d0-6b30517df61b'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:45:08.491979 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-2966dd51-ae6d-4260-a8d0-6b30517df61b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca3f87d08ab34bc9b71a9ba8c20bf15c', 'request_id': 'req-2966dd51-ae6d-4260-a8d0-6b30517df61b'} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:45:08.565636 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-2966dd51-ae6d-4260-a8d0-6b30517df61b admin admin] The token cache is being invalidate because project ca3f87d08ab34bc9b71a9ba8c20bf15c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 23 19:45:08.565933 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-2966dd51-ae6d-4260-a8d0-6b30517df61b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:45:08.566547 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: DEBUG keystone.notifications [None req-2966dd51-ae6d-4260-a8d0-6b30517df61b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 23 19:45:08.568674 dv-cinder-819011-1-iscsi devstack@keystone.service[79233]: [pid: 79233|app: 0|req: 1447/2903] 10.222.0.62 () {58 vars in 1232 bytes} [Tue Nov 23 19:45:08 2021] DELETE /identity/v3/projects/ca3f87d08ab34bc9b71a9ba8c20bf15c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 23 19:47:41.416208 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b9225-ef59-44c0-9d3f-afbdb599e00d service neutron] Authenticating user token {{(pid=79232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 23 19:47:41.418436 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-ab5b9225-ef59-44c0-9d3f-afbdb599e00d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:47:41.551548 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b9225-ef59-44c0-9d3f-afbdb599e00d service neutron] Validating token access rules against request {{(pid=79232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 23 19:47:41.607520 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2a9ed-72af-4186-8568-2026ca0f9f43 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd100a378f1ff441080555bfc2ff4d6ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2955b3037801465c9eec5d78fe2e3ae9', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 23 19:47:41.608165 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2a9ed-72af-4186-8568-2026ca0f9f43 service placement] REQUEST_METHOD: `GET` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 23 19:47:41.608451 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2a9ed-72af-4186-8568-2026ca0f9f43 service placement] SCRIPT_NAME: `/identity` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 23 19:47:41.608733 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2a9ed-72af-4186-8568-2026ca0f9f43 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 23 19:47:41.610529 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.fernet_utils [None req-9bc2a9ed-72af-4186-8568-2026ca0f9f43 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 23 19:47:41.621669 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2a9ed-72af-4186-8568-2026ca0f9f43 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 23 19:47:41.623221 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2a9ed-72af-4186-8568-2026ca0f9f43 service placement] RBAC: Authorization granted {{(pid=79232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 23 19:47:41.633079 dv-cinder-819011-1-iscsi devstack@keystone.service[79232]: [pid: 79232|app: 0|req: 1457/2904] 10.222.0.62 () {60 vars in 1365 bytes} [Tue Nov 23 19:47:41 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)